2023-02-17T22:26:41,554 Created temporary directory: /tmp/pip-ephem-wheel-cache-1of6e46z 2023-02-17T22:26:41,558 Created temporary directory: /tmp/pip-build-tracker-nexeb3cc 2023-02-17T22:26:41,559 Initialized build tracking at /tmp/pip-build-tracker-nexeb3cc 2023-02-17T22:26:41,559 Created build tracker: /tmp/pip-build-tracker-nexeb3cc 2023-02-17T22:26:41,560 Entered build tracker: /tmp/pip-build-tracker-nexeb3cc 2023-02-17T22:26:41,561 Created temporary directory: /tmp/pip-wheel-8jq6rnta 2023-02-17T22:26:41,569 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-02-17T22:26:41,575 Created temporary directory: /tmp/pip-ephem-wheel-cache-b1egigwp 2023-02-17T22:26:41,632 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-02-17T22:26:41,639 2 location(s) to search for versions of deepspeed: 2023-02-17T22:26:41,639 * https://pypi.org/simple/deepspeed/ 2023-02-17T22:26:41,639 * https://www.piwheels.org/simple/deepspeed/ 2023-02-17T22:26:41,640 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-02-17T22:26:41,641 Getting page https://pypi.org/simple/deepspeed/ 2023-02-17T22:26:41,644 Found index url https://pypi.org/simple 2023-02-17T22:26:41,833 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-02-17T22:26:41,864 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-02-17T22:26:41,865 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-02-17T22:26:41,866 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-02-17T22:26:41,866 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-02-17T22:26:41,867 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-02-17T22:26:41,868 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-02-17T22:26:41,868 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-02-17T22:26:41,869 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-02-17T22:26:41,870 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-02-17T22:26:41,870 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-02-17T22:26:41,871 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-02-17T22:26:41,872 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-02-17T22:26:41,872 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-02-17T22:26:41,873 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-02-17T22:26:41,874 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-02-17T22:26:41,874 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-02-17T22:26:41,875 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-02-17T22:26:41,876 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-02-17T22:26:41,876 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-02-17T22:26:41,877 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-02-17T22:26:41,878 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-02-17T22:26:41,879 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-02-17T22:26:41,879 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-02-17T22:26:41,880 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-02-17T22:26:41,880 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-02-17T22:26:41,881 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-02-17T22:26:41,882 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-02-17T22:26:41,882 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-02-17T22:26:41,883 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-02-17T22:26:41,884 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-02-17T22:26:41,884 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-02-17T22:26:41,885 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-02-17T22:26:41,886 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-02-17T22:26:41,887 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-02-17T22:26:41,888 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-02-17T22:26:41,888 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-02-17T22:26:41,889 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-02-17T22:26:41,890 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-02-17T22:26:41,890 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-02-17T22:26:41,891 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-02-17T22:26:41,892 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-02-17T22:26:41,892 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-02-17T22:26:41,893 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-02-17T22:26:41,894 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-02-17T22:26:41,894 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-02-17T22:26:41,895 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-02-17T22:26:41,896 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-02-17T22:26:41,896 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-02-17T22:26:41,897 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-02-17T22:26:41,898 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-02-17T22:26:41,898 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-02-17T22:26:41,899 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-02-17T22:26:41,900 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-02-17T22:26:41,900 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-02-17T22:26:41,901 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-02-17T22:26:41,902 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-02-17T22:26:41,902 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-02-17T22:26:41,903 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-02-17T22:26:41,904 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-02-17T22:26:41,904 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-02-17T22:26:41,905 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-02-17T22:26:41,906 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-02-17T22:26:41,906 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-02-17T22:26:41,907 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-02-17T22:26:41,908 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-02-17T22:26:41,910 Found index url https://www.piwheels.org/simple 2023-02-17T22:26:42,140 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-02-17T22:26:42,165 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,166 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,167 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,167 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,168 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,168 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,169 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,169 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,170 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,170 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,171 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,171 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,172 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,172 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,173 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,173 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,174 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,174 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,175 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,175 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,176 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,177 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,177 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,178 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,178 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,179 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,179 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,180 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,180 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,181 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,181 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,182 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,182 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-02-17T22:26:42,183 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-02-17T22:26:42,183 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-02-17T22:26:42,236 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-02-17T22:26:42,266 Collecting deepspeed==0.8.1 2023-02-17T22:26:42,271 Created temporary directory: /tmp/pip-unpack-ss24vlbo 2023-02-17T22:26:42,950 Downloading deepspeed-0.8.1.tar.gz (759 kB) 2023-02-17T22:26:45,738 Added deepspeed==0.8.1 from https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz to build tracker '/tmp/pip-build-tracker-nexeb3cc' 2023-02-17T22:26:45,742 Running setup.py (path:/tmp/pip-wheel-8jq6rnta/deepspeed_a5ef808790f44003b0a5530ddb2bd79d/setup.py) egg_info for package deepspeed 2023-02-17T22:26:45,743 Created temporary directory: /tmp/pip-pip-egg-info-b1klhbh7 2023-02-17T22:26:45,744 Preparing metadata (setup.py): started 2023-02-17T22:26:45,746 Running command python setup.py egg_info 2023-02-17T22:26:49,244 fatal: not a git repository (or any of the parent directories): .git 2023-02-17T22:26:50,531 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-02-17T22:26:50,531  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-02-17T22:26:50,532 DS_BUILD_OPS=0 2023-02-17T22:26:50,532  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-02-17T22:26:50,532  [WARNING]  async_io: please install the libaio-dev package with apt 2023-02-17T22:26:50,533  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-02-17T22:26:50,533  [WARNING]  unable to import torch, please install it first 2023-02-17T22:26:50,533  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-02-17T22:26:50,534  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-02-17T22:26:50,534 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-02-17T22:26:50,534 version=0.8.1, git_hash=unknown, git_branch=unknown 2023-02-17T22:26:50,535 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2023-02-17T22:26:50,535 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-02-17T22:26:50,536 ext_modules=[] 2023-02-17T22:26:50,536 running egg_info 2023-02-17T22:26:50,537 creating /tmp/pip-pip-egg-info-b1klhbh7/deepspeed.egg-info 2023-02-17T22:26:50,628 writing /tmp/pip-pip-egg-info-b1klhbh7/deepspeed.egg-info/PKG-INFO 2023-02-17T22:26:50,634 writing dependency_links to /tmp/pip-pip-egg-info-b1klhbh7/deepspeed.egg-info/dependency_links.txt 2023-02-17T22:26:50,639 writing entry points to /tmp/pip-pip-egg-info-b1klhbh7/deepspeed.egg-info/entry_points.txt 2023-02-17T22:26:50,643 writing requirements to /tmp/pip-pip-egg-info-b1klhbh7/deepspeed.egg-info/requires.txt 2023-02-17T22:26:50,646 writing top-level names to /tmp/pip-pip-egg-info-b1klhbh7/deepspeed.egg-info/top_level.txt 2023-02-17T22:26:50,649 writing manifest file '/tmp/pip-pip-egg-info-b1klhbh7/deepspeed.egg-info/SOURCES.txt' 2023-02-17T22:26:51,121 reading manifest file '/tmp/pip-pip-egg-info-b1klhbh7/deepspeed.egg-info/SOURCES.txt' 2023-02-17T22:26:51,125 reading manifest template 'MANIFEST.in' 2023-02-17T22:26:52,467 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-02-17T22:26:53,432 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-02-17T22:26:54,078 warning: no files found matching '*.tr' under directory 'csrc' 2023-02-17T22:26:54,223 warning: no files found matching '*.cc' under directory 'csrc' 2023-02-17T22:26:54,268 adding license file 'LICENSE' 2023-02-17T22:26:54,323 writing manifest file '/tmp/pip-pip-egg-info-b1klhbh7/deepspeed.egg-info/SOURCES.txt' 2023-02-17T22:26:54,326 deepspeed build time = 5.072161674499512 secs 2023-02-17T22:26:54,543 Preparing metadata (setup.py): finished with status 'done' 2023-02-17T22:26:54,563 Source in /tmp/pip-wheel-8jq6rnta/deepspeed_a5ef808790f44003b0a5530ddb2bd79d has version 0.8.1, which satisfies requirement deepspeed==0.8.1 from https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz 2023-02-17T22:26:54,565 Removed deepspeed==0.8.1 from https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz from build tracker '/tmp/pip-build-tracker-nexeb3cc' 2023-02-17T22:26:54,581 Created temporary directory: /tmp/pip-unpack-zqznwf14 2023-02-17T22:26:54,583 Building wheels for collected packages: deepspeed 2023-02-17T22:26:54,592 Created temporary directory: /tmp/pip-wheel-6yi7gmt2 2023-02-17T22:26:54,592 Building wheel for deepspeed (setup.py): started 2023-02-17T22:26:54,594 Destination directory: /tmp/pip-wheel-6yi7gmt2 2023-02-17T22:26:54,595 Running command python setup.py bdist_wheel 2023-02-17T22:26:56,914 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-02-17T22:26:56,938  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-02-17T22:26:57,025 DS_BUILD_OPS=0 2023-02-17T22:26:57,325  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-02-17T22:26:57,491  [WARNING]  async_io: please install the libaio-dev package with apt 2023-02-17T22:26:57,492  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-02-17T22:26:57,496  [WARNING]  unable to import torch, please install it first 2023-02-17T22:26:57,497  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-02-17T22:26:57,498  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-02-17T22:26:57,499 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-02-17T22:26:57,540 fatal: not a git repository (or any of the parent directories): .git 2023-02-17T22:26:57,545 version=0.8.1, git_hash=unknown, git_branch=unknown 2023-02-17T22:26:57,547 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2023-02-17T22:26:57,548 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-02-17T22:26:57,548 ext_modules=[] 2023-02-17T22:26:58,836 running bdist_wheel 2023-02-17T22:26:59,724 running build 2023-02-17T22:26:59,725 running build_py 2023-02-17T22:26:59,825 creating build 2023-02-17T22:26:59,826 creating build/lib 2023-02-17T22:26:59,827 creating build/lib/deepspeed 2023-02-17T22:26:59,830 copying deepspeed/constants.py -> build/lib/deepspeed 2023-02-17T22:26:59,833 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-02-17T22:26:59,836 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-02-17T22:26:59,840 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-02-17T22:26:59,843 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-02-17T22:26:59,849 creating build/lib/deepspeed/elasticity 2023-02-17T22:26:59,851 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-02-17T22:26:59,858 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-02-17T22:26:59,862 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-02-17T22:26:59,865 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-02-17T22:26:59,869 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-02-17T22:26:59,872 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-02-17T22:26:59,877 creating build/lib/deepspeed/nebula 2023-02-17T22:26:59,879 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-02-17T22:26:59,882 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-02-17T22:26:59,885 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-02-17T22:26:59,893 creating build/lib/deepspeed/pipe 2023-02-17T22:26:59,894 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-02-17T22:26:59,900 creating build/lib/deepspeed/compression 2023-02-17T22:26:59,901 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-02-17T22:26:59,906 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-02-17T22:26:59,910 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-02-17T22:26:59,916 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-02-17T22:26:59,920 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-02-17T22:26:59,927 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-02-17T22:26:59,931 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-02-17T22:26:59,935 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-02-17T22:26:59,942 creating build/lib/deepspeed/comm 2023-02-17T22:26:59,944 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-02-17T22:26:59,949 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-02-17T22:26:59,953 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-02-17T22:26:59,957 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-02-17T22:26:59,960 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-02-17T22:26:59,966 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-02-17T22:26:59,970 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-02-17T22:26:59,976 creating build/lib/deepspeed/module_inject 2023-02-17T22:26:59,978 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-02-17T22:26:59,984 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-02-17T22:26:59,987 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-02-17T22:26:59,990 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-02-17T22:26:59,994 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-02-17T22:26:59,997 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-02-17T22:27:00,002 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-02-17T22:27:00,005 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-02-17T22:27:00,008 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-02-17T22:27:00,012 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-02-17T22:27:00,017 creating build/lib/deepspeed/checkpoint 2023-02-17T22:27:00,018 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-02-17T22:27:00,022 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-02-17T22:27:00,026 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-02-17T22:27:00,030 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-02-17T22:27:00,034 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-02-17T22:27:00,037 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-02-17T22:27:00,041 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-02-17T22:27:00,044 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-02-17T22:27:00,048 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-02-17T22:27:00,053 creating build/lib/deepspeed/monitor 2023-02-17T22:27:00,055 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-02-17T22:27:00,059 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-02-17T22:27:00,062 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-02-17T22:27:00,065 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-02-17T22:27:00,069 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-02-17T22:27:00,072 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-02-17T22:27:00,075 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-02-17T22:27:00,080 creating build/lib/deepspeed/moe 2023-02-17T22:27:00,081 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-02-17T22:27:00,086 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-02-17T22:27:00,090 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-02-17T22:27:00,093 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-02-17T22:27:00,098 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-02-17T22:27:00,102 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-02-17T22:27:00,106 creating build/lib/deepspeed/accelerator 2023-02-17T22:27:00,107 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-02-17T22:27:00,112 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-02-17T22:27:00,115 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-02-17T22:27:00,119 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-02-17T22:27:00,123 creating build/lib/deepspeed/inference 2023-02-17T22:27:00,125 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-02-17T22:27:00,130 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-02-17T22:27:00,134 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-02-17T22:27:00,138 creating build/lib/deepspeed/profiling 2023-02-17T22:27:00,140 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-02-17T22:27:00,144 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-02-17T22:27:00,147 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-02-17T22:27:00,152 creating build/lib/deepspeed/runtime 2023-02-17T22:27:00,154 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,158 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,162 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,173 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,177 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,183 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,187 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,192 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,198 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,202 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,205 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,208 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,212 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,218 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,222 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-02-17T22:27:00,226 creating build/lib/deepspeed/model_implementations 2023-02-17T22:27:00,228 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-02-17T22:27:00,232 creating build/lib/deepspeed/ops 2023-02-17T22:27:00,233 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-02-17T22:27:00,239 creating build/lib/deepspeed/utils 2023-02-17T22:27:00,241 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,245 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,248 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,252 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,256 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,259 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,262 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,265 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,269 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,273 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,277 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,281 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,284 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-02-17T22:27:00,289 creating build/lib/deepspeed/autotuning 2023-02-17T22:27:00,290 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-02-17T22:27:00,297 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-02-17T22:27:00,301 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-02-17T22:27:00,305 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-02-17T22:27:00,309 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-02-17T22:27:00,313 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-02-17T22:27:00,318 creating build/lib/deepspeed/launcher 2023-02-17T22:27:00,319 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-02-17T22:27:00,324 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-02-17T22:27:00,329 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-02-17T22:27:00,332 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-02-17T22:27:00,335 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-02-17T22:27:00,342 creating build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,344 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,348 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,352 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,356 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,361 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,365 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,369 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,373 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,378 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,382 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,387 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,391 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,395 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,400 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,404 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,409 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-02-17T22:27:00,414 creating build/lib/deepspeed/module_inject/containers/features 2023-02-17T22:27:00,416 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-02-17T22:27:00,421 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-02-17T22:27:00,425 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-02-17T22:27:00,445 creating build/lib/deepspeed/profiling/flops_profiler 2023-02-17T22:27:00,448 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-02-17T22:27:00,454 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-02-17T22:27:00,460 creating build/lib/deepspeed/runtime/swap_tensor 2023-02-17T22:27:00,462 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-02-17T22:27:00,466 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-02-17T22:27:00,470 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-02-17T22:27:00,473 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-02-17T22:27:00,478 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-02-17T22:27:00,482 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-02-17T22:27:00,486 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-02-17T22:27:00,490 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-02-17T22:27:00,497 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-02-17T22:27:00,505 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-02-17T22:27:00,507 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-02-17T22:27:00,510 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-02-17T22:27:00,513 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-02-17T22:27:00,520 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-02-17T22:27:00,522 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-02-17T22:27:00,527 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-02-17T22:27:00,531 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-02-17T22:27:00,535 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-02-17T22:27:00,540 creating build/lib/deepspeed/runtime/pipe 2023-02-17T22:27:00,542 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-02-17T22:27:00,548 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-02-17T22:27:00,553 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-02-17T22:27:00,561 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-02-17T22:27:00,566 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-02-17T22:27:00,570 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-02-17T22:27:00,575 creating build/lib/deepspeed/runtime/compression 2023-02-17T22:27:00,576 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-02-17T22:27:00,579 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-02-17T22:27:00,584 creating build/lib/deepspeed/runtime/comm 2023-02-17T22:27:00,585 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-02-17T22:27:00,590 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-02-17T22:27:00,594 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-02-17T22:27:00,597 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-02-17T22:27:00,602 creating build/lib/deepspeed/runtime/data_pipeline 2023-02-17T22:27:00,603 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-02-17T22:27:00,608 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-02-17T22:27:00,612 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-02-17T22:27:00,616 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-02-17T22:27:00,621 creating build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,622 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,627 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,634 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,637 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,642 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,648 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,651 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,664 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,667 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,673 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,676 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,686 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,690 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-02-17T22:27:00,696 creating build/lib/deepspeed/runtime/fp16 2023-02-17T22:27:00,698 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-02-17T22:27:00,703 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-02-17T22:27:00,707 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-02-17T22:27:00,712 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-02-17T22:27:00,716 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:00,718 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:00,723 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:00,729 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:00,734 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:00,737 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:00,741 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:00,743 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:00,747 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:00,750 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:00,754 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:00,758 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:00,762 creating build/lib/deepspeed/runtime/fp16/onebit 2023-02-17T22:27:00,763 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-02-17T22:27:00,768 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-02-17T22:27:00,774 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-02-17T22:27:00,779 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-02-17T22:27:00,784 creating build/lib/deepspeed/model_implementations/transformers 2023-02-17T22:27:00,785 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-02-17T22:27:00,789 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-02-17T22:27:00,792 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-02-17T22:27:00,796 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-02-17T22:27:00,799 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-02-17T22:27:00,802 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-02-17T22:27:00,806 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-02-17T22:27:00,809 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-02-17T22:27:00,813 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-02-17T22:27:00,817 creating build/lib/deepspeed/model_implementations/diffusers 2023-02-17T22:27:00,819 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-02-17T22:27:00,823 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-02-17T22:27:00,826 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-02-17T22:27:00,830 creating build/lib/deepspeed/ops/aio 2023-02-17T22:27:00,831 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-02-17T22:27:00,836 creating build/lib/deepspeed/ops/random_ltd 2023-02-17T22:27:00,837 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-02-17T22:27:00,841 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-02-17T22:27:00,846 creating build/lib/deepspeed/ops/adagrad 2023-02-17T22:27:00,848 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-02-17T22:27:00,852 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-02-17T22:27:00,857 creating build/lib/deepspeed/ops/adam 2023-02-17T22:27:00,858 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-02-17T22:27:00,863 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-02-17T22:27:00,866 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-02-17T22:27:00,870 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-02-17T22:27:00,876 creating build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,878 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,881 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,885 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,888 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,891 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,895 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,898 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,902 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,905 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,909 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,912 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,915 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,919 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,922 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,925 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,932 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-02-17T22:27:00,936 creating build/lib/deepspeed/ops/transformer 2023-02-17T22:27:00,938 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-02-17T22:27:00,944 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-02-17T22:27:00,949 creating build/lib/deepspeed/ops/quantizer 2023-02-17T22:27:00,950 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-02-17T22:27:00,954 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-02-17T22:27:00,959 creating build/lib/deepspeed/ops/sparse_attention 2023-02-17T22:27:00,961 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-02-17T22:27:00,966 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-02-17T22:27:00,974 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-02-17T22:27:00,978 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-02-17T22:27:00,981 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-02-17T22:27:00,986 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-02-17T22:27:00,989 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-02-17T22:27:00,998 creating build/lib/deepspeed/ops/lamb 2023-02-17T22:27:01,000 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-02-17T22:27:01,004 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-02-17T22:27:01,010 creating build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,011 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,015 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,020 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,024 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,028 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,033 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,037 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,041 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,045 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,050 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-02-17T22:27:01,055 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,057 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,061 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,064 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,067 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,071 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,074 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,077 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,081 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,084 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,088 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:01,092 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-02-17T22:27:01,093 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-02-17T22:27:01,099 creating build/lib/deepspeed/autotuning/tuner 2023-02-17T22:27:01,100 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-02-17T22:27:01,105 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-02-17T22:27:01,108 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-02-17T22:27:01,111 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-02-17T22:27:01,115 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-02-17T22:27:01,118 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-02-17T22:27:01,122 running egg_info 2023-02-17T22:27:01,310 writing deepspeed.egg-info/PKG-INFO 2023-02-17T22:27:01,316 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-02-17T22:27:01,320 writing entry points to deepspeed.egg-info/entry_points.txt 2023-02-17T22:27:01,324 writing requirements to deepspeed.egg-info/requires.txt 2023-02-17T22:27:01,326 writing top-level names to deepspeed.egg-info/top_level.txt 2023-02-17T22:27:01,502 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-02-17T22:27:01,588 reading manifest template 'MANIFEST.in' 2023-02-17T22:27:02,835 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-02-17T22:27:03,788 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-02-17T22:27:04,426 warning: no files found matching '*.tr' under directory 'csrc' 2023-02-17T22:27:04,571 warning: no files found matching '*.cc' under directory 'csrc' 2023-02-17T22:27:04,618 adding license file 'LICENSE' 2023-02-17T22:27:04,689 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-02-17T22:27:04,707 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.autotuning.config_templates' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,707 !! 2023-02-17T22:27:04,708 ############################ 2023-02-17T22:27:04,709 # Package would be ignored # 2023-02-17T22:27:04,709 ############################ 2023-02-17T22:27:04,709 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, 2023-02-17T22:27:04,709 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,710 'deepspeed.autotuning.config_templates' has been automatically added to the distribution only 2023-02-17T22:27:04,710 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,711 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,711 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2023-02-17T22:27:04,711 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,712 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,712 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,713 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,713 documentation page. 2023-02-17T22:27:04,714 !! 2023-02-17T22:27:04,714 check.warn(importable) 2023-02-17T22:27:04,715 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adagrad' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,715 !! 2023-02-17T22:27:04,716 ############################ 2023-02-17T22:27:04,716 # Package would be ignored # 2023-02-17T22:27:04,717 ############################ 2023-02-17T22:27:04,717 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, 2023-02-17T22:27:04,717 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,718 'deepspeed.ops.csrc.adagrad' has been automatically added to the distribution only 2023-02-17T22:27:04,718 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,718 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,719 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2023-02-17T22:27:04,719 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,719 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,720 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,720 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,721 documentation page. 2023-02-17T22:27:04,721 !! 2023-02-17T22:27:04,722 check.warn(importable) 2023-02-17T22:27:04,722 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adam' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,723 !! 2023-02-17T22:27:04,723 ############################ 2023-02-17T22:27:04,724 # Package would be ignored # 2023-02-17T22:27:04,724 ############################ 2023-02-17T22:27:04,724 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, 2023-02-17T22:27:04,725 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,725 'deepspeed.ops.csrc.adam' has been automatically added to the distribution only 2023-02-17T22:27:04,725 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,726 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,726 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2023-02-17T22:27:04,727 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,727 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,727 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,728 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,728 documentation page. 2023-02-17T22:27:04,729 !! 2023-02-17T22:27:04,730 check.warn(importable) 2023-02-17T22:27:04,730 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.common' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,730 !! 2023-02-17T22:27:04,731 ############################ 2023-02-17T22:27:04,732 # Package would be ignored # 2023-02-17T22:27:04,732 ############################ 2023-02-17T22:27:04,732 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, 2023-02-17T22:27:04,732 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,733 'deepspeed.ops.csrc.aio.common' has been automatically added to the distribution only 2023-02-17T22:27:04,733 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,733 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,734 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2023-02-17T22:27:04,734 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,735 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,735 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,735 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,736 documentation page. 2023-02-17T22:27:04,737 !! 2023-02-17T22:27:04,737 check.warn(importable) 2023-02-17T22:27:04,738 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_lib' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,738 !! 2023-02-17T22:27:04,739 ############################ 2023-02-17T22:27:04,739 # Package would be ignored # 2023-02-17T22:27:04,739 ############################ 2023-02-17T22:27:04,740 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, 2023-02-17T22:27:04,740 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,740 'deepspeed.ops.csrc.aio.py_lib' has been automatically added to the distribution only 2023-02-17T22:27:04,741 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,741 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,741 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2023-02-17T22:27:04,742 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,742 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,742 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,743 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,743 documentation page. 2023-02-17T22:27:04,744 !! 2023-02-17T22:27:04,745 check.warn(importable) 2023-02-17T22:27:04,745 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_test' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,745 !! 2023-02-17T22:27:04,746 ############################ 2023-02-17T22:27:04,746 # Package would be ignored # 2023-02-17T22:27:04,747 ############################ 2023-02-17T22:27:04,747 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, 2023-02-17T22:27:04,747 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,748 'deepspeed.ops.csrc.aio.py_test' has been automatically added to the distribution only 2023-02-17T22:27:04,748 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,748 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,749 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2023-02-17T22:27:04,749 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,749 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,750 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,750 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,750 documentation page. 2023-02-17T22:27:04,751 !! 2023-02-17T22:27:04,752 check.warn(importable) 2023-02-17T22:27:04,752 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.common' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,752 !! 2023-02-17T22:27:04,753 ############################ 2023-02-17T22:27:04,754 # Package would be ignored # 2023-02-17T22:27:04,754 ############################ 2023-02-17T22:27:04,754 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, 2023-02-17T22:27:04,754 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,755 'deepspeed.ops.csrc.common' has been automatically added to the distribution only 2023-02-17T22:27:04,755 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,755 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,756 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2023-02-17T22:27:04,756 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,757 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,757 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,757 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,758 documentation page. 2023-02-17T22:27:04,759 !! 2023-02-17T22:27:04,759 check.warn(importable) 2023-02-17T22:27:04,759 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.includes' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,760 !! 2023-02-17T22:27:04,760 ############################ 2023-02-17T22:27:04,761 # Package would be ignored # 2023-02-17T22:27:04,761 ############################ 2023-02-17T22:27:04,761 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, 2023-02-17T22:27:04,762 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,762 'deepspeed.ops.csrc.includes' has been automatically added to the distribution only 2023-02-17T22:27:04,762 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,763 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,763 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2023-02-17T22:27:04,764 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,764 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,764 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,765 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,765 documentation page. 2023-02-17T22:27:04,766 !! 2023-02-17T22:27:04,767 check.warn(importable) 2023-02-17T22:27:04,767 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.lamb' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,767 !! 2023-02-17T22:27:04,768 ############################ 2023-02-17T22:27:04,768 # Package would be ignored # 2023-02-17T22:27:04,769 ############################ 2023-02-17T22:27:04,769 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, 2023-02-17T22:27:04,769 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,770 'deepspeed.ops.csrc.lamb' has been automatically added to the distribution only 2023-02-17T22:27:04,770 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,770 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,771 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2023-02-17T22:27:04,771 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,771 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,772 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,772 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,772 documentation page. 2023-02-17T22:27:04,774 !! 2023-02-17T22:27:04,774 check.warn(importable) 2023-02-17T22:27:04,775 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.quantization' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,775 !! 2023-02-17T22:27:04,777 ############################ 2023-02-17T22:27:04,777 # Package would be ignored # 2023-02-17T22:27:04,778 ############################ 2023-02-17T22:27:04,778 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, 2023-02-17T22:27:04,779 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,780 'deepspeed.ops.csrc.quantization' has been automatically added to the distribution only 2023-02-17T22:27:04,780 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,781 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,782 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2023-02-17T22:27:04,782 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,782 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,783 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,784 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,784 documentation page. 2023-02-17T22:27:04,785 !! 2023-02-17T22:27:04,786 check.warn(importable) 2023-02-17T22:27:04,786 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.random_ltd' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,787 !! 2023-02-17T22:27:04,788 ############################ 2023-02-17T22:27:04,788 # Package would be ignored # 2023-02-17T22:27:04,789 ############################ 2023-02-17T22:27:04,789 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package, 2023-02-17T22:27:04,789 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,790 'deepspeed.ops.csrc.random_ltd' has been automatically added to the distribution only 2023-02-17T22:27:04,790 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,791 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,791 Please make sure that 'deepspeed.ops.csrc.random_ltd' is included as a package by using 2023-02-17T22:27:04,792 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,792 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,792 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,793 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,793 documentation page. 2023-02-17T22:27:04,794 !! 2023-02-17T22:27:04,795 check.warn(importable) 2023-02-17T22:27:04,795 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.sparse_attention' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,795 !! 2023-02-17T22:27:04,797 ############################ 2023-02-17T22:27:04,797 # Package would be ignored # 2023-02-17T22:27:04,798 ############################ 2023-02-17T22:27:04,798 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, 2023-02-17T22:27:04,798 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,799 'deepspeed.ops.csrc.sparse_attention' has been automatically added to the distribution only 2023-02-17T22:27:04,799 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,800 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,800 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2023-02-17T22:27:04,801 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,801 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,802 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,803 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,803 documentation page. 2023-02-17T22:27:04,804 !! 2023-02-17T22:27:04,804 check.warn(importable) 2023-02-17T22:27:04,805 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.csrc' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,805 !! 2023-02-17T22:27:04,806 ############################ 2023-02-17T22:27:04,806 # Package would be ignored # 2023-02-17T22:27:04,807 ############################ 2023-02-17T22:27:04,807 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package, 2023-02-17T22:27:04,807 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,808 'deepspeed.ops.csrc.spatial.csrc' has been automatically added to the distribution only 2023-02-17T22:27:04,808 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,809 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,809 Please make sure that 'deepspeed.ops.csrc.spatial.csrc' is included as a package by using 2023-02-17T22:27:04,810 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,811 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,811 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,812 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,812 documentation page. 2023-02-17T22:27:04,813 !! 2023-02-17T22:27:04,814 check.warn(importable) 2023-02-17T22:27:04,814 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.includes' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,814 !! 2023-02-17T22:27:04,815 ############################ 2023-02-17T22:27:04,815 # Package would be ignored # 2023-02-17T22:27:04,816 ############################ 2023-02-17T22:27:04,816 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package, 2023-02-17T22:27:04,816 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,817 'deepspeed.ops.csrc.spatial.includes' has been automatically added to the distribution only 2023-02-17T22:27:04,817 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,818 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,818 Please make sure that 'deepspeed.ops.csrc.spatial.includes' is included as a package by using 2023-02-17T22:27:04,819 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,819 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,819 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,820 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,820 documentation page. 2023-02-17T22:27:04,821 !! 2023-02-17T22:27:04,822 check.warn(importable) 2023-02-17T22:27:04,822 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,822 !! 2023-02-17T22:27:04,823 ############################ 2023-02-17T22:27:04,824 # Package would be ignored # 2023-02-17T22:27:04,824 ############################ 2023-02-17T22:27:04,824 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, 2023-02-17T22:27:04,825 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,825 'deepspeed.ops.csrc.transformer' has been automatically added to the distribution only 2023-02-17T22:27:04,826 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,826 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,827 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2023-02-17T22:27:04,827 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,827 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,828 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,828 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,828 documentation page. 2023-02-17T22:27:04,829 !! 2023-02-17T22:27:04,830 check.warn(importable) 2023-02-17T22:27:04,830 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.csrc' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,831 !! 2023-02-17T22:27:04,832 ############################ 2023-02-17T22:27:04,832 # Package would be ignored # 2023-02-17T22:27:04,832 ############################ 2023-02-17T22:27:04,833 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, 2023-02-17T22:27:04,833 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,834 'deepspeed.ops.csrc.transformer.inference.csrc' has been automatically added to the distribution only 2023-02-17T22:27:04,834 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,834 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,835 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2023-02-17T22:27:04,835 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,836 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,836 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,837 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,837 documentation page. 2023-02-17T22:27:04,838 !! 2023-02-17T22:27:04,838 check.warn(importable) 2023-02-17T22:27:04,839 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.includes' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,839 !! 2023-02-17T22:27:04,840 ############################ 2023-02-17T22:27:04,840 # Package would be ignored # 2023-02-17T22:27:04,841 ############################ 2023-02-17T22:27:04,841 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, 2023-02-17T22:27:04,841 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,842 'deepspeed.ops.csrc.transformer.inference.includes' has been automatically added to the distribution only 2023-02-17T22:27:04,842 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,843 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,843 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2023-02-17T22:27:04,843 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,844 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,844 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,845 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,845 documentation page. 2023-02-17T22:27:04,846 !! 2023-02-17T22:27:04,847 check.warn(importable) 2023-02-17T22:27:04,847 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.utils' as data is deprecated, please list it in `packages`. 2023-02-17T22:27:04,847 !! 2023-02-17T22:27:04,848 ############################ 2023-02-17T22:27:04,849 # Package would be ignored # 2023-02-17T22:27:04,849 ############################ 2023-02-17T22:27:04,849 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, 2023-02-17T22:27:04,850 but it is not listed in the `packages` configuration of setuptools. 2023-02-17T22:27:04,850 'deepspeed.ops.csrc.utils' has been automatically added to the distribution only 2023-02-17T22:27:04,851 because it may contain data files, but this behavior is likely to change 2023-02-17T22:27:04,851 in future versions of setuptools (and therefore is considered deprecated). 2023-02-17T22:27:04,852 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2023-02-17T22:27:04,852 the `packages` configuration field or the proper discovery methods 2023-02-17T22:27:04,852 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-02-17T22:27:04,853 instead of `find_packages(...)`/`find:`). 2023-02-17T22:27:04,853 You can read more about "package discovery" and "data files" on setuptools 2023-02-17T22:27:04,854 documentation page. 2023-02-17T22:27:04,855 !! 2023-02-17T22:27:04,855 check.warn(importable) 2023-02-17T22:27:04,855 creating build/lib/deepspeed/ops/csrc 2023-02-17T22:27:04,856 creating build/lib/deepspeed/ops/csrc/adagrad 2023-02-17T22:27:04,856 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-02-17T22:27:04,856 creating build/lib/deepspeed/ops/csrc/adam 2023-02-17T22:27:04,857 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-02-17T22:27:04,857 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-02-17T22:27:04,857 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-02-17T22:27:04,858 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-02-17T22:27:04,858 creating build/lib/deepspeed/ops/csrc/aio 2023-02-17T22:27:04,858 creating build/lib/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:04,859 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:04,859 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:04,859 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:04,860 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:04,860 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:04,860 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:04,861 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,861 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,861 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,862 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,862 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,862 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,863 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,868 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,873 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,877 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,882 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,887 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:04,891 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-02-17T22:27:04,894 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-02-17T22:27:04,898 creating build/lib/deepspeed/ops/csrc/common 2023-02-17T22:27:04,900 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-02-17T22:27:04,905 creating build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,907 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,912 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,917 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,921 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,926 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,932 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,937 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,943 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,948 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,954 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,959 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,963 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,967 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,972 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,975 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,980 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,985 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,990 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:04,996 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:05,001 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:05,005 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:05,023 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:05,027 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:05,032 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:05,037 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:05,040 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:05,045 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-02-17T22:27:05,049 creating build/lib/deepspeed/ops/csrc/lamb 2023-02-17T22:27:05,050 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-02-17T22:27:05,054 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-02-17T22:27:05,059 creating build/lib/deepspeed/ops/csrc/quantization 2023-02-17T22:27:05,060 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-02-17T22:27:05,064 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-02-17T22:27:05,071 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-02-17T22:27:05,075 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-02-17T22:27:05,079 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-02-17T22:27:05,081 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-02-17T22:27:05,085 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-02-17T22:27:05,089 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-02-17T22:27:05,093 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-02-17T22:27:05,098 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-02-17T22:27:05,099 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-02-17T22:27:05,103 creating build/lib/deepspeed/ops/csrc/spatial 2023-02-17T22:27:05,104 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-02-17T22:27:05,105 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-02-17T22:27:05,110 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-02-17T22:27:05,114 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-02-17T22:27:05,115 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-02-17T22:27:05,119 creating build/lib/deepspeed/ops/csrc/transformer 2023-02-17T22:27:05,120 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-02-17T22:27:05,125 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-02-17T22:27:05,131 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-02-17T22:27:05,138 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-02-17T22:27:05,142 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-02-17T22:27:05,147 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-02-17T22:27:05,155 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-02-17T22:27:05,161 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-02-17T22:27:05,166 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-02-17T22:27:05,167 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:05,169 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:05,174 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:05,178 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:05,184 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:05,189 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:05,197 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:05,202 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:05,208 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:05,214 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-02-17T22:27:05,216 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-02-17T22:27:05,222 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-02-17T22:27:05,228 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-02-17T22:27:05,233 creating build/lib/deepspeed/ops/csrc/utils 2023-02-17T22:27:05,235 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-02-17T22:27:05,239 creating build/lib/deepspeed/autotuning/config_templates 2023-02-17T22:27:05,241 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-02-17T22:27:05,246 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-02-17T22:27:05,250 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-02-17T22:27:05,255 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-02-17T22:27:05,258 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-02-17T22:27:05,263 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-02-17T22:27:05,266 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-02-17T22:27:05,341 running build_scripts 2023-02-17T22:27:05,342 creating build/scripts-3.7 2023-02-17T22:27:05,343 copying and adjusting bin/deepspeed -> build/scripts-3.7 2023-02-17T22:27:05,347 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2023-02-17T22:27:05,349 copying and adjusting bin/ds -> build/scripts-3.7 2023-02-17T22:27:05,352 copying bin/ds_ssh -> build/scripts-3.7 2023-02-17T22:27:05,356 copying and adjusting bin/ds_report -> build/scripts-3.7 2023-02-17T22:27:05,358 copying and adjusting bin/ds_bench -> build/scripts-3.7 2023-02-17T22:27:05,361 copying and adjusting bin/dsr -> build/scripts-3.7 2023-02-17T22:27:05,364 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2023-02-17T22:27:05,365 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2023-02-17T22:27:05,366 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2023-02-17T22:27:05,366 changing mode of build/scripts-3.7/ds from 644 to 755 2023-02-17T22:27:05,367 changing mode of build/scripts-3.7/ds_report from 644 to 755 2023-02-17T22:27:05,367 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2023-02-17T22:27:05,368 changing mode of build/scripts-3.7/dsr from 644 to 755 2023-02-17T22:27:05,368 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2023-02-17T22:27:05,473 /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2023-02-17T22:27:05,473 setuptools.SetuptoolsDeprecationWarning, 2023-02-17T22:27:05,567 installing to build/bdist.linux-armv7l/wheel 2023-02-17T22:27:05,568 running install 2023-02-17T22:27:05,630 running install_lib 2023-02-17T22:27:05,727 creating build/bdist.linux-armv7l 2023-02-17T22:27:05,728 creating build/bdist.linux-armv7l/wheel 2023-02-17T22:27:05,732 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-02-17T22:27:05,734 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-02-17T22:27:05,736 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-02-17T22:27:05,741 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-02-17T22:27:05,744 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-02-17T22:27:05,748 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-02-17T22:27:05,751 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-02-17T22:27:05,754 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-02-17T22:27:05,759 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-02-17T22:27:05,760 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-02-17T22:27:05,764 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-02-17T22:27:05,767 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-02-17T22:27:05,771 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-02-17T22:27:05,772 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-02-17T22:27:05,777 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-02-17T22:27:05,778 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-02-17T22:27:05,783 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-02-17T22:27:05,787 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-02-17T22:27:05,791 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-02-17T22:27:05,795 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-02-17T22:27:05,801 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-02-17T22:27:05,805 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-02-17T22:27:05,808 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-02-17T22:27:05,813 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-02-17T22:27:05,814 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-02-17T22:27:05,819 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-02-17T22:27:05,822 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-02-17T22:27:05,825 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-02-17T22:27:05,828 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-02-17T22:27:05,833 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-02-17T22:27:05,837 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-02-17T22:27:05,840 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-02-17T22:27:05,844 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,846 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,851 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,855 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,858 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,862 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,865 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,869 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,873 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,877 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,879 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,883 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,887 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,890 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,894 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,897 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,900 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,904 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,908 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,911 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,915 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,918 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,921 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,925 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,929 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-02-17T22:27:05,930 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-02-17T22:27:05,934 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-02-17T22:27:05,937 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-02-17T22:27:05,941 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,944 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-02-17T22:27:05,947 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,950 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-02-17T22:27:05,954 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-02-17T22:27:05,956 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-02-17T22:27:05,959 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-02-17T22:27:05,963 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-02-17T22:27:05,966 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-02-17T22:27:05,970 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-02-17T22:27:05,973 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-02-17T22:27:05,977 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-02-17T22:27:05,981 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-02-17T22:27:05,984 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-02-17T22:27:05,989 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-02-17T22:27:05,990 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-02-17T22:27:05,994 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-02-17T22:27:05,997 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-02-17T22:27:06,000 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-02-17T22:27:06,003 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-02-17T22:27:06,006 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-02-17T22:27:06,009 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-02-17T22:27:06,013 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-02-17T22:27:06,014 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-02-17T22:27:06,020 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-02-17T22:27:06,023 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-02-17T22:27:06,026 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-02-17T22:27:06,029 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-02-17T22:27:06,033 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-02-17T22:27:06,035 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-02-17T22:27:06,040 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-02-17T22:27:06,041 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-02-17T22:27:06,045 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-02-17T22:27:06,048 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-02-17T22:27:06,052 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-02-17T22:27:06,057 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-02-17T22:27:06,058 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-02-17T22:27:06,063 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-02-17T22:27:06,067 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-02-17T22:27:06,070 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-02-17T22:27:06,075 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-02-17T22:27:06,077 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-02-17T22:27:06,080 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-02-17T22:27:06,083 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-02-17T22:27:06,087 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-02-17T22:27:06,088 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-02-17T22:27:06,094 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-02-17T22:27:06,098 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-02-17T22:27:06,103 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,104 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,107 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,112 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-02-17T22:27:06,114 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-02-17T22:27:06,117 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-02-17T22:27:06,122 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-02-17T22:27:06,125 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-02-17T22:27:06,129 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-02-17T22:27:06,133 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-02-17T22:27:06,137 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-02-17T22:27:06,140 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-02-17T22:27:06,145 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-02-17T22:27:06,150 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-02-17T22:27:06,152 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-02-17T22:27:06,155 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-02-17T22:27:06,158 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-02-17T22:27:06,164 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-02-17T22:27:06,166 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-02-17T22:27:06,170 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-02-17T22:27:06,173 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-02-17T22:27:06,176 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-02-17T22:27:06,180 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-02-17T22:27:06,182 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-02-17T22:27:06,187 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-02-17T22:27:06,191 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-02-17T22:27:06,198 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-02-17T22:27:06,203 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-02-17T22:27:06,207 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-02-17T22:27:06,211 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-02-17T22:27:06,213 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-02-17T22:27:06,216 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-02-17T22:27:06,219 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,233 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-02-17T22:27:06,235 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-02-17T22:27:06,239 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-02-17T22:27:06,244 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-02-17T22:27:06,247 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-02-17T22:27:06,250 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,254 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,261 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,267 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-02-17T22:27:06,268 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-02-17T22:27:06,274 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:06,276 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:06,281 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:06,287 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:06,293 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:06,297 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-02-17T22:27:06,301 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:06,303 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:06,308 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:06,312 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:06,317 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:06,321 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-02-17T22:27:06,324 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-02-17T22:27:06,329 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-02-17T22:27:06,334 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-02-17T22:27:06,337 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,343 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,349 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,355 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,357 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,362 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,371 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,375 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,380 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,386 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,390 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,399 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,403 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,408 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,411 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,421 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,425 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-02-17T22:27:06,429 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,432 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,435 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,440 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,446 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-02-17T22:27:06,449 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-02-17T22:27:06,450 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-02-17T22:27:06,455 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-02-17T22:27:06,460 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-02-17T22:27:06,465 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-02-17T22:27:06,468 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-02-17T22:27:06,473 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-02-17T22:27:06,477 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-02-17T22:27:06,481 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-02-17T22:27:06,484 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,488 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-02-17T22:27:06,493 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-02-17T22:27:06,496 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-02-17T22:27:06,498 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-02-17T22:27:06,501 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-02-17T22:27:06,505 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-02-17T22:27:06,508 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-02-17T22:27:06,511 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-02-17T22:27:06,514 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-02-17T22:27:06,517 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-02-17T22:27:06,520 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-02-17T22:27:06,524 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-02-17T22:27:06,527 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-02-17T22:27:06,529 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-02-17T22:27:06,532 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-02-17T22:27:06,536 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-02-17T22:27:06,539 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-02-17T22:27:06,542 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-02-17T22:27:06,547 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-02-17T22:27:06,549 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-02-17T22:27:06,552 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-02-17T22:27:06,555 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,557 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,560 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,564 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,567 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,570 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,573 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,578 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,581 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,584 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,588 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,591 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-02-17T22:27:06,596 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-02-17T22:27:06,597 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-02-17T22:27:06,602 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:06,603 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:06,607 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:06,611 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:06,614 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:06,618 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:06,621 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-02-17T22:27:06,625 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-02-17T22:27:06,626 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-02-17T22:27:06,631 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-02-17T22:27:06,635 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-02-17T22:27:06,639 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-02-17T22:27:06,645 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,646 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,650 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,653 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,659 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,664 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,668 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,671 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,675 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,681 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,685 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,690 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,694 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,699 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,702 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,706 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,711 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,714 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,718 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,723 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,728 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,732 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,737 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,741 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,745 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,749 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,753 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,756 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-02-17T22:27:06,761 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-02-17T22:27:06,764 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-02-17T22:27:06,766 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-02-17T22:27:06,771 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-02-17T22:27:06,776 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-02-17T22:27:06,778 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-02-17T22:27:06,782 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-02-17T22:27:06,783 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-02-17T22:27:06,788 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-02-17T22:27:06,790 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-02-17T22:27:06,793 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-02-17T22:27:06,797 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-02-17T22:27:06,800 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-02-17T22:27:06,805 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-02-17T22:27:06,807 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-02-17T22:27:06,811 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-02-17T22:27:06,815 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-02-17T22:27:06,822 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-02-17T22:27:06,827 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-02-17T22:27:06,833 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-02-17T22:27:06,835 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:06,837 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:06,842 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:06,846 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:06,850 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:06,858 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:06,862 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:06,867 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:06,872 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-02-17T22:27:06,879 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-02-17T22:27:06,880 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-02-17T22:27:06,884 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-02-17T22:27:06,888 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-02-17T22:27:06,893 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-02-17T22:27:06,902 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-02-17T22:27:06,908 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-02-17T22:27:06,914 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-02-17T22:27:06,915 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-02-17T22:27:06,920 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-02-17T22:27:06,922 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-02-17T22:27:06,927 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-02-17T22:27:06,928 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-02-17T22:27:06,933 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-02-17T22:27:06,936 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-02-17T22:27:06,941 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-02-17T22:27:06,948 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-02-17T22:27:06,950 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-02-17T22:27:06,955 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-02-17T22:27:06,957 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-02-17T22:27:06,960 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-02-17T22:27:06,966 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-02-17T22:27:06,968 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-02-17T22:27:06,972 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-02-17T22:27:06,974 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-02-17T22:27:06,978 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-02-17T22:27:06,983 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-02-17T22:27:06,984 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-02-17T22:27:06,989 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-02-17T22:27:06,994 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-02-17T22:27:06,995 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-02-17T22:27:06,999 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-02-17T22:27:07,003 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-02-17T22:27:07,007 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-02-17T22:27:07,012 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,013 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,017 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,020 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,023 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,027 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,030 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,033 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,037 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,040 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,043 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,046 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,050 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,053 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,057 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,060 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,067 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-02-17T22:27:07,071 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-02-17T22:27:07,072 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-02-17T22:27:07,080 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,081 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,085 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,090 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,095 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,099 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,103 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,109 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,110 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,114 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,118 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,122 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,125 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,128 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,132 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,135 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,139 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,143 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-02-17T22:27:07,146 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,150 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,154 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,159 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-02-17T22:27:07,162 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-02-17T22:27:07,166 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-02-17T22:27:07,170 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-02-17T22:27:07,171 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-02-17T22:27:07,175 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-02-17T22:27:07,180 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-02-17T22:27:07,181 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-02-17T22:27:07,186 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-02-17T22:27:07,192 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-02-17T22:27:07,195 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-02-17T22:27:07,200 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-02-17T22:27:07,201 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-02-17T22:27:07,206 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-02-17T22:27:07,209 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-02-17T22:27:07,212 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-02-17T22:27:07,215 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-02-17T22:27:07,220 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-02-17T22:27:07,223 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-02-17T22:27:07,230 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-02-17T22:27:07,231 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-02-17T22:27:07,236 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-02-17T22:27:07,241 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,243 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,248 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,252 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,256 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,260 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,263 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,266 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,270 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,273 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,278 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,283 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,286 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,290 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-02-17T22:27:07,295 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-02-17T22:27:07,297 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-02-17T22:27:07,299 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-02-17T22:27:07,304 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-02-17T22:27:07,307 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-02-17T22:27:07,310 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-02-17T22:27:07,314 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-02-17T22:27:07,317 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-02-17T22:27:07,321 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-02-17T22:27:07,328 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-02-17T22:27:07,332 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-02-17T22:27:07,336 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-02-17T22:27:07,340 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-02-17T22:27:07,345 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-02-17T22:27:07,349 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-02-17T22:27:07,351 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-02-17T22:27:07,354 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-02-17T22:27:07,357 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-02-17T22:27:07,361 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-02-17T22:27:07,365 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-02-17T22:27:07,367 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-02-17T22:27:07,372 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-02-17T22:27:07,377 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-02-17T22:27:07,380 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-02-17T22:27:07,382 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-02-17T22:27:07,386 running install_egg_info 2023-02-17T22:27:07,491 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.8.1-py3.7.egg-info 2023-02-17T22:27:07,517 running install_scripts 2023-02-17T22:27:07,625 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data 2023-02-17T22:27:07,626 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts 2023-02-17T22:27:07,628 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts 2023-02-17T22:27:07,631 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts 2023-02-17T22:27:07,635 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts 2023-02-17T22:27:07,638 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts 2023-02-17T22:27:07,641 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts 2023-02-17T22:27:07,644 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts 2023-02-17T22:27:07,648 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts 2023-02-17T22:27:07,651 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts 2023-02-17T22:27:07,654 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts/ds_bench to 755 2023-02-17T22:27:07,654 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts/deepspeed.pt to 755 2023-02-17T22:27:07,655 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts/deepspeed to 755 2023-02-17T22:27:07,655 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts/ds_report to 755 2023-02-17T22:27:07,656 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts/ds to 755 2023-02-17T22:27:07,656 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts/dsr to 755 2023-02-17T22:27:07,657 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts/ds_elastic to 755 2023-02-17T22:27:07,657 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.data/scripts/ds_ssh to 755 2023-02-17T22:27:07,942 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2023-02-17T22:27:07,950 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.1.dist-info/WHEEL 2023-02-17T22:27:07,954 creating '/tmp/pip-wheel-6yi7gmt2/deepspeed-0.8.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-02-17T22:27:07,961 adding 'deepspeed/__init__.py' 2023-02-17T22:27:07,963 adding 'deepspeed/constants.py' 2023-02-17T22:27:07,967 adding 'deepspeed/env_report.py' 2023-02-17T22:27:07,969 adding 'deepspeed/git_version_info.py' 2023-02-17T22:27:07,971 adding 'deepspeed/git_version_info_installed.py' 2023-02-17T22:27:07,974 adding 'deepspeed/accelerator/__init__.py' 2023-02-17T22:27:07,976 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-02-17T22:27:07,980 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-02-17T22:27:07,982 adding 'deepspeed/accelerator/real_accelerator.py' 2023-02-17T22:27:07,986 adding 'deepspeed/autotuning/__init__.py' 2023-02-17T22:27:07,999 adding 'deepspeed/autotuning/autotuner.py' 2023-02-17T22:27:08,002 adding 'deepspeed/autotuning/config.py' 2023-02-17T22:27:08,005 adding 'deepspeed/autotuning/constants.py' 2023-02-17T22:27:08,010 adding 'deepspeed/autotuning/scheduler.py' 2023-02-17T22:27:08,015 adding 'deepspeed/autotuning/utils.py' 2023-02-17T22:27:08,019 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-02-17T22:27:08,021 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-02-17T22:27:08,023 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-02-17T22:27:08,025 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-02-17T22:27:08,028 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-02-17T22:27:08,031 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-02-17T22:27:08,033 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-02-17T22:27:08,036 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-02-17T22:27:08,038 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-02-17T22:27:08,041 adding 'deepspeed/autotuning/tuner/utils.py' 2023-02-17T22:27:08,045 adding 'deepspeed/checkpoint/__init__.py' 2023-02-17T22:27:08,047 adding 'deepspeed/checkpoint/constants.py' 2023-02-17T22:27:08,051 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-02-17T22:27:08,054 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-02-17T22:27:08,058 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-02-17T22:27:08,061 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-02-17T22:27:08,064 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-02-17T22:27:08,066 adding 'deepspeed/checkpoint/utils.py' 2023-02-17T22:27:08,069 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-02-17T22:27:08,073 adding 'deepspeed/comm/__init__.py' 2023-02-17T22:27:08,075 adding 'deepspeed/comm/backend.py' 2023-02-17T22:27:08,082 adding 'deepspeed/comm/comm.py' 2023-02-17T22:27:08,084 adding 'deepspeed/comm/config.py' 2023-02-17T22:27:08,087 adding 'deepspeed/comm/constants.py' 2023-02-17T22:27:08,090 adding 'deepspeed/comm/torch.py' 2023-02-17T22:27:08,093 adding 'deepspeed/comm/utils.py' 2023-02-17T22:27:08,097 adding 'deepspeed/compression/__init__.py' 2023-02-17T22:27:08,104 adding 'deepspeed/compression/basic_layer.py' 2023-02-17T22:27:08,108 adding 'deepspeed/compression/compress.py' 2023-02-17T22:27:08,113 adding 'deepspeed/compression/config.py' 2023-02-17T22:27:08,116 adding 'deepspeed/compression/constants.py' 2023-02-17T22:27:08,120 adding 'deepspeed/compression/helper.py' 2023-02-17T22:27:08,123 adding 'deepspeed/compression/scheduler.py' 2023-02-17T22:27:08,126 adding 'deepspeed/compression/utils.py' 2023-02-17T22:27:08,129 adding 'deepspeed/elasticity/__init__.py' 2023-02-17T22:27:08,132 adding 'deepspeed/elasticity/config.py' 2023-02-17T22:27:08,135 adding 'deepspeed/elasticity/constants.py' 2023-02-17T22:27:08,138 adding 'deepspeed/elasticity/elastic_agent.py' 2023-02-17T22:27:08,143 adding 'deepspeed/elasticity/elasticity.py' 2023-02-17T22:27:08,146 adding 'deepspeed/elasticity/utils.py' 2023-02-17T22:27:08,149 adding 'deepspeed/inference/__init__.py' 2023-02-17T22:27:08,153 adding 'deepspeed/inference/config.py' 2023-02-17T22:27:08,160 adding 'deepspeed/inference/engine.py' 2023-02-17T22:27:08,163 adding 'deepspeed/launcher/__init__.py' 2023-02-17T22:27:08,165 adding 'deepspeed/launcher/constants.py' 2023-02-17T22:27:08,170 adding 'deepspeed/launcher/launch.py' 2023-02-17T22:27:08,174 adding 'deepspeed/launcher/multinode_runner.py' 2023-02-17T22:27:08,180 adding 'deepspeed/launcher/runner.py' 2023-02-17T22:27:08,184 adding 'deepspeed/model_implementations/__init__.py' 2023-02-17T22:27:08,187 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-02-17T22:27:08,189 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-02-17T22:27:08,192 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-02-17T22:27:08,195 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-02-17T22:27:08,198 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-02-17T22:27:08,200 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-02-17T22:27:08,202 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-02-17T22:27:08,204 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-02-17T22:27:08,207 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-02-17T22:27:08,209 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-02-17T22:27:08,211 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-02-17T22:27:08,214 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-02-17T22:27:08,218 adding 'deepspeed/module_inject/__init__.py' 2023-02-17T22:27:08,220 adding 'deepspeed/module_inject/auto_tp.py' 2023-02-17T22:27:08,223 adding 'deepspeed/module_inject/inject.py' 2023-02-17T22:27:08,226 adding 'deepspeed/module_inject/layers.py' 2023-02-17T22:27:08,230 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-02-17T22:27:08,233 adding 'deepspeed/module_inject/module_quantize.py' 2023-02-17T22:27:08,236 adding 'deepspeed/module_inject/policy.py' 2023-02-17T22:27:08,245 adding 'deepspeed/module_inject/replace_module.py' 2023-02-17T22:27:08,248 adding 'deepspeed/module_inject/replace_policy.py' 2023-02-17T22:27:08,250 adding 'deepspeed/module_inject/utils.py' 2023-02-17T22:27:08,254 adding 'deepspeed/module_inject/containers/__init__.py' 2023-02-17T22:27:08,258 adding 'deepspeed/module_inject/containers/base.py' 2023-02-17T22:27:08,261 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-02-17T22:27:08,263 adding 'deepspeed/module_inject/containers/bert.py' 2023-02-17T22:27:08,266 adding 'deepspeed/module_inject/containers/bloom.py' 2023-02-17T22:27:08,269 adding 'deepspeed/module_inject/containers/clip.py' 2023-02-17T22:27:08,271 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-02-17T22:27:08,273 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-02-17T22:27:08,276 adding 'deepspeed/module_inject/containers/gptj.py' 2023-02-17T22:27:08,279 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-02-17T22:27:08,281 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-02-17T22:27:08,284 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-02-17T22:27:08,287 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-02-17T22:27:08,290 adding 'deepspeed/module_inject/containers/opt.py' 2023-02-17T22:27:08,292 adding 'deepspeed/module_inject/containers/unet.py' 2023-02-17T22:27:08,295 adding 'deepspeed/module_inject/containers/vae.py' 2023-02-17T22:27:08,298 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-02-17T22:27:08,300 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-02-17T22:27:08,303 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-02-17T22:27:08,306 adding 'deepspeed/moe/__init__.py' 2023-02-17T22:27:08,308 adding 'deepspeed/moe/experts.py' 2023-02-17T22:27:08,311 adding 'deepspeed/moe/layer.py' 2023-02-17T22:27:08,314 adding 'deepspeed/moe/mappings.py' 2023-02-17T22:27:08,320 adding 'deepspeed/moe/sharded_moe.py' 2023-02-17T22:27:08,323 adding 'deepspeed/moe/utils.py' 2023-02-17T22:27:08,327 adding 'deepspeed/monitor/__init__.py' 2023-02-17T22:27:08,329 adding 'deepspeed/monitor/config.py' 2023-02-17T22:27:08,332 adding 'deepspeed/monitor/csv_monitor.py' 2023-02-17T22:27:08,334 adding 'deepspeed/monitor/monitor.py' 2023-02-17T22:27:08,336 adding 'deepspeed/monitor/tensorboard.py' 2023-02-17T22:27:08,338 adding 'deepspeed/monitor/utils.py' 2023-02-17T22:27:08,341 adding 'deepspeed/monitor/wandb.py' 2023-02-17T22:27:08,344 adding 'deepspeed/nebula/__init__.py' 2023-02-17T22:27:08,346 adding 'deepspeed/nebula/config.py' 2023-02-17T22:27:08,349 adding 'deepspeed/nebula/constants.py' 2023-02-17T22:27:08,352 adding 'deepspeed/ops/__init__.py' 2023-02-17T22:27:08,355 adding 'deepspeed/ops/adagrad/__init__.py' 2023-02-17T22:27:08,358 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-02-17T22:27:08,361 adding 'deepspeed/ops/adam/__init__.py' 2023-02-17T22:27:08,365 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-02-17T22:27:08,368 adding 'deepspeed/ops/adam/fused_adam.py' 2023-02-17T22:27:08,370 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-02-17T22:27:08,374 adding 'deepspeed/ops/aio/__init__.py' 2023-02-17T22:27:08,379 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-02-17T22:27:08,383 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-02-17T22:27:08,386 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-02-17T22:27:08,389 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-02-17T22:27:08,392 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-02-17T22:27:08,398 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-02-17T22:27:08,401 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-02-17T22:27:08,403 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-02-17T22:27:08,405 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-02-17T22:27:08,408 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-02-17T22:27:08,411 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-02-17T22:27:08,414 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-02-17T22:27:08,417 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-02-17T22:27:08,419 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-02-17T22:27:08,421 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-02-17T22:27:08,424 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-02-17T22:27:08,426 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-02-17T22:27:08,430 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-02-17T22:27:08,432 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-02-17T22:27:08,435 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-02-17T22:27:08,438 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-02-17T22:27:08,440 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-02-17T22:27:08,443 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-02-17T22:27:08,447 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-02-17T22:27:08,451 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-02-17T22:27:08,453 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-02-17T22:27:08,455 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-02-17T22:27:08,458 adding 'deepspeed/ops/csrc/includes/context.h' 2023-02-17T22:27:08,462 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-02-17T22:27:08,465 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-02-17T22:27:08,468 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-02-17T22:27:08,471 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-02-17T22:27:08,474 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-02-17T22:27:08,478 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-02-17T22:27:08,480 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-02-17T22:27:08,483 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-02-17T22:27:08,485 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-02-17T22:27:08,488 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-02-17T22:27:08,490 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-02-17T22:27:08,495 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-02-17T22:27:08,497 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-02-17T22:27:08,502 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-02-17T22:27:08,506 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-02-17T22:27:08,509 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-02-17T22:27:08,513 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-02-17T22:27:08,515 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-02-17T22:27:08,520 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-02-17T22:27:08,523 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-02-17T22:27:08,525 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-02-17T22:27:08,528 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-02-17T22:27:08,531 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-02-17T22:27:08,535 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-02-17T22:27:08,539 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-02-17T22:27:08,543 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-02-17T22:27:08,549 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-02-17T22:27:08,553 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-02-17T22:27:08,556 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-02-17T22:27:08,560 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-02-17T22:27:08,563 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-02-17T22:27:08,566 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-02-17T22:27:08,569 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-02-17T22:27:08,573 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-02-17T22:27:08,578 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-02-17T22:27:08,581 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-02-17T22:27:08,584 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-02-17T22:27:08,588 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-02-17T22:27:08,594 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-02-17T22:27:08,603 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-02-17T22:27:08,607 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-02-17T22:27:08,611 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-02-17T22:27:08,621 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-02-17T22:27:08,628 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-02-17T22:27:08,634 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-02-17T22:27:08,640 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-02-17T22:27:08,643 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-02-17T22:27:08,650 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-02-17T22:27:08,655 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-02-17T22:27:08,666 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-02-17T22:27:08,670 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-02-17T22:27:08,675 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-02-17T22:27:08,681 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-02-17T22:27:08,686 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-02-17T22:27:08,690 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-02-17T22:27:08,693 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-02-17T22:27:08,696 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-02-17T22:27:08,699 adding 'deepspeed/ops/lamb/__init__.py' 2023-02-17T22:27:08,703 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-02-17T22:27:08,707 adding 'deepspeed/ops/op_builder/__init__.py' 2023-02-17T22:27:08,709 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-02-17T22:27:08,712 adding 'deepspeed/ops/op_builder/async_io.py' 2023-02-17T22:27:08,719 adding 'deepspeed/ops/op_builder/builder.py' 2023-02-17T22:27:08,722 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-02-17T22:27:08,724 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-02-17T22:27:08,727 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-02-17T22:27:08,729 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-02-17T22:27:08,731 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-02-17T22:27:08,733 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-02-17T22:27:08,736 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-02-17T22:27:08,738 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-02-17T22:27:08,741 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-02-17T22:27:08,743 adding 'deepspeed/ops/op_builder/transformer.py' 2023-02-17T22:27:08,745 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-02-17T22:27:08,747 adding 'deepspeed/ops/op_builder/utils.py' 2023-02-17T22:27:08,751 adding 'deepspeed/ops/quantizer/__init__.py' 2023-02-17T22:27:08,753 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-02-17T22:27:08,756 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-02-17T22:27:08,759 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-02-17T22:27:08,763 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-02-17T22:27:08,766 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-02-17T22:27:08,776 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-02-17T22:27:08,781 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-02-17T22:27:08,785 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-02-17T22:27:08,789 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-02-17T22:27:08,798 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-02-17T22:27:08,804 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-02-17T22:27:08,809 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-02-17T22:27:08,812 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-02-17T22:27:08,816 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-02-17T22:27:08,820 adding 'deepspeed/ops/transformer/__init__.py' 2023-02-17T22:27:08,825 adding 'deepspeed/ops/transformer/transformer.py' 2023-02-17T22:27:08,829 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-02-17T22:27:08,832 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-02-17T22:27:08,835 adding 'deepspeed/ops/transformer/inference/config.py' 2023-02-17T22:27:08,837 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-02-17T22:27:08,840 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-02-17T22:27:08,843 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-02-17T22:27:08,848 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-02-17T22:27:08,851 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-02-17T22:27:08,856 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-02-17T22:27:08,859 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-02-17T22:27:08,863 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-02-17T22:27:08,865 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-02-17T22:27:08,867 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-02-17T22:27:08,870 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-02-17T22:27:08,872 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-02-17T22:27:08,874 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-02-17T22:27:08,877 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-02-17T22:27:08,879 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-02-17T22:27:08,881 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-02-17T22:27:08,883 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-02-17T22:27:08,886 adding 'deepspeed/pipe/__init__.py' 2023-02-17T22:27:08,889 adding 'deepspeed/profiling/__init__.py' 2023-02-17T22:27:08,892 adding 'deepspeed/profiling/config.py' 2023-02-17T22:27:08,894 adding 'deepspeed/profiling/constants.py' 2023-02-17T22:27:08,897 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-02-17T22:27:08,909 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-02-17T22:27:08,914 adding 'deepspeed/runtime/__init__.py' 2023-02-17T22:27:08,919 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-02-17T22:27:08,928 adding 'deepspeed/runtime/config.py' 2023-02-17T22:27:08,933 adding 'deepspeed/runtime/config_utils.py' 2023-02-17T22:27:08,937 adding 'deepspeed/runtime/constants.py' 2023-02-17T22:27:08,940 adding 'deepspeed/runtime/dataloader.py' 2023-02-17T22:27:08,943 adding 'deepspeed/runtime/eigenvalue.py' 2023-02-17T22:27:08,983 adding 'deepspeed/runtime/engine.py' 2023-02-17T22:27:08,994 adding 'deepspeed/runtime/lr_schedules.py' 2023-02-17T22:27:08,997 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-02-17T22:27:09,000 adding 'deepspeed/runtime/quantize.py' 2023-02-17T22:27:09,003 adding 'deepspeed/runtime/sparse_tensor.py' 2023-02-17T22:27:09,008 adding 'deepspeed/runtime/state_dict_factory.py' 2023-02-17T22:27:09,018 adding 'deepspeed/runtime/utils.py' 2023-02-17T22:27:09,022 adding 'deepspeed/runtime/weight_quantizer.py' 2023-02-17T22:27:09,025 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-02-17T22:27:09,034 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-02-17T22:27:09,037 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-02-17T22:27:09,041 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-02-17T22:27:09,043 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-02-17T22:27:09,046 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-02-17T22:27:09,048 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-02-17T22:27:09,051 adding 'deepspeed/runtime/comm/__init__.py' 2023-02-17T22:27:09,054 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-02-17T22:27:09,058 adding 'deepspeed/runtime/comm/mpi.py' 2023-02-17T22:27:09,062 adding 'deepspeed/runtime/comm/nccl.py' 2023-02-17T22:27:09,065 adding 'deepspeed/runtime/compression/__init__.py' 2023-02-17T22:27:09,067 adding 'deepspeed/runtime/compression/cupy.py' 2023-02-17T22:27:09,070 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-02-17T22:27:09,073 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-02-17T22:27:09,076 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-02-17T22:27:09,079 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-02-17T22:27:09,083 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-02-17T22:27:09,086 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-02-17T22:27:09,088 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-02-17T22:27:09,091 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-02-17T22:27:09,093 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-02-17T22:27:09,097 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-02-17T22:27:09,103 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-02-17T22:27:09,108 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-02-17T22:27:09,115 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-02-17T22:27:09,118 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-02-17T22:27:09,121 adding 'deepspeed/runtime/fp16/__init__.py' 2023-02-17T22:27:09,127 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-02-17T22:27:09,131 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-02-17T22:27:09,137 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-02-17T22:27:09,140 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-02-17T22:27:09,145 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-02-17T22:27:09,151 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-02-17T22:27:09,157 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-02-17T22:27:09,160 adding 'deepspeed/runtime/pipe/__init__.py' 2023-02-17T22:27:09,174 adding 'deepspeed/runtime/pipe/engine.py' 2023-02-17T22:27:09,184 adding 'deepspeed/runtime/pipe/module.py' 2023-02-17T22:27:09,187 adding 'deepspeed/runtime/pipe/p2p.py' 2023-02-17T22:27:09,192 adding 'deepspeed/runtime/pipe/schedule.py' 2023-02-17T22:27:09,197 adding 'deepspeed/runtime/pipe/topology.py' 2023-02-17T22:27:09,201 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-02-17T22:27:09,203 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-02-17T22:27:09,207 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-02-17T22:27:09,209 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-02-17T22:27:09,215 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-02-17T22:27:09,219 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-02-17T22:27:09,224 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-02-17T22:27:09,228 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-02-17T22:27:09,231 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-02-17T22:27:09,235 adding 'deepspeed/runtime/zero/__init__.py' 2023-02-17T22:27:09,239 adding 'deepspeed/runtime/zero/config.py' 2023-02-17T22:27:09,243 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-02-17T22:27:09,247 adding 'deepspeed/runtime/zero/linear.py' 2023-02-17T22:27:09,250 adding 'deepspeed/runtime/zero/offload_config.py' 2023-02-17T22:27:09,256 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-02-17T22:27:09,275 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-02-17T22:27:09,283 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-02-17T22:27:09,314 adding 'deepspeed/runtime/zero/stage3.py' 2023-02-17T22:27:09,346 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-02-17T22:27:09,351 adding 'deepspeed/runtime/zero/test.py' 2023-02-17T22:27:09,355 adding 'deepspeed/runtime/zero/tiling.py' 2023-02-17T22:27:09,358 adding 'deepspeed/runtime/zero/utils.py' 2023-02-17T22:27:09,361 adding 'deepspeed/utils/__init__.py' 2023-02-17T22:27:09,364 adding 'deepspeed/utils/comms_logging.py' 2023-02-17T22:27:09,367 adding 'deepspeed/utils/debug.py' 2023-02-17T22:27:09,370 adding 'deepspeed/utils/exceptions.py' 2023-02-17T22:27:09,374 adding 'deepspeed/utils/groups.py' 2023-02-17T22:27:09,377 adding 'deepspeed/utils/init_on_device.py' 2023-02-17T22:27:09,380 adding 'deepspeed/utils/logging.py' 2023-02-17T22:27:09,382 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-02-17T22:27:09,384 adding 'deepspeed/utils/nvtx.py' 2023-02-17T22:27:09,387 adding 'deepspeed/utils/tensor_fragment.py' 2023-02-17T22:27:09,391 adding 'deepspeed/utils/timer.py' 2023-02-17T22:27:09,393 adding 'deepspeed/utils/types.py' 2023-02-17T22:27:09,398 adding 'deepspeed/utils/zero_to_fp32.py' 2023-02-17T22:27:09,403 adding 'deepspeed-0.8.1.data/scripts/deepspeed' 2023-02-17T22:27:09,405 adding 'deepspeed-0.8.1.data/scripts/deepspeed.pt' 2023-02-17T22:27:09,407 adding 'deepspeed-0.8.1.data/scripts/ds' 2023-02-17T22:27:09,409 adding 'deepspeed-0.8.1.data/scripts/ds_bench' 2023-02-17T22:27:09,411 adding 'deepspeed-0.8.1.data/scripts/ds_elastic' 2023-02-17T22:27:09,413 adding 'deepspeed-0.8.1.data/scripts/ds_report' 2023-02-17T22:27:09,415 adding 'deepspeed-0.8.1.data/scripts/ds_ssh' 2023-02-17T22:27:09,417 adding 'deepspeed-0.8.1.data/scripts/dsr' 2023-02-17T22:27:09,422 adding 'deepspeed-0.8.1.dist-info/LICENSE' 2023-02-17T22:27:09,429 adding 'deepspeed-0.8.1.dist-info/METADATA' 2023-02-17T22:27:09,431 adding 'deepspeed-0.8.1.dist-info/WHEEL' 2023-02-17T22:27:09,433 adding 'deepspeed-0.8.1.dist-info/entry_points.txt' 2023-02-17T22:27:09,434 adding 'deepspeed-0.8.1.dist-info/top_level.txt' 2023-02-17T22:27:09,451 adding 'deepspeed-0.8.1.dist-info/RECORD' 2023-02-17T22:27:09,485 removing build/bdist.linux-armv7l/wheel 2023-02-17T22:27:09,688 deepspeed build time = 12.139321088790894 secs 2023-02-17T22:27:09,954 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-02-17T22:27:09,984 Created wheel for deepspeed: filename=deepspeed-0.8.1-py3-none-any.whl size=765842 sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad 2023-02-17T22:27:09,986 Stored in directory: /tmp/pip-ephem-wheel-cache-b1egigwp/wheels/9d/d6/f7/b1c7df57209b2458509e6ece9db945a51163bcb33e0cefe61c 2023-02-17T22:27:10,051 Successfully built deepspeed 2023-02-17T22:27:10,120 Removed build tracker: '/tmp/pip-build-tracker-nexeb3cc'