2022-10-21T21:24:34,675 Created temporary directory: /tmp/pip-ephem-wheel-cache-l6ni9fvk 2022-10-21T21:24:34,680 Created temporary directory: /tmp/pip-build-tracker-926mp9rg 2022-10-21T21:24:34,681 Initialized build tracking at /tmp/pip-build-tracker-926mp9rg 2022-10-21T21:24:34,682 Created build tracker: /tmp/pip-build-tracker-926mp9rg 2022-10-21T21:24:34,682 Entered build tracker: /tmp/pip-build-tracker-926mp9rg 2022-10-21T21:24:34,683 Created temporary directory: /tmp/pip-wheel-98rzdtrb 2022-10-21T21:24:34,693 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2022-10-21T21:24:34,699 Created temporary directory: /tmp/pip-ephem-wheel-cache-t3dym9wa 2022-10-21T21:24:34,761 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2022-10-21T21:24:34,768 2 location(s) to search for versions of deepspeed: 2022-10-21T21:24:34,768 * https://pypi.org/simple/deepspeed/ 2022-10-21T21:24:34,768 * https://www.piwheels.org/simple/deepspeed/ 2022-10-21T21:24:34,769 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2022-10-21T21:24:34,770 Getting page https://pypi.org/simple/deepspeed/ 2022-10-21T21:24:34,774 Found index url https://pypi.org/simple 2022-10-21T21:24:34,973 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2022-10-21T21:24:35,002 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-10-21T21:24:35,002 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2022-10-21T21:24:35,003 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-10-21T21:24:35,004 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2022-10-21T21:24:35,005 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-10-21T21:24:35,006 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2022-10-21T21:24:35,006 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-10-21T21:24:35,007 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2022-10-21T21:24:35,008 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-10-21T21:24:35,008 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2022-10-21T21:24:35,009 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2022-10-21T21:24:35,010 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2022-10-21T21:24:35,010 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2022-10-21T21:24:35,011 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2022-10-21T21:24:35,012 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2022-10-21T21:24:35,012 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2022-10-21T21:24:35,013 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2022-10-21T21:24:35,014 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2022-10-21T21:24:35,015 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2022-10-21T21:24:35,015 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2022-10-21T21:24:35,016 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2022-10-21T21:24:35,017 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2022-10-21T21:24:35,018 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2022-10-21T21:24:35,018 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2022-10-21T21:24:35,019 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2022-10-21T21:24:35,020 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2022-10-21T21:24:35,020 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2022-10-21T21:24:35,021 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2022-10-21T21:24:35,022 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2022-10-21T21:24:35,023 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2022-10-21T21:24:35,023 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2022-10-21T21:24:35,024 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2022-10-21T21:24:35,025 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2022-10-21T21:24:35,025 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2022-10-21T21:24:35,026 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2022-10-21T21:24:35,027 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2022-10-21T21:24:35,027 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2022-10-21T21:24:35,028 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2022-10-21T21:24:35,029 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2022-10-21T21:24:35,030 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2022-10-21T21:24:35,030 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2022-10-21T21:24:35,031 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2022-10-21T21:24:35,032 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2022-10-21T21:24:35,032 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2022-10-21T21:24:35,033 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2022-10-21T21:24:35,034 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2022-10-21T21:24:35,034 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2022-10-21T21:24:35,035 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2022-10-21T21:24:35,036 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2022-10-21T21:24:35,037 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2022-10-21T21:24:35,037 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2022-10-21T21:24:35,038 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2022-10-21T21:24:35,039 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2022-10-21T21:24:35,039 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2022-10-21T21:24:35,040 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2022-10-21T21:24:35,041 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2022-10-21T21:24:35,041 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2022-10-21T21:24:35,042 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2022-10-21T21:24:35,043 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2022-10-21T21:24:35,044 Getting page https://www.piwheels.org/simple/deepspeed/ 2022-10-21T21:24:35,046 Found index url https://www.piwheels.org/simple 2022-10-21T21:24:35,263 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2022-10-21T21:24:35,284 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,285 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,286 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,286 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,287 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,287 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,288 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,288 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,289 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,289 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,290 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,290 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,291 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,291 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,292 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,292 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,293 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,294 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,294 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,295 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,295 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,296 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,296 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,297 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,297 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,298 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,298 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,299 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2022-10-21T21:24:35,299 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2022-10-21T21:24:35,300 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2022-10-21T21:24:35,351 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2022-10-21T21:24:35,382 Collecting deepspeed==0.7.4 2022-10-21T21:24:35,387 Created temporary directory: /tmp/pip-unpack-0sld0c3x 2022-10-21T21:24:35,964 Downloading deepspeed-0.7.4.tar.gz (665 kB) 2022-10-21T21:24:38,465 Added deepspeed==0.7.4 from https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz to build tracker '/tmp/pip-build-tracker-926mp9rg' 2022-10-21T21:24:38,468 Running setup.py (path:/tmp/pip-wheel-98rzdtrb/deepspeed_676f5379a59843a093aa36c2b9aa9b20/setup.py) egg_info for package deepspeed 2022-10-21T21:24:38,469 Created temporary directory: /tmp/pip-pip-egg-info-wgl72954 2022-10-21T21:24:38,470 Preparing metadata (setup.py): started 2022-10-21T21:24:38,472 Running command python setup.py egg_info 2022-10-21T21:24:41,936 fatal: not a git repository (or any of the parent directories): .git 2022-10-21T21:24:48,181 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2022-10-21T21:24:48,182  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2022-10-21T21:24:48,183 DS_BUILD_OPS=0 2022-10-21T21:24:48,183  [WARNING]  unable to import torch, please install it first 2022-10-21T21:24:48,184  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2022-10-21T21:24:48,184  [WARNING]  async_io: please install the libaio-dev package with apt 2022-10-21T21:24:48,184  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2022-10-21T21:24:48,185  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-10-21T21:24:48,185 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'utils': False, 'quantizer': False, 'transformer_inference': False} 2022-10-21T21:24:48,185 version=0.7.4, git_hash=unknown, git_branch=unknown 2022-10-21T21:24:48,186 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2022-10-21T21:24:48,186 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'utils': True, 'quantizer': True, 'transformer_inference': False} 2022-10-21T21:24:48,186 ext_modules=[] 2022-10-21T21:24:48,187 running egg_info 2022-10-21T21:24:48,187 creating /tmp/pip-pip-egg-info-wgl72954/deepspeed.egg-info 2022-10-21T21:24:48,927 writing /tmp/pip-pip-egg-info-wgl72954/deepspeed.egg-info/PKG-INFO 2022-10-21T21:24:49,528 writing dependency_links to /tmp/pip-pip-egg-info-wgl72954/deepspeed.egg-info/dependency_links.txt 2022-10-21T21:24:51,303 writing entry points to /tmp/pip-pip-egg-info-wgl72954/deepspeed.egg-info/entry_points.txt 2022-10-21T21:24:52,487 writing requirements to /tmp/pip-pip-egg-info-wgl72954/deepspeed.egg-info/requires.txt 2022-10-21T21:24:53,082 writing top-level names to /tmp/pip-pip-egg-info-wgl72954/deepspeed.egg-info/top_level.txt 2022-10-21T21:24:53,085 writing manifest file '/tmp/pip-pip-egg-info-wgl72954/deepspeed.egg-info/SOURCES.txt' 2022-10-21T21:24:54,429 reading manifest file '/tmp/pip-pip-egg-info-wgl72954/deepspeed.egg-info/SOURCES.txt' 2022-10-21T21:24:54,432 reading manifest template 'MANIFEST.in' 2022-10-21T21:24:55,464 warning: no files found matching '*.hip' under directory 'deepspeed' 2022-10-21T21:24:56,231 warning: no files found matching '*.cc' under directory 'deepspeed' 2022-10-21T21:24:56,784 warning: no files found matching '*.tr' under directory 'csrc' 2022-10-21T21:24:56,910 warning: no files found matching '*.cc' under directory 'csrc' 2022-10-21T21:24:56,947 adding license file 'LICENSE' 2022-10-21T21:24:56,985 writing manifest file '/tmp/pip-pip-egg-info-wgl72954/deepspeed.egg-info/SOURCES.txt' 2022-10-21T21:24:56,988 deepspeed build time = 15.041398525238037 secs 2022-10-21T21:24:57,217 Preparing metadata (setup.py): finished with status 'done' 2022-10-21T21:24:57,236 Source in /tmp/pip-wheel-98rzdtrb/deepspeed_676f5379a59843a093aa36c2b9aa9b20 has version 0.7.4, which satisfies requirement deepspeed==0.7.4 from https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz 2022-10-21T21:24:57,238 Removed deepspeed==0.7.4 from https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz from build tracker '/tmp/pip-build-tracker-926mp9rg' 2022-10-21T21:24:57,255 Created temporary directory: /tmp/pip-unpack-7q6j7a8b 2022-10-21T21:24:57,256 Building wheels for collected packages: deepspeed 2022-10-21T21:24:57,266 Created temporary directory: /tmp/pip-wheel-93i0icsg 2022-10-21T21:24:57,266 Building wheel for deepspeed (setup.py): started 2022-10-21T21:24:57,268 Destination directory: /tmp/pip-wheel-93i0icsg 2022-10-21T21:24:57,269 Running command python setup.py bdist_wheel 2022-10-21T21:25:00,000 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2022-10-21T21:25:00,022  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2022-10-21T21:25:00,064 DS_BUILD_OPS=0 2022-10-21T21:25:00,066  [WARNING]  unable to import torch, please install it first 2022-10-21T21:25:00,368  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2022-10-21T21:25:00,542  [WARNING]  async_io: please install the libaio-dev package with apt 2022-10-21T21:25:00,544  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2022-10-21T21:25:00,548  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-10-21T21:25:00,548 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'utils': False, 'quantizer': False, 'transformer_inference': False} 2022-10-21T21:25:00,591 fatal: not a git repository (or any of the parent directories): .git 2022-10-21T21:25:00,597 version=0.7.4, git_hash=unknown, git_branch=unknown 2022-10-21T21:25:00,599 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2022-10-21T21:25:00,600 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'utils': True, 'quantizer': True, 'transformer_inference': False} 2022-10-21T21:25:00,601 ext_modules=[] 2022-10-21T21:25:06,245 running bdist_wheel 2022-10-21T21:25:06,691 running build 2022-10-21T21:25:06,692 running build_py 2022-10-21T21:25:07,427 creating build 2022-10-21T21:25:07,428 creating build/lib 2022-10-21T21:25:07,430 creating build/lib/deepspeed 2022-10-21T21:25:07,433 copying deepspeed/env_report.py -> build/lib/deepspeed 2022-10-21T21:25:07,438 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2022-10-21T21:25:07,441 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2022-10-21T21:25:07,444 copying deepspeed/constants.py -> build/lib/deepspeed 2022-10-21T21:25:07,448 copying deepspeed/__init__.py -> build/lib/deepspeed 2022-10-21T21:25:07,453 creating build/lib/benchmarks 2022-10-21T21:25:07,455 copying benchmarks/__init__.py -> build/lib/benchmarks 2022-10-21T21:25:07,461 creating build/lib/deepspeed/autotuning 2022-10-21T21:25:07,463 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2022-10-21T21:25:07,468 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2022-10-21T21:25:07,476 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2022-10-21T21:25:07,481 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2022-10-21T21:25:07,485 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2022-10-21T21:25:07,490 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2022-10-21T21:25:07,495 creating build/lib/deepspeed/ops 2022-10-21T21:25:07,497 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2022-10-21T21:25:07,503 creating build/lib/deepspeed/module_inject 2022-10-21T21:25:07,505 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2022-10-21T21:25:07,509 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2022-10-21T21:25:07,514 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2022-10-21T21:25:07,522 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2022-10-21T21:25:07,527 copying deepspeed/module_inject/unet.py -> build/lib/deepspeed/module_inject 2022-10-21T21:25:07,531 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2022-10-21T21:25:07,536 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2022-10-21T21:25:07,540 copying deepspeed/module_inject/encoder.py -> build/lib/deepspeed/module_inject 2022-10-21T21:25:07,543 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2022-10-21T21:25:07,550 creating build/lib/deepspeed/runtime 2022-10-21T21:25:07,552 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,556 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,567 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,572 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,577 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,582 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,587 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,591 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,595 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,599 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,603 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,607 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,613 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,621 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,626 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2022-10-21T21:25:07,631 creating build/lib/deepspeed/nebula 2022-10-21T21:25:07,633 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2022-10-21T21:25:07,637 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2022-10-21T21:25:07,640 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2022-10-21T21:25:07,646 creating build/lib/deepspeed/elasticity 2022-10-21T21:25:07,648 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2022-10-21T21:25:07,653 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2022-10-21T21:25:07,658 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2022-10-21T21:25:07,662 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2022-10-21T21:25:07,666 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2022-10-21T21:25:07,670 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2022-10-21T21:25:07,676 creating build/lib/deepspeed/profiling 2022-10-21T21:25:07,678 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2022-10-21T21:25:07,682 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2022-10-21T21:25:07,685 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2022-10-21T21:25:07,690 creating build/lib/deepspeed/inference 2022-10-21T21:25:07,692 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2022-10-21T21:25:07,697 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2022-10-21T21:25:07,703 creating build/lib/deepspeed/monitor 2022-10-21T21:25:07,705 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2022-10-21T21:25:07,709 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2022-10-21T21:25:07,712 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2022-10-21T21:25:07,716 copying deepspeed/monitor/constants.py -> build/lib/deepspeed/monitor 2022-10-21T21:25:07,719 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2022-10-21T21:25:07,722 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2022-10-21T21:25:07,725 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2022-10-21T21:25:07,728 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2022-10-21T21:25:07,733 creating build/lib/deepspeed/compression 2022-10-21T21:25:07,734 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2022-10-21T21:25:07,738 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2022-10-21T21:25:07,742 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2022-10-21T21:25:07,746 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2022-10-21T21:25:07,752 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2022-10-21T21:25:07,756 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2022-10-21T21:25:07,759 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2022-10-21T21:25:07,763 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2022-10-21T21:25:07,769 creating build/lib/deepspeed/checkpoint 2022-10-21T21:25:07,770 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-10-21T21:25:07,775 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-10-21T21:25:07,779 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2022-10-21T21:25:07,782 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2022-10-21T21:25:07,786 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-10-21T21:25:07,789 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2022-10-21T21:25:07,792 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2022-10-21T21:25:07,796 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2022-10-21T21:25:07,799 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2022-10-21T21:25:07,804 creating build/lib/deepspeed/comm 2022-10-21T21:25:07,806 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2022-10-21T21:25:07,811 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2022-10-21T21:25:07,814 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2022-10-21T21:25:07,818 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2022-10-21T21:25:07,821 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2022-10-21T21:25:07,824 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2022-10-21T21:25:07,827 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2022-10-21T21:25:07,832 creating build/lib/deepspeed/launcher 2022-10-21T21:25:07,834 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2022-10-21T21:25:07,840 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2022-10-21T21:25:07,844 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2022-10-21T21:25:07,849 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2022-10-21T21:25:07,852 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2022-10-21T21:25:07,857 creating build/lib/deepspeed/moe 2022-10-21T21:25:07,859 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2022-10-21T21:25:07,863 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2022-10-21T21:25:07,867 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2022-10-21T21:25:07,871 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2022-10-21T21:25:07,876 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2022-10-21T21:25:07,879 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2022-10-21T21:25:07,885 creating build/lib/deepspeed/pipe 2022-10-21T21:25:07,886 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2022-10-21T21:25:07,892 creating build/lib/deepspeed/utils 2022-10-21T21:25:07,895 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,899 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,904 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,908 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,912 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,917 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,921 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,924 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,928 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,931 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,935 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,938 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,942 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2022-10-21T21:25:07,947 creating build/lib/deepspeed/autotuning/tuner 2022-10-21T21:25:07,949 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-10-21T21:25:07,953 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2022-10-21T21:25:07,957 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-10-21T21:25:07,961 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2022-10-21T21:25:07,964 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-10-21T21:25:07,968 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2022-10-21T21:25:07,973 creating build/lib/deepspeed/ops/adam 2022-10-21T21:25:07,975 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2022-10-21T21:25:07,979 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2022-10-21T21:25:07,983 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2022-10-21T21:25:07,988 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2022-10-21T21:25:07,994 creating build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:07,995 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:07,999 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,003 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,007 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,010 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,014 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,018 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,021 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,027 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,030 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,034 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,038 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,041 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2022-10-21T21:25:08,047 creating build/lib/deepspeed/ops/sparse_attention 2022-10-21T21:25:08,048 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2022-10-21T21:25:08,054 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2022-10-21T21:25:08,059 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2022-10-21T21:25:08,064 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2022-10-21T21:25:08,068 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2022-10-21T21:25:08,072 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2022-10-21T21:25:08,076 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2022-10-21T21:25:08,083 creating build/lib/deepspeed/ops/transformer 2022-10-21T21:25:08,085 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2022-10-21T21:25:08,089 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2022-10-21T21:25:08,096 creating build/lib/deepspeed/ops/aio 2022-10-21T21:25:08,098 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2022-10-21T21:25:08,102 creating build/lib/deepspeed/ops/quantizer 2022-10-21T21:25:08,105 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2022-10-21T21:25:08,108 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2022-10-21T21:25:08,113 creating build/lib/deepspeed/ops/lamb 2022-10-21T21:25:08,115 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2022-10-21T21:25:08,119 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2022-10-21T21:25:08,125 creating build/lib/deepspeed/ops/adagrad 2022-10-21T21:25:08,127 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2022-10-21T21:25:08,132 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2022-10-21T21:25:08,136 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2022-10-21T21:25:08,138 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-10-21T21:25:08,144 creating build/lib/deepspeed/ops/transformer/inference 2022-10-21T21:25:08,146 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2022-10-21T21:25:08,151 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2022-10-21T21:25:08,157 copying deepspeed/ops/transformer/inference/attention.py -> build/lib/deepspeed/ops/transformer/inference 2022-10-21T21:25:08,162 copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference 2022-10-21T21:25:08,168 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2022-10-21T21:25:08,174 creating build/lib/deepspeed/runtime/swap_tensor 2022-10-21T21:25:08,176 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2022-10-21T21:25:08,182 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-10-21T21:25:08,187 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-10-21T21:25:08,192 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-10-21T21:25:08,197 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-10-21T21:25:08,202 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2022-10-21T21:25:08,207 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2022-10-21T21:25:08,210 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2022-10-21T21:25:08,215 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2022-10-21T21:25:08,220 creating build/lib/deepspeed/runtime/fp16 2022-10-21T21:25:08,222 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2022-10-21T21:25:08,228 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2022-10-21T21:25:08,233 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2022-10-21T21:25:08,236 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2022-10-21T21:25:08,243 creating build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,245 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,250 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,254 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,259 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,264 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,269 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,279 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,283 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,287 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,291 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,302 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,306 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,310 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2022-10-21T21:25:08,319 creating build/lib/deepspeed/runtime/activation_checkpointing 2022-10-21T21:25:08,321 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-10-21T21:25:08,328 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-10-21T21:25:08,331 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-10-21T21:25:08,336 creating build/lib/deepspeed/runtime/compression 2022-10-21T21:25:08,338 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2022-10-21T21:25:08,342 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2022-10-21T21:25:08,346 creating build/lib/deepspeed/runtime/checkpoint_engine 2022-10-21T21:25:08,348 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-10-21T21:25:08,353 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-10-21T21:25:08,357 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-10-21T21:25:08,359 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-10-21T21:25:08,364 creating build/lib/deepspeed/runtime/comm 2022-10-21T21:25:08,365 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2022-10-21T21:25:08,369 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2022-10-21T21:25:08,373 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2022-10-21T21:25:08,377 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2022-10-21T21:25:08,382 creating build/lib/deepspeed/runtime/data_pipeline 2022-10-21T21:25:08,385 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2022-10-21T21:25:08,388 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2022-10-21T21:25:08,394 creating build/lib/deepspeed/runtime/pipe 2022-10-21T21:25:08,396 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2022-10-21T21:25:08,403 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2022-10-21T21:25:08,408 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2022-10-21T21:25:08,412 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2022-10-21T21:25:08,418 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2022-10-21T21:25:08,421 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2022-10-21T21:25:08,427 creating build/lib/deepspeed/runtime/fp16/onebit 2022-10-21T21:25:08,428 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-10-21T21:25:08,433 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-10-21T21:25:08,438 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-10-21T21:25:08,444 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-10-21T21:25:08,449 creating build/lib/deepspeed/profiling/flops_profiler 2022-10-21T21:25:08,451 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2022-10-21T21:25:08,459 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2022-10-21T21:25:08,465 creating build/lib/benchmarks/communication 2022-10-21T21:25:08,466 copying benchmarks/communication/broadcast.py -> build/lib/benchmarks/communication 2022-10-21T21:25:08,470 copying benchmarks/communication/all_reduce.py -> build/lib/benchmarks/communication 2022-10-21T21:25:08,474 copying benchmarks/communication/pt2pt.py -> build/lib/benchmarks/communication 2022-10-21T21:25:08,478 copying benchmarks/communication/all_to_all.py -> build/lib/benchmarks/communication 2022-10-21T21:25:08,482 copying benchmarks/communication/constants.py -> build/lib/benchmarks/communication 2022-10-21T21:25:08,485 copying benchmarks/communication/__init__.py -> build/lib/benchmarks/communication 2022-10-21T21:25:08,487 copying benchmarks/communication/all_gather.py -> build/lib/benchmarks/communication 2022-10-21T21:25:08,491 copying benchmarks/communication/utils.py -> build/lib/benchmarks/communication 2022-10-21T21:25:08,495 copying benchmarks/communication/run_all.py -> build/lib/benchmarks/communication 2022-10-21T21:25:08,498 running egg_info 2022-10-21T21:25:09,969 writing deepspeed.egg-info/PKG-INFO 2022-10-21T21:25:10,558 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2022-10-21T21:25:12,328 writing entry points to deepspeed.egg-info/entry_points.txt 2022-10-21T21:25:13,511 writing requirements to deepspeed.egg-info/requires.txt 2022-10-21T21:25:14,104 writing top-level names to deepspeed.egg-info/top_level.txt 2022-10-21T21:25:14,322 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2022-10-21T21:25:14,394 reading manifest template 'MANIFEST.in' 2022-10-21T21:25:15,378 warning: no files found matching '*.hip' under directory 'deepspeed' 2022-10-21T21:25:16,120 warning: no files found matching '*.cc' under directory 'deepspeed' 2022-10-21T21:25:16,640 warning: no files found matching '*.tr' under directory 'csrc' 2022-10-21T21:25:16,770 warning: no files found matching '*.cc' under directory 'csrc' 2022-10-21T21:25:16,806 adding license file 'LICENSE' 2022-10-21T21:25:16,859 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2022-10-21T21:25:16,865 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,866 ############################ 2022-10-21T21:25:16,866 # Package would be ignored # 2022-10-21T21:25:16,866 ############################ 2022-10-21T21:25:16,867 Python recognizes 'benchmarks.inference' as an importable package, however it is 2022-10-21T21:25:16,867 included in the distribution as "data". 2022-10-21T21:25:16,867 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,868 therefore is considered deprecated). 2022-10-21T21:25:16,868 Please make sure that 'benchmarks.inference' is included as a package by using 2022-10-21T21:25:16,868 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,869 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,869 documentation page. 2022-10-21T21:25:16,870 !! 2022-10-21T21:25:16,871 check.warn(importable) 2022-10-21T21:25:16,872 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,873 ############################ 2022-10-21T21:25:16,873 # Package would be ignored # 2022-10-21T21:25:16,873 ############################ 2022-10-21T21:25:16,874 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, however it is 2022-10-21T21:25:16,874 included in the distribution as "data". 2022-10-21T21:25:16,874 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,874 therefore is considered deprecated). 2022-10-21T21:25:16,875 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2022-10-21T21:25:16,875 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,876 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,876 documentation page. 2022-10-21T21:25:16,877 !! 2022-10-21T21:25:16,878 check.warn(importable) 2022-10-21T21:25:16,878 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,879 ############################ 2022-10-21T21:25:16,879 # Package would be ignored # 2022-10-21T21:25:16,880 ############################ 2022-10-21T21:25:16,880 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, however it is 2022-10-21T21:25:16,880 included in the distribution as "data". 2022-10-21T21:25:16,880 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,881 therefore is considered deprecated). 2022-10-21T21:25:16,881 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2022-10-21T21:25:16,882 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,882 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,882 documentation page. 2022-10-21T21:25:16,883 !! 2022-10-21T21:25:16,884 check.warn(importable) 2022-10-21T21:25:16,884 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,885 ############################ 2022-10-21T21:25:16,885 # Package would be ignored # 2022-10-21T21:25:16,886 ############################ 2022-10-21T21:25:16,886 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, however it is 2022-10-21T21:25:16,886 included in the distribution as "data". 2022-10-21T21:25:16,887 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,887 therefore is considered deprecated). 2022-10-21T21:25:16,887 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2022-10-21T21:25:16,888 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,888 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,889 documentation page. 2022-10-21T21:25:16,889 !! 2022-10-21T21:25:16,890 check.warn(importable) 2022-10-21T21:25:16,890 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,891 ############################ 2022-10-21T21:25:16,891 # Package would be ignored # 2022-10-21T21:25:16,892 ############################ 2022-10-21T21:25:16,892 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, however it is 2022-10-21T21:25:16,892 included in the distribution as "data". 2022-10-21T21:25:16,892 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,893 therefore is considered deprecated). 2022-10-21T21:25:16,893 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2022-10-21T21:25:16,894 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,894 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,895 documentation page. 2022-10-21T21:25:16,895 !! 2022-10-21T21:25:16,896 check.warn(importable) 2022-10-21T21:25:16,896 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,897 ############################ 2022-10-21T21:25:16,898 # Package would be ignored # 2022-10-21T21:25:16,898 ############################ 2022-10-21T21:25:16,898 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, however it is 2022-10-21T21:25:16,898 included in the distribution as "data". 2022-10-21T21:25:16,899 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,899 therefore is considered deprecated). 2022-10-21T21:25:16,900 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2022-10-21T21:25:16,900 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,900 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,901 documentation page. 2022-10-21T21:25:16,902 !! 2022-10-21T21:25:16,902 check.warn(importable) 2022-10-21T21:25:16,902 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,903 ############################ 2022-10-21T21:25:16,904 # Package would be ignored # 2022-10-21T21:25:16,904 ############################ 2022-10-21T21:25:16,904 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, however it is 2022-10-21T21:25:16,904 included in the distribution as "data". 2022-10-21T21:25:16,905 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,905 therefore is considered deprecated). 2022-10-21T21:25:16,905 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2022-10-21T21:25:16,906 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,906 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,907 documentation page. 2022-10-21T21:25:16,907 !! 2022-10-21T21:25:16,908 check.warn(importable) 2022-10-21T21:25:16,908 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,909 ############################ 2022-10-21T21:25:16,909 # Package would be ignored # 2022-10-21T21:25:16,910 ############################ 2022-10-21T21:25:16,910 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, however it is 2022-10-21T21:25:16,910 included in the distribution as "data". 2022-10-21T21:25:16,911 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,911 therefore is considered deprecated). 2022-10-21T21:25:16,911 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2022-10-21T21:25:16,912 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,912 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,913 documentation page. 2022-10-21T21:25:16,913 !! 2022-10-21T21:25:16,914 check.warn(importable) 2022-10-21T21:25:16,914 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,915 ############################ 2022-10-21T21:25:16,915 # Package would be ignored # 2022-10-21T21:25:16,916 ############################ 2022-10-21T21:25:16,916 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, however it is 2022-10-21T21:25:16,916 included in the distribution as "data". 2022-10-21T21:25:16,917 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,917 therefore is considered deprecated). 2022-10-21T21:25:16,917 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2022-10-21T21:25:16,918 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,918 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,919 documentation page. 2022-10-21T21:25:16,920 !! 2022-10-21T21:25:16,920 check.warn(importable) 2022-10-21T21:25:16,920 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,921 ############################ 2022-10-21T21:25:16,922 # Package would be ignored # 2022-10-21T21:25:16,922 ############################ 2022-10-21T21:25:16,922 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, however it is 2022-10-21T21:25:16,923 included in the distribution as "data". 2022-10-21T21:25:16,923 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,923 therefore is considered deprecated). 2022-10-21T21:25:16,924 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2022-10-21T21:25:16,924 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,925 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,925 documentation page. 2022-10-21T21:25:16,926 !! 2022-10-21T21:25:16,927 check.warn(importable) 2022-10-21T21:25:16,927 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,928 ############################ 2022-10-21T21:25:16,929 # Package would be ignored # 2022-10-21T21:25:16,929 ############################ 2022-10-21T21:25:16,929 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, however it is 2022-10-21T21:25:16,930 included in the distribution as "data". 2022-10-21T21:25:16,930 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,930 therefore is considered deprecated). 2022-10-21T21:25:16,931 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2022-10-21T21:25:16,931 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,932 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,932 documentation page. 2022-10-21T21:25:16,933 !! 2022-10-21T21:25:16,934 check.warn(importable) 2022-10-21T21:25:16,934 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,935 ############################ 2022-10-21T21:25:16,935 # Package would be ignored # 2022-10-21T21:25:16,936 ############################ 2022-10-21T21:25:16,936 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, however it is 2022-10-21T21:25:16,936 included in the distribution as "data". 2022-10-21T21:25:16,937 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,937 therefore is considered deprecated). 2022-10-21T21:25:16,938 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2022-10-21T21:25:16,938 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,938 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,939 documentation page. 2022-10-21T21:25:16,940 !! 2022-10-21T21:25:16,940 check.warn(importable) 2022-10-21T21:25:16,941 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,942 ############################ 2022-10-21T21:25:16,942 # Package would be ignored # 2022-10-21T21:25:16,942 ############################ 2022-10-21T21:25:16,943 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, however it is 2022-10-21T21:25:16,943 included in the distribution as "data". 2022-10-21T21:25:16,943 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,944 therefore is considered deprecated). 2022-10-21T21:25:16,944 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2022-10-21T21:25:16,945 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,945 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,945 documentation page. 2022-10-21T21:25:16,946 !! 2022-10-21T21:25:16,947 check.warn(importable) 2022-10-21T21:25:16,947 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,948 ############################ 2022-10-21T21:25:16,949 # Package would be ignored # 2022-10-21T21:25:16,949 ############################ 2022-10-21T21:25:16,949 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, however it is 2022-10-21T21:25:16,950 included in the distribution as "data". 2022-10-21T21:25:16,950 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,950 therefore is considered deprecated). 2022-10-21T21:25:16,951 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2022-10-21T21:25:16,951 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,952 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,952 documentation page. 2022-10-21T21:25:16,953 !! 2022-10-21T21:25:16,954 check.warn(importable) 2022-10-21T21:25:16,954 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,955 ############################ 2022-10-21T21:25:16,955 # Package would be ignored # 2022-10-21T21:25:16,956 ############################ 2022-10-21T21:25:16,956 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, however it is 2022-10-21T21:25:16,956 included in the distribution as "data". 2022-10-21T21:25:16,956 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,957 therefore is considered deprecated). 2022-10-21T21:25:16,957 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2022-10-21T21:25:16,958 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,958 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,959 documentation page. 2022-10-21T21:25:16,960 !! 2022-10-21T21:25:16,960 check.warn(importable) 2022-10-21T21:25:16,961 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:153: SetuptoolsDeprecationWarning: !! 2022-10-21T21:25:16,962 ############################ 2022-10-21T21:25:16,962 # Package would be ignored # 2022-10-21T21:25:16,962 ############################ 2022-10-21T21:25:16,963 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, however it is 2022-10-21T21:25:16,963 included in the distribution as "data". 2022-10-21T21:25:16,963 This behavior is likely to change in future versions of setuptools (and 2022-10-21T21:25:16,964 therefore is considered deprecated). 2022-10-21T21:25:16,964 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2022-10-21T21:25:16,965 setuptools' `packages` configuration field or the proper discovery methods. 2022-10-21T21:25:16,966 You can read more about "package discovery" and "data files" on setuptools 2022-10-21T21:25:16,966 documentation page. 2022-10-21T21:25:16,967 !! 2022-10-21T21:25:16,968 check.warn(importable) 2022-10-21T21:25:16,968 creating build/lib/benchmarks/inference 2022-10-21T21:25:16,968 copying benchmarks/inference/bert-bench.py -> build/lib/benchmarks/inference 2022-10-21T21:25:16,969 copying benchmarks/inference/collect_results.py -> build/lib/benchmarks/inference 2022-10-21T21:25:16,969 copying benchmarks/inference/gpt-bench.py -> build/lib/benchmarks/inference 2022-10-21T21:25:16,969 creating build/lib/deepspeed/autotuning/config_templates 2022-10-21T21:25:16,970 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2022-10-21T21:25:16,970 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2022-10-21T21:25:16,971 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2022-10-21T21:25:16,971 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2022-10-21T21:25:16,971 creating build/lib/deepspeed/ops/csrc 2022-10-21T21:25:16,971 creating build/lib/deepspeed/ops/csrc/adagrad 2022-10-21T21:25:16,972 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2022-10-21T21:25:16,972 creating build/lib/deepspeed/ops/csrc/adam 2022-10-21T21:25:16,972 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2022-10-21T21:25:16,973 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2022-10-21T21:25:16,973 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2022-10-21T21:25:16,977 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2022-10-21T21:25:16,982 creating build/lib/deepspeed/ops/csrc/aio 2022-10-21T21:25:16,983 creating build/lib/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:16,986 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:16,992 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:16,996 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:17,001 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:17,006 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:17,011 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:17,015 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:17,016 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:17,020 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:17,024 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:17,029 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:17,033 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:17,037 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:17,041 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:17,045 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:17,049 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:17,052 creating build/lib/deepspeed/ops/csrc/aio/py_test 2022-10-21T21:25:17,054 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2022-10-21T21:25:17,057 creating build/lib/deepspeed/ops/csrc/common 2022-10-21T21:25:17,059 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2022-10-21T21:25:17,063 creating build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,064 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,069 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,072 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,077 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,082 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,087 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,092 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,097 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,101 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,106 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,110 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,114 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,119 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,123 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,127 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,131 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,135 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,141 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,145 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,149 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,153 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,157 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,161 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2022-10-21T21:25:17,166 creating build/lib/deepspeed/ops/csrc/lamb 2022-10-21T21:25:17,167 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2022-10-21T21:25:17,172 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2022-10-21T21:25:17,177 creating build/lib/deepspeed/ops/csrc/quantization 2022-10-21T21:25:17,178 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2022-10-21T21:25:17,182 copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2022-10-21T21:25:17,188 creating build/lib/deepspeed/ops/csrc/sparse_attention 2022-10-21T21:25:17,189 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2022-10-21T21:25:17,194 creating build/lib/deepspeed/ops/csrc/transformer 2022-10-21T21:25:17,195 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-10-21T21:25:17,201 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-10-21T21:25:17,206 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2022-10-21T21:25:17,213 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-10-21T21:25:17,218 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-10-21T21:25:17,222 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-10-21T21:25:17,231 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-10-21T21:25:17,236 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-10-21T21:25:17,241 creating build/lib/deepspeed/ops/csrc/transformer/inference 2022-10-21T21:25:17,242 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:17,244 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:17,249 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:17,254 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:17,260 copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:17,265 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:17,273 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:17,277 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:17,282 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:17,288 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-10-21T21:25:17,290 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-10-21T21:25:17,295 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-10-21T21:25:17,300 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-10-21T21:25:17,305 creating build/lib/deepspeed/ops/csrc/utils 2022-10-21T21:25:17,306 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2022-10-21T21:25:17,310 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-10-21T21:25:17,315 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-10-21T21:25:17,318 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-10-21T21:25:17,379 running build_scripts 2022-10-21T21:25:17,380 creating build/scripts-3.7 2022-10-21T21:25:17,382 copying and adjusting bin/deepspeed -> build/scripts-3.7 2022-10-21T21:25:17,386 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2022-10-21T21:25:17,388 copying and adjusting bin/ds -> build/scripts-3.7 2022-10-21T21:25:17,391 copying bin/ds_ssh -> build/scripts-3.7 2022-10-21T21:25:17,395 copying and adjusting bin/ds_report -> build/scripts-3.7 2022-10-21T21:25:17,398 copying and adjusting bin/ds_bench -> build/scripts-3.7 2022-10-21T21:25:17,401 copying and adjusting bin/dsr -> build/scripts-3.7 2022-10-21T21:25:17,403 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2022-10-21T21:25:17,405 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2022-10-21T21:25:17,406 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2022-10-21T21:25:17,406 changing mode of build/scripts-3.7/ds from 644 to 755 2022-10-21T21:25:17,407 changing mode of build/scripts-3.7/ds_report from 644 to 755 2022-10-21T21:25:17,407 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2022-10-21T21:25:17,408 changing mode of build/scripts-3.7/dsr from 644 to 755 2022-10-21T21:25:17,408 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2022-10-21T21:25:18,147 /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2022-10-21T21:25:18,148 setuptools.SetuptoolsDeprecationWarning, 2022-10-21T21:25:18,895 installing to build/bdist.linux-armv7l/wheel 2022-10-21T21:25:18,895 running install 2022-10-21T21:25:18,956 running install_lib 2022-10-21T21:25:19,703 creating build/bdist.linux-armv7l 2022-10-21T21:25:19,704 creating build/bdist.linux-armv7l/wheel 2022-10-21T21:25:19,707 creating build/bdist.linux-armv7l/wheel/deepspeed 2022-10-21T21:25:19,710 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-10-21T21:25:19,713 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-10-21T21:25:19,715 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-10-21T21:25:19,719 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-10-21T21:25:19,722 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-10-21T21:25:19,726 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-10-21T21:25:19,729 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-10-21T21:25:19,735 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-10-21T21:25:19,736 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-10-21T21:25:19,740 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-10-21T21:25:19,744 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-10-21T21:25:19,747 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-10-21T21:25:19,751 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-10-21T21:25:19,754 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-10-21T21:25:19,757 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-10-21T21:25:19,763 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-10-21T21:25:19,767 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-10-21T21:25:19,770 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-10-21T21:25:19,774 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-10-21T21:25:19,780 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2022-10-21T21:25:19,782 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-10-21T21:25:19,784 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-10-21T21:25:19,788 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-10-21T21:25:19,791 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-10-21T21:25:19,795 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-10-21T21:25:19,799 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2022-10-21T21:25:19,802 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-10-21T21:25:19,803 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-10-21T21:25:19,807 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-10-21T21:25:19,811 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-10-21T21:25:19,816 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-10-21T21:25:19,821 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,823 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,828 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,833 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,838 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,843 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,847 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,852 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,856 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,860 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,865 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,869 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,872 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,876 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,880 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,883 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,887 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,891 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,894 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,897 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,901 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,905 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,908 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,911 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-10-21T21:25:19,916 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-10-21T21:25:19,918 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-10-21T21:25:19,922 copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-10-21T21:25:19,929 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2022-10-21T21:25:19,931 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2022-10-21T21:25:19,937 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-10-21T21:25:19,939 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-10-21T21:25:19,946 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-10-21T21:25:19,951 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-10-21T21:25:19,957 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-10-21T21:25:19,961 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-10-21T21:25:19,969 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-10-21T21:25:19,976 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2022-10-21T21:25:19,979 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:19,981 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:19,987 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:19,992 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:19,998 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:20,005 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:20,010 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:20,015 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:20,018 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-10-21T21:25:20,024 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-10-21T21:25:20,025 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-10-21T21:25:20,029 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-10-21T21:25:20,034 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-10-21T21:25:20,038 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-10-21T21:25:20,044 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-10-21T21:25:20,049 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2022-10-21T21:25:20,052 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:20,053 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:20,057 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:20,060 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:20,064 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:20,068 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:20,071 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:20,075 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:20,079 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:20,082 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-10-21T21:25:20,086 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2022-10-21T21:25:20,088 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2022-10-21T21:25:20,092 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:20,094 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:20,099 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:20,102 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:20,106 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:20,109 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:20,112 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-10-21T21:25:20,117 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-10-21T21:25:20,119 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-10-21T21:25:20,123 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-10-21T21:25:20,128 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2022-10-21T21:25:20,129 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2022-10-21T21:25:20,134 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2022-10-21T21:25:20,135 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2022-10-21T21:25:20,141 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2022-10-21T21:25:20,142 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2022-10-21T21:25:20,147 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,149 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,152 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,156 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,159 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,163 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,166 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,170 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,174 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,179 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,183 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,187 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,191 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,194 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-10-21T21:25:20,199 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-10-21T21:25:20,201 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-10-21T21:25:20,207 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-10-21T21:25:20,212 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-10-21T21:25:20,217 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-10-21T21:25:20,221 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-10-21T21:25:20,225 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-10-21T21:25:20,229 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-10-21T21:25:20,237 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-10-21T21:25:20,239 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-10-21T21:25:20,243 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-10-21T21:25:20,247 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-10-21T21:25:20,250 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-10-21T21:25:20,256 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-10-21T21:25:20,259 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-10-21T21:25:20,261 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-10-21T21:25:20,265 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-10-21T21:25:20,270 copying build/lib/deepspeed/ops/transformer/inference/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-10-21T21:25:20,277 copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-10-21T21:25:20,283 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-10-21T21:25:20,287 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-10-21T21:25:20,291 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-10-21T21:25:20,298 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2022-10-21T21:25:20,300 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2022-10-21T21:25:20,305 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-10-21T21:25:20,307 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-10-21T21:25:20,310 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-10-21T21:25:20,315 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-10-21T21:25:20,317 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-10-21T21:25:20,321 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-10-21T21:25:20,326 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2022-10-21T21:25:20,331 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-10-21T21:25:20,333 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-10-21T21:25:20,337 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-10-21T21:25:20,341 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-10-21T21:25:20,347 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-10-21T21:25:20,349 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-10-21T21:25:20,353 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-10-21T21:25:20,357 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-10-21T21:25:20,363 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-10-21T21:25:20,368 copying build/lib/deepspeed/module_inject/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-10-21T21:25:20,371 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-10-21T21:25:20,375 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-10-21T21:25:20,378 copying build/lib/deepspeed/module_inject/encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-10-21T21:25:20,381 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-10-21T21:25:20,384 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-10-21T21:25:20,389 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,391 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,395 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,408 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-10-21T21:25:20,409 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-10-21T21:25:20,414 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-10-21T21:25:20,418 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-10-21T21:25:20,422 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-10-21T21:25:20,426 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-10-21T21:25:20,430 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-10-21T21:25:20,434 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-10-21T21:25:20,437 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-10-21T21:25:20,440 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-10-21T21:25:20,444 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,449 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,453 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,458 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,464 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-10-21T21:25:20,465 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-10-21T21:25:20,471 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-10-21T21:25:20,473 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-10-21T21:25:20,477 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-10-21T21:25:20,482 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-10-21T21:25:20,487 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-10-21T21:25:20,490 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-10-21T21:25:20,495 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-10-21T21:25:20,498 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-10-21T21:25:20,502 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,506 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,508 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,512 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,516 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,520 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,525 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,530 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,540 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,543 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,546 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,550 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,559 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,563 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,566 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-10-21T21:25:20,574 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,579 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-10-21T21:25:20,580 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-10-21T21:25:20,586 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-10-21T21:25:20,588 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-10-21T21:25:20,592 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-10-21T21:25:20,594 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-10-21T21:25:20,598 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-10-21T21:25:20,600 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,605 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-10-21T21:25:20,606 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-10-21T21:25:20,611 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-10-21T21:25:20,614 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-10-21T21:25:20,617 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-10-21T21:25:20,621 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-10-21T21:25:20,622 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-10-21T21:25:20,627 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-10-21T21:25:20,630 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-10-21T21:25:20,634 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-10-21T21:25:20,639 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-10-21T21:25:20,641 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-10-21T21:25:20,644 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-10-21T21:25:20,647 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,652 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,655 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,662 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-10-21T21:25:20,663 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-10-21T21:25:20,671 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-10-21T21:25:20,676 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-10-21T21:25:20,680 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-10-21T21:25:20,686 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-10-21T21:25:20,689 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-10-21T21:25:20,693 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,699 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,703 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-10-21T21:25:20,708 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-10-21T21:25:20,709 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-10-21T21:25:20,713 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-10-21T21:25:20,716 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-10-21T21:25:20,720 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-10-21T21:25:20,722 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-10-21T21:25:20,726 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-10-21T21:25:20,731 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-10-21T21:25:20,734 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-10-21T21:25:20,737 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-10-21T21:25:20,741 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-10-21T21:25:20,745 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-10-21T21:25:20,747 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-10-21T21:25:20,749 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-10-21T21:25:20,756 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-10-21T21:25:20,759 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-10-21T21:25:20,762 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-10-21T21:25:20,764 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-10-21T21:25:20,768 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-10-21T21:25:20,772 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-10-21T21:25:20,773 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-10-21T21:25:20,778 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-10-21T21:25:20,782 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-10-21T21:25:20,783 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-10-21T21:25:20,787 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-10-21T21:25:20,790 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-10-21T21:25:20,793 copying build/lib/deepspeed/monitor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-10-21T21:25:20,796 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-10-21T21:25:20,799 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-10-21T21:25:20,802 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-10-21T21:25:20,805 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-10-21T21:25:20,809 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-10-21T21:25:20,810 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-10-21T21:25:20,814 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-10-21T21:25:20,819 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-10-21T21:25:20,822 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-10-21T21:25:20,830 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-10-21T21:25:20,833 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-10-21T21:25:20,836 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-10-21T21:25:20,841 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-10-21T21:25:20,846 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-10-21T21:25:20,848 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-10-21T21:25:20,852 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-10-21T21:25:20,856 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-10-21T21:25:20,860 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-10-21T21:25:20,863 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-10-21T21:25:20,867 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-10-21T21:25:20,870 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-10-21T21:25:20,873 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-10-21T21:25:20,876 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-10-21T21:25:20,880 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-10-21T21:25:20,882 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-10-21T21:25:20,887 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-10-21T21:25:20,890 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-10-21T21:25:20,894 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-10-21T21:25:20,897 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-10-21T21:25:20,900 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-10-21T21:25:20,903 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-10-21T21:25:20,907 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-10-21T21:25:20,910 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-10-21T21:25:20,916 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-10-21T21:25:20,917 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-10-21T21:25:20,922 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-10-21T21:25:20,926 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-10-21T21:25:20,930 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-10-21T21:25:20,933 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-10-21T21:25:20,937 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-10-21T21:25:20,938 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-10-21T21:25:20,941 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-10-21T21:25:20,944 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-10-21T21:25:20,948 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-10-21T21:25:20,952 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-10-21T21:25:20,955 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-10-21T21:25:20,959 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2022-10-21T21:25:20,961 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2022-10-21T21:25:20,965 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:20,967 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:20,971 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:20,975 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:20,978 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:20,982 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:20,986 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:20,990 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:20,993 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:20,996 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:20,999 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:21,002 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:21,006 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:21,009 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-10-21T21:25:21,013 creating build/bdist.linux-armv7l/wheel/benchmarks 2022-10-21T21:25:21,015 creating build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-10-21T21:25:21,017 copying build/lib/benchmarks/inference/collect_results.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-10-21T21:25:21,020 copying build/lib/benchmarks/inference/gpt-bench.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-10-21T21:25:21,024 copying build/lib/benchmarks/inference/bert-bench.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-10-21T21:25:21,028 creating build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-10-21T21:25:21,029 copying build/lib/benchmarks/communication/broadcast.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-10-21T21:25:21,033 copying build/lib/benchmarks/communication/all_reduce.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-10-21T21:25:21,036 copying build/lib/benchmarks/communication/pt2pt.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-10-21T21:25:21,040 copying build/lib/benchmarks/communication/all_to_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-10-21T21:25:21,043 copying build/lib/benchmarks/communication/constants.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-10-21T21:25:21,046 copying build/lib/benchmarks/communication/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-10-21T21:25:21,049 copying build/lib/benchmarks/communication/all_gather.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-10-21T21:25:21,052 copying build/lib/benchmarks/communication/utils.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-10-21T21:25:21,056 copying build/lib/benchmarks/communication/run_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-10-21T21:25:21,059 copying build/lib/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks 2022-10-21T21:25:21,061 running install_egg_info 2022-10-21T21:25:21,850 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.7.4-py3.7.egg-info 2022-10-21T21:25:21,877 running install_scripts 2022-10-21T21:25:21,986 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data 2022-10-21T21:25:21,987 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts 2022-10-21T21:25:21,989 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts 2022-10-21T21:25:21,992 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts 2022-10-21T21:25:21,996 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts 2022-10-21T21:25:21,999 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts 2022-10-21T21:25:22,002 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts 2022-10-21T21:25:22,006 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts 2022-10-21T21:25:22,009 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts 2022-10-21T21:25:22,013 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts 2022-10-21T21:25:22,015 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts/deepspeed to 755 2022-10-21T21:25:22,016 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts/dsr to 755 2022-10-21T21:25:22,017 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts/deepspeed.pt to 755 2022-10-21T21:25:22,017 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts/ds_report to 755 2022-10-21T21:25:22,018 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts/ds to 755 2022-10-21T21:25:22,018 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts/ds_ssh to 755 2022-10-21T21:25:22,019 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts/ds_bench to 755 2022-10-21T21:25:22,019 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.data/scripts/ds_elastic to 755 2022-10-21T21:25:22,296 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2022-10-21T21:25:22,304 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.4.dist-info/WHEEL 2022-10-21T21:25:22,309 creating '/tmp/pip-wheel-93i0icsg/deepspeed-0.7.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2022-10-21T21:25:22,313 adding 'benchmarks/__init__.py' 2022-10-21T21:25:22,317 adding 'benchmarks/communication/__init__.py' 2022-10-21T21:25:22,320 adding 'benchmarks/communication/all_gather.py' 2022-10-21T21:25:22,323 adding 'benchmarks/communication/all_reduce.py' 2022-10-21T21:25:22,326 adding 'benchmarks/communication/all_to_all.py' 2022-10-21T21:25:22,328 adding 'benchmarks/communication/broadcast.py' 2022-10-21T21:25:22,331 adding 'benchmarks/communication/constants.py' 2022-10-21T21:25:22,333 adding 'benchmarks/communication/pt2pt.py' 2022-10-21T21:25:22,336 adding 'benchmarks/communication/run_all.py' 2022-10-21T21:25:22,339 adding 'benchmarks/communication/utils.py' 2022-10-21T21:25:22,343 adding 'benchmarks/inference/bert-bench.py' 2022-10-21T21:25:22,346 adding 'benchmarks/inference/collect_results.py' 2022-10-21T21:25:22,348 adding 'benchmarks/inference/gpt-bench.py' 2022-10-21T21:25:22,355 adding 'deepspeed/__init__.py' 2022-10-21T21:25:22,357 adding 'deepspeed/constants.py' 2022-10-21T21:25:22,360 adding 'deepspeed/env_report.py' 2022-10-21T21:25:22,362 adding 'deepspeed/git_version_info.py' 2022-10-21T21:25:22,365 adding 'deepspeed/git_version_info_installed.py' 2022-10-21T21:25:22,368 adding 'deepspeed/autotuning/__init__.py' 2022-10-21T21:25:22,380 adding 'deepspeed/autotuning/autotuner.py' 2022-10-21T21:25:22,384 adding 'deepspeed/autotuning/config.py' 2022-10-21T21:25:22,387 adding 'deepspeed/autotuning/constants.py' 2022-10-21T21:25:22,392 adding 'deepspeed/autotuning/scheduler.py' 2022-10-21T21:25:22,396 adding 'deepspeed/autotuning/utils.py' 2022-10-21T21:25:22,400 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2022-10-21T21:25:22,402 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2022-10-21T21:25:22,404 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2022-10-21T21:25:22,406 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2022-10-21T21:25:22,409 adding 'deepspeed/autotuning/tuner/__init__.py' 2022-10-21T21:25:22,411 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2022-10-21T21:25:22,414 adding 'deepspeed/autotuning/tuner/cost_model.py' 2022-10-21T21:25:22,416 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2022-10-21T21:25:22,419 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2022-10-21T21:25:22,421 adding 'deepspeed/autotuning/tuner/utils.py' 2022-10-21T21:25:22,425 adding 'deepspeed/checkpoint/__init__.py' 2022-10-21T21:25:22,427 adding 'deepspeed/checkpoint/constants.py' 2022-10-21T21:25:22,431 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2022-10-21T21:25:22,434 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2022-10-21T21:25:22,437 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2022-10-21T21:25:22,440 adding 'deepspeed/checkpoint/reshape_utils.py' 2022-10-21T21:25:22,443 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2022-10-21T21:25:22,445 adding 'deepspeed/checkpoint/utils.py' 2022-10-21T21:25:22,448 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2022-10-21T21:25:22,452 adding 'deepspeed/comm/__init__.py' 2022-10-21T21:25:22,454 adding 'deepspeed/comm/backend.py' 2022-10-21T21:25:22,460 adding 'deepspeed/comm/comm.py' 2022-10-21T21:25:22,463 adding 'deepspeed/comm/config.py' 2022-10-21T21:25:22,465 adding 'deepspeed/comm/constants.py' 2022-10-21T21:25:22,468 adding 'deepspeed/comm/torch.py' 2022-10-21T21:25:22,471 adding 'deepspeed/comm/utils.py' 2022-10-21T21:25:22,475 adding 'deepspeed/compression/__init__.py' 2022-10-21T21:25:22,482 adding 'deepspeed/compression/basic_layer.py' 2022-10-21T21:25:22,487 adding 'deepspeed/compression/compress.py' 2022-10-21T21:25:22,491 adding 'deepspeed/compression/config.py' 2022-10-21T21:25:22,494 adding 'deepspeed/compression/constants.py' 2022-10-21T21:25:22,497 adding 'deepspeed/compression/helper.py' 2022-10-21T21:25:22,500 adding 'deepspeed/compression/scheduler.py' 2022-10-21T21:25:22,503 adding 'deepspeed/compression/utils.py' 2022-10-21T21:25:22,507 adding 'deepspeed/elasticity/__init__.py' 2022-10-21T21:25:22,509 adding 'deepspeed/elasticity/config.py' 2022-10-21T21:25:22,512 adding 'deepspeed/elasticity/constants.py' 2022-10-21T21:25:22,516 adding 'deepspeed/elasticity/elastic_agent.py' 2022-10-21T21:25:22,521 adding 'deepspeed/elasticity/elasticity.py' 2022-10-21T21:25:22,524 adding 'deepspeed/elasticity/utils.py' 2022-10-21T21:25:22,527 adding 'deepspeed/inference/__init__.py' 2022-10-21T21:25:22,534 adding 'deepspeed/inference/engine.py' 2022-10-21T21:25:22,537 adding 'deepspeed/launcher/__init__.py' 2022-10-21T21:25:22,539 adding 'deepspeed/launcher/constants.py' 2022-10-21T21:25:22,543 adding 'deepspeed/launcher/launch.py' 2022-10-21T21:25:22,548 adding 'deepspeed/launcher/multinode_runner.py' 2022-10-21T21:25:22,555 adding 'deepspeed/launcher/runner.py' 2022-10-21T21:25:22,559 adding 'deepspeed/module_inject/__init__.py' 2022-10-21T21:25:22,561 adding 'deepspeed/module_inject/encoder.py' 2022-10-21T21:25:22,564 adding 'deepspeed/module_inject/inject.py' 2022-10-21T21:25:22,566 adding 'deepspeed/module_inject/layers.py' 2022-10-21T21:25:22,570 adding 'deepspeed/module_inject/load_checkpoint.py' 2022-10-21T21:25:22,572 adding 'deepspeed/module_inject/module_quantize.py' 2022-10-21T21:25:22,585 adding 'deepspeed/module_inject/replace_module.py' 2022-10-21T21:25:22,591 adding 'deepspeed/module_inject/replace_policy.py' 2022-10-21T21:25:22,594 adding 'deepspeed/module_inject/unet.py' 2022-10-21T21:25:22,597 adding 'deepspeed/moe/__init__.py' 2022-10-21T21:25:22,599 adding 'deepspeed/moe/experts.py' 2022-10-21T21:25:22,602 adding 'deepspeed/moe/layer.py' 2022-10-21T21:25:22,605 adding 'deepspeed/moe/mappings.py' 2022-10-21T21:25:22,610 adding 'deepspeed/moe/sharded_moe.py' 2022-10-21T21:25:22,614 adding 'deepspeed/moe/utils.py' 2022-10-21T21:25:22,617 adding 'deepspeed/monitor/__init__.py' 2022-10-21T21:25:22,619 adding 'deepspeed/monitor/config.py' 2022-10-21T21:25:22,621 adding 'deepspeed/monitor/constants.py' 2022-10-21T21:25:22,624 adding 'deepspeed/monitor/csv_monitor.py' 2022-10-21T21:25:22,626 adding 'deepspeed/monitor/monitor.py' 2022-10-21T21:25:22,628 adding 'deepspeed/monitor/tensorboard.py' 2022-10-21T21:25:22,631 adding 'deepspeed/monitor/utils.py' 2022-10-21T21:25:22,633 adding 'deepspeed/monitor/wandb.py' 2022-10-21T21:25:22,636 adding 'deepspeed/nebula/__init__.py' 2022-10-21T21:25:22,638 adding 'deepspeed/nebula/config.py' 2022-10-21T21:25:22,640 adding 'deepspeed/nebula/constants.py' 2022-10-21T21:25:22,644 adding 'deepspeed/ops/__init__.py' 2022-10-21T21:25:22,647 adding 'deepspeed/ops/adagrad/__init__.py' 2022-10-21T21:25:22,649 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2022-10-21T21:25:22,653 adding 'deepspeed/ops/adam/__init__.py' 2022-10-21T21:25:22,656 adding 'deepspeed/ops/adam/cpu_adam.py' 2022-10-21T21:25:22,659 adding 'deepspeed/ops/adam/fused_adam.py' 2022-10-21T21:25:22,662 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2022-10-21T21:25:22,665 adding 'deepspeed/ops/aio/__init__.py' 2022-10-21T21:25:22,670 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2022-10-21T21:25:22,674 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2022-10-21T21:25:22,677 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2022-10-21T21:25:22,679 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2022-10-21T21:25:22,682 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2022-10-21T21:25:22,689 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2022-10-21T21:25:22,691 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2022-10-21T21:25:22,694 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2022-10-21T21:25:22,696 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2022-10-21T21:25:22,698 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2022-10-21T21:25:22,701 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2022-10-21T21:25:22,704 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2022-10-21T21:25:22,707 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2022-10-21T21:25:22,709 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2022-10-21T21:25:22,711 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2022-10-21T21:25:22,715 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2022-10-21T21:25:22,717 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2022-10-21T21:25:22,720 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2022-10-21T21:25:22,722 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2022-10-21T21:25:22,724 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2022-10-21T21:25:22,727 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2022-10-21T21:25:22,730 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2022-10-21T21:25:22,734 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2022-10-21T21:25:22,737 adding 'deepspeed/ops/csrc/includes/Timer.h' 2022-10-21T21:25:22,739 adding 'deepspeed/ops/csrc/includes/compat.h' 2022-10-21T21:25:22,741 adding 'deepspeed/ops/csrc/includes/context.h' 2022-10-21T21:25:22,745 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2022-10-21T21:25:22,748 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2022-10-21T21:25:22,751 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2022-10-21T21:25:22,754 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2022-10-21T21:25:22,757 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2022-10-21T21:25:22,759 adding 'deepspeed/ops/csrc/includes/dropout.h' 2022-10-21T21:25:22,762 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2022-10-21T21:25:22,764 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2022-10-21T21:25:22,767 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2022-10-21T21:25:22,769 adding 'deepspeed/ops/csrc/includes/gelu.h' 2022-10-21T21:25:22,772 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2022-10-21T21:25:22,775 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2022-10-21T21:25:22,780 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2022-10-21T21:25:22,783 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2022-10-21T21:25:22,785 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2022-10-21T21:25:22,787 adding 'deepspeed/ops/csrc/includes/simd.h' 2022-10-21T21:25:22,790 adding 'deepspeed/ops/csrc/includes/softmax.h' 2022-10-21T21:25:22,792 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2022-10-21T21:25:22,795 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2022-10-21T21:25:22,799 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2022-10-21T21:25:22,803 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2022-10-21T21:25:22,807 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2022-10-21T21:25:22,813 adding 'deepspeed/ops/csrc/quantization/quantizer.cu' 2022-10-21T21:25:22,818 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2022-10-21T21:25:22,822 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2022-10-21T21:25:22,828 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2022-10-21T21:25:22,837 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2022-10-21T21:25:22,842 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2022-10-21T21:25:22,846 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2022-10-21T21:25:22,856 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2022-10-21T21:25:22,862 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2022-10-21T21:25:22,868 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2022-10-21T21:25:22,874 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2022-10-21T21:25:22,877 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2022-10-21T21:25:22,883 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2022-10-21T21:25:22,887 adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu' 2022-10-21T21:25:22,898 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2022-10-21T21:25:22,902 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2022-10-21T21:25:22,906 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2022-10-21T21:25:22,912 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2022-10-21T21:25:22,918 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2022-10-21T21:25:22,921 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2022-10-21T21:25:22,925 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2022-10-21T21:25:22,928 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2022-10-21T21:25:22,931 adding 'deepspeed/ops/lamb/__init__.py' 2022-10-21T21:25:22,935 adding 'deepspeed/ops/lamb/fused_lamb.py' 2022-10-21T21:25:22,938 adding 'deepspeed/ops/op_builder/__init__.py' 2022-10-21T21:25:22,941 adding 'deepspeed/ops/op_builder/async_io.py' 2022-10-21T21:25:22,948 adding 'deepspeed/ops/op_builder/builder.py' 2022-10-21T21:25:22,951 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2022-10-21T21:25:22,953 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2022-10-21T21:25:22,955 adding 'deepspeed/ops/op_builder/fused_adam.py' 2022-10-21T21:25:22,958 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2022-10-21T21:25:22,960 adding 'deepspeed/ops/op_builder/quantizer.py' 2022-10-21T21:25:22,962 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2022-10-21T21:25:22,965 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2022-10-21T21:25:22,967 adding 'deepspeed/ops/op_builder/transformer.py' 2022-10-21T21:25:22,969 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2022-10-21T21:25:22,971 adding 'deepspeed/ops/op_builder/utils.py' 2022-10-21T21:25:22,974 adding 'deepspeed/ops/quantizer/__init__.py' 2022-10-21T21:25:22,977 adding 'deepspeed/ops/quantizer/quantizer.py' 2022-10-21T21:25:22,980 adding 'deepspeed/ops/sparse_attention/__init__.py' 2022-10-21T21:25:22,982 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2022-10-21T21:25:22,991 adding 'deepspeed/ops/sparse_attention/matmul.py' 2022-10-21T21:25:22,996 adding 'deepspeed/ops/sparse_attention/softmax.py' 2022-10-21T21:25:23,000 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2022-10-21T21:25:23,004 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2022-10-21T21:25:23,011 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2022-10-21T21:25:23,015 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2022-10-21T21:25:23,019 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2022-10-21T21:25:23,021 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2022-10-21T21:25:23,024 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2022-10-21T21:25:23,027 adding 'deepspeed/ops/transformer/__init__.py' 2022-10-21T21:25:23,033 adding 'deepspeed/ops/transformer/transformer.py' 2022-10-21T21:25:23,037 adding 'deepspeed/ops/transformer/inference/__init__.py' 2022-10-21T21:25:23,040 adding 'deepspeed/ops/transformer/inference/attention.py' 2022-10-21T21:25:23,046 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2022-10-21T21:25:23,055 adding 'deepspeed/ops/transformer/inference/transformer_inference.py' 2022-10-21T21:25:23,059 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2022-10-21T21:25:23,062 adding 'deepspeed/pipe/__init__.py' 2022-10-21T21:25:23,065 adding 'deepspeed/profiling/__init__.py' 2022-10-21T21:25:23,067 adding 'deepspeed/profiling/config.py' 2022-10-21T21:25:23,069 adding 'deepspeed/profiling/constants.py' 2022-10-21T21:25:23,072 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2022-10-21T21:25:23,084 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2022-10-21T21:25:23,089 adding 'deepspeed/runtime/__init__.py' 2022-10-21T21:25:23,094 adding 'deepspeed/runtime/bf16_optimizer.py' 2022-10-21T21:25:23,103 adding 'deepspeed/runtime/config.py' 2022-10-21T21:25:23,107 adding 'deepspeed/runtime/config_utils.py' 2022-10-21T21:25:23,111 adding 'deepspeed/runtime/constants.py' 2022-10-21T21:25:23,114 adding 'deepspeed/runtime/dataloader.py' 2022-10-21T21:25:23,117 adding 'deepspeed/runtime/eigenvalue.py' 2022-10-21T21:25:23,154 adding 'deepspeed/runtime/engine.py' 2022-10-21T21:25:23,165 adding 'deepspeed/runtime/lr_schedules.py' 2022-10-21T21:25:23,168 adding 'deepspeed/runtime/progressive_layer_drop.py' 2022-10-21T21:25:23,171 adding 'deepspeed/runtime/quantize.py' 2022-10-21T21:25:23,174 adding 'deepspeed/runtime/sparse_tensor.py' 2022-10-21T21:25:23,179 adding 'deepspeed/runtime/state_dict_factory.py' 2022-10-21T21:25:23,189 adding 'deepspeed/runtime/utils.py' 2022-10-21T21:25:23,192 adding 'deepspeed/runtime/weight_quantizer.py' 2022-10-21T21:25:23,196 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2022-10-21T21:25:23,204 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2022-10-21T21:25:23,208 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2022-10-21T21:25:23,211 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2022-10-21T21:25:23,213 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2022-10-21T21:25:23,216 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2022-10-21T21:25:23,218 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2022-10-21T21:25:23,221 adding 'deepspeed/runtime/comm/__init__.py' 2022-10-21T21:25:23,224 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2022-10-21T21:25:23,228 adding 'deepspeed/runtime/comm/mpi.py' 2022-10-21T21:25:23,231 adding 'deepspeed/runtime/comm/nccl.py' 2022-10-21T21:25:23,235 adding 'deepspeed/runtime/compression/__init__.py' 2022-10-21T21:25:23,237 adding 'deepspeed/runtime/compression/cupy.py' 2022-10-21T21:25:23,240 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2022-10-21T21:25:23,243 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2022-10-21T21:25:23,246 adding 'deepspeed/runtime/fp16/__init__.py' 2022-10-21T21:25:23,252 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2022-10-21T21:25:23,256 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2022-10-21T21:25:23,261 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2022-10-21T21:25:23,265 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2022-10-21T21:25:23,269 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2022-10-21T21:25:23,276 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2022-10-21T21:25:23,281 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2022-10-21T21:25:23,285 adding 'deepspeed/runtime/pipe/__init__.py' 2022-10-21T21:25:23,299 adding 'deepspeed/runtime/pipe/engine.py' 2022-10-21T21:25:23,308 adding 'deepspeed/runtime/pipe/module.py' 2022-10-21T21:25:23,312 adding 'deepspeed/runtime/pipe/p2p.py' 2022-10-21T21:25:23,316 adding 'deepspeed/runtime/pipe/schedule.py' 2022-10-21T21:25:23,322 adding 'deepspeed/runtime/pipe/topology.py' 2022-10-21T21:25:23,325 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2022-10-21T21:25:23,328 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2022-10-21T21:25:23,331 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2022-10-21T21:25:23,333 adding 'deepspeed/runtime/swap_tensor/constants.py' 2022-10-21T21:25:23,339 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2022-10-21T21:25:23,342 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2022-10-21T21:25:23,348 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2022-10-21T21:25:23,352 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2022-10-21T21:25:23,355 adding 'deepspeed/runtime/swap_tensor/utils.py' 2022-10-21T21:25:23,359 adding 'deepspeed/runtime/zero/__init__.py' 2022-10-21T21:25:23,362 adding 'deepspeed/runtime/zero/config.py' 2022-10-21T21:25:23,366 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2022-10-21T21:25:23,369 adding 'deepspeed/runtime/zero/linear.py' 2022-10-21T21:25:23,372 adding 'deepspeed/runtime/zero/offload_config.py' 2022-10-21T21:25:23,377 adding 'deepspeed/runtime/zero/parameter_offload.py' 2022-10-21T21:25:23,397 adding 'deepspeed/runtime/zero/partition_parameters.py' 2022-10-21T21:25:23,404 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2022-10-21T21:25:23,435 adding 'deepspeed/runtime/zero/stage3.py' 2022-10-21T21:25:23,467 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2022-10-21T21:25:23,472 adding 'deepspeed/runtime/zero/test.py' 2022-10-21T21:25:23,476 adding 'deepspeed/runtime/zero/tiling.py' 2022-10-21T21:25:23,479 adding 'deepspeed/runtime/zero/utils.py' 2022-10-21T21:25:23,482 adding 'deepspeed/utils/__init__.py' 2022-10-21T21:25:23,485 adding 'deepspeed/utils/comms_logging.py' 2022-10-21T21:25:23,488 adding 'deepspeed/utils/debug.py' 2022-10-21T21:25:23,490 adding 'deepspeed/utils/exceptions.py' 2022-10-21T21:25:23,495 adding 'deepspeed/utils/groups.py' 2022-10-21T21:25:23,498 adding 'deepspeed/utils/init_on_device.py' 2022-10-21T21:25:23,500 adding 'deepspeed/utils/logging.py' 2022-10-21T21:25:23,503 adding 'deepspeed/utils/mixed_precision_linkage.py' 2022-10-21T21:25:23,505 adding 'deepspeed/utils/nvtx.py' 2022-10-21T21:25:23,508 adding 'deepspeed/utils/tensor_fragment.py' 2022-10-21T21:25:23,511 adding 'deepspeed/utils/timer.py' 2022-10-21T21:25:23,514 adding 'deepspeed/utils/types.py' 2022-10-21T21:25:23,519 adding 'deepspeed/utils/zero_to_fp32.py' 2022-10-21T21:25:23,523 adding 'deepspeed-0.7.4.data/scripts/deepspeed' 2022-10-21T21:25:23,526 adding 'deepspeed-0.7.4.data/scripts/deepspeed.pt' 2022-10-21T21:25:23,528 adding 'deepspeed-0.7.4.data/scripts/ds' 2022-10-21T21:25:23,530 adding 'deepspeed-0.7.4.data/scripts/ds_bench' 2022-10-21T21:25:23,532 adding 'deepspeed-0.7.4.data/scripts/ds_elastic' 2022-10-21T21:25:23,534 adding 'deepspeed-0.7.4.data/scripts/ds_report' 2022-10-21T21:25:23,536 adding 'deepspeed-0.7.4.data/scripts/ds_ssh' 2022-10-21T21:25:23,538 adding 'deepspeed-0.7.4.data/scripts/dsr' 2022-10-21T21:25:23,543 adding 'deepspeed-0.7.4.dist-info/LICENSE' 2022-10-21T21:25:23,550 adding 'deepspeed-0.7.4.dist-info/METADATA' 2022-10-21T21:25:23,552 adding 'deepspeed-0.7.4.dist-info/WHEEL' 2022-10-21T21:25:23,554 adding 'deepspeed-0.7.4.dist-info/entry_points.txt' 2022-10-21T21:25:23,555 adding 'deepspeed-0.7.4.dist-info/top_level.txt' 2022-10-21T21:25:23,563 adding 'deepspeed-0.7.4.dist-info/RECORD' 2022-10-21T21:25:23,590 removing build/bdist.linux-armv7l/wheel 2022-10-21T21:25:23,775 deepspeed build time = 23.171816110610962 secs 2022-10-21T21:25:24,025 Building wheel for deepspeed (setup.py): finished with status 'done' 2022-10-21T21:25:24,052 Created wheel for deepspeed: filename=deepspeed-0.7.4-py3-none-any.whl size=676656 sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd 2022-10-21T21:25:24,055 Stored in directory: /tmp/pip-ephem-wheel-cache-t3dym9wa/wheels/b2/c8/5a/5939fdf544114ace7f9662582db99ed1d855b04f7ec8dde924 2022-10-21T21:25:24,114 Successfully built deepspeed 2022-10-21T21:25:24,160 Removed build tracker: '/tmp/pip-build-tracker-926mp9rg'