2023-04-21T01:02:33,350 Created temporary directory: /tmp/pip-ephem-wheel-cache-611ikdbb 2023-04-21T01:02:33,373 Created temporary directory: /tmp/pip-build-tracker-i6ic_5c0 2023-04-21T01:02:33,373 Initialized build tracking at /tmp/pip-build-tracker-i6ic_5c0 2023-04-21T01:02:33,374 Created build tracker: /tmp/pip-build-tracker-i6ic_5c0 2023-04-21T01:02:33,374 Entered build tracker: /tmp/pip-build-tracker-i6ic_5c0 2023-04-21T01:02:33,375 Created temporary directory: /tmp/pip-wheel-i4o0f4hf 2023-04-21T01:02:33,385 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-04-21T01:02:33,391 Created temporary directory: /tmp/pip-ephem-wheel-cache-upuqf6g5 2023-04-21T01:02:33,457 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-04-21T01:02:33,464 2 location(s) to search for versions of deepspeed: 2023-04-21T01:02:33,464 * https://pypi.org/simple/deepspeed/ 2023-04-21T01:02:33,464 * https://www.piwheels.org/simple/deepspeed/ 2023-04-21T01:02:33,465 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-04-21T01:02:33,466 Getting page https://pypi.org/simple/deepspeed/ 2023-04-21T01:02:33,469 Found index url https://pypi.org/simple 2023-04-21T01:02:33,675 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-04-21T01:02:33,707 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-04-21T01:02:33,708 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-04-21T01:02:33,709 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-04-21T01:02:33,710 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-04-21T01:02:33,710 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-04-21T01:02:33,711 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-04-21T01:02:33,711 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-04-21T01:02:33,712 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-04-21T01:02:33,713 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-04-21T01:02:33,713 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-04-21T01:02:33,714 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-04-21T01:02:33,715 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-04-21T01:02:33,716 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-04-21T01:02:33,716 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-04-21T01:02:33,717 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-04-21T01:02:33,718 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-04-21T01:02:33,718 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-04-21T01:02:33,719 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-04-21T01:02:33,720 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-04-21T01:02:33,720 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-04-21T01:02:33,721 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-04-21T01:02:33,722 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-04-21T01:02:33,722 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-04-21T01:02:33,723 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-04-21T01:02:33,724 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-04-21T01:02:33,725 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-04-21T01:02:33,725 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-04-21T01:02:33,726 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-04-21T01:02:33,727 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-04-21T01:02:33,727 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-04-21T01:02:33,728 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-04-21T01:02:33,729 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-04-21T01:02:33,729 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-04-21T01:02:33,730 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-04-21T01:02:33,731 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-04-21T01:02:33,732 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-04-21T01:02:33,732 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-04-21T01:02:33,733 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-04-21T01:02:33,734 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-04-21T01:02:33,734 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-04-21T01:02:33,735 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-04-21T01:02:33,736 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-04-21T01:02:33,736 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-04-21T01:02:33,737 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-04-21T01:02:33,738 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-04-21T01:02:33,739 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-04-21T01:02:33,739 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-04-21T01:02:33,740 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-04-21T01:02:33,741 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-04-21T01:02:33,741 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-04-21T01:02:33,742 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-04-21T01:02:33,743 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-04-21T01:02:33,744 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-04-21T01:02:33,744 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-04-21T01:02:33,745 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-04-21T01:02:33,746 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-04-21T01:02:33,746 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-04-21T01:02:33,747 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-04-21T01:02:33,748 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-04-21T01:02:33,748 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-04-21T01:02:33,749 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-04-21T01:02:33,750 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-04-21T01:02:33,750 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-04-21T01:02:33,751 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-04-21T01:02:33,752 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-04-21T01:02:33,753 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-04-21T01:02:33,753 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-04-21T01:02:33,754 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-04-21T01:02:33,755 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-04-21T01:02:33,757 Found index url https://www.piwheels.org/simple 2023-04-21T01:02:34,451 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-04-21T01:02:34,478 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,478 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,479 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,479 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,480 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,481 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,481 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,482 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,482 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,483 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,483 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,484 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,484 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,485 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,485 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,486 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,486 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,487 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,487 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,488 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,488 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,489 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,489 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,490 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,490 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,491 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,491 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,492 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,492 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,493 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,493 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,494 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,494 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,495 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,495 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,496 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,496 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-04-21T01:02:34,497 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-04-21T01:02:34,498 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-04-21T01:02:34,552 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-04-21T01:02:34,583 Collecting deepspeed==0.9.1 2023-04-21T01:02:34,597 Created temporary directory: /tmp/pip-unpack-5bvegnek 2023-04-21T01:02:34,782 Downloading deepspeed-0.9.1.tar.gz (766 kB) 2023-04-21T01:02:37,605 Added deepspeed==0.9.1 from https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz to build tracker '/tmp/pip-build-tracker-i6ic_5c0' 2023-04-21T01:02:37,609 Running setup.py (path:/tmp/pip-wheel-i4o0f4hf/deepspeed_265acee96c954f2c989cea3cef034c40/setup.py) egg_info for package deepspeed 2023-04-21T01:02:37,610 Created temporary directory: /tmp/pip-pip-egg-info-z8iiguzx 2023-04-21T01:02:37,611 Preparing metadata (setup.py): started 2023-04-21T01:02:37,613 Running command python setup.py egg_info 2023-04-21T01:02:39,848 fatal: not a git repository (or any of the parent directories): .git 2023-04-21T01:02:40,725 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-04-21T01:02:40,726  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-04-21T01:02:40,726 DS_BUILD_OPS=0 2023-04-21T01:02:40,727  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-04-21T01:02:40,727  [WARNING]  async_io: please install the libaio-dev package with apt 2023-04-21T01:02:40,727  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-04-21T01:02:40,728  [WARNING]  unable to import torch, please install it first 2023-04-21T01:02:40,728  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-04-21T01:02:40,728  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-04-21T01:02:40,728 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-04-21T01:02:40,729 version=0.9.1, git_hash=unknown, git_branch=unknown 2023-04-21T01:02:40,729 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-04-21T01:02:40,729 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-04-21T01:02:40,730 ext_modules=[] 2023-04-21T01:02:40,730 running egg_info 2023-04-21T01:02:40,758 creating /tmp/pip-pip-egg-info-z8iiguzx/deepspeed.egg-info 2023-04-21T01:02:40,835 writing /tmp/pip-pip-egg-info-z8iiguzx/deepspeed.egg-info/PKG-INFO 2023-04-21T01:02:40,873 writing dependency_links to /tmp/pip-pip-egg-info-z8iiguzx/deepspeed.egg-info/dependency_links.txt 2023-04-21T01:02:40,878 writing entry points to /tmp/pip-pip-egg-info-z8iiguzx/deepspeed.egg-info/entry_points.txt 2023-04-21T01:02:40,882 writing requirements to /tmp/pip-pip-egg-info-z8iiguzx/deepspeed.egg-info/requires.txt 2023-04-21T01:02:40,885 writing top-level names to /tmp/pip-pip-egg-info-z8iiguzx/deepspeed.egg-info/top_level.txt 2023-04-21T01:02:40,887 writing manifest file '/tmp/pip-pip-egg-info-z8iiguzx/deepspeed.egg-info/SOURCES.txt' 2023-04-21T01:02:41,404 reading manifest file '/tmp/pip-pip-egg-info-z8iiguzx/deepspeed.egg-info/SOURCES.txt' 2023-04-21T01:02:41,407 reading manifest template 'MANIFEST.in' 2023-04-21T01:02:42,949 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-04-21T01:02:43,921 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-04-21T01:02:44,605 warning: no files found matching '*.tr' under directory 'csrc' 2023-04-21T01:02:44,754 warning: no files found matching '*.cc' under directory 'csrc' 2023-04-21T01:02:44,779 warning: no files found matching '*.py' under directory 'benchmarks' 2023-04-21T01:02:44,788 adding license file 'LICENSE' 2023-04-21T01:02:44,844 writing manifest file '/tmp/pip-pip-egg-info-z8iiguzx/deepspeed.egg-info/SOURCES.txt' 2023-04-21T01:02:44,848 deepspeed build time = 4.987887382507324 secs 2023-04-21T01:02:44,976 Preparing metadata (setup.py): finished with status 'done' 2023-04-21T01:02:44,996 Source in /tmp/pip-wheel-i4o0f4hf/deepspeed_265acee96c954f2c989cea3cef034c40 has version 0.9.1, which satisfies requirement deepspeed==0.9.1 from https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz 2023-04-21T01:02:44,998 Removed deepspeed==0.9.1 from https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz from build tracker '/tmp/pip-build-tracker-i6ic_5c0' 2023-04-21T01:02:45,016 Created temporary directory: /tmp/pip-unpack-o3c6nhb4 2023-04-21T01:02:45,017 Building wheels for collected packages: deepspeed 2023-04-21T01:02:45,027 Created temporary directory: /tmp/pip-wheel-90t94cah 2023-04-21T01:02:45,027 Building wheel for deepspeed (setup.py): started 2023-04-21T01:02:45,029 Destination directory: /tmp/pip-wheel-90t94cah 2023-04-21T01:02:45,030 Running command python setup.py bdist_wheel 2023-04-21T01:02:46,219 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-04-21T01:02:46,243  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-04-21T01:02:46,353 DS_BUILD_OPS=0 2023-04-21T01:02:46,666  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-04-21T01:02:46,838  [WARNING]  async_io: please install the libaio-dev package with apt 2023-04-21T01:02:46,838  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-04-21T01:02:46,842  [WARNING]  unable to import torch, please install it first 2023-04-21T01:02:46,843  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-04-21T01:02:46,844  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-04-21T01:02:46,844 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-04-21T01:02:46,883 fatal: not a git repository (or any of the parent directories): .git 2023-04-21T01:02:46,888 version=0.9.1, git_hash=unknown, git_branch=unknown 2023-04-21T01:02:46,890 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-04-21T01:02:46,891 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-04-21T01:02:46,891 ext_modules=[] 2023-04-21T01:02:48,099 running bdist_wheel 2023-04-21T01:02:48,853 running build 2023-04-21T01:02:48,854 running build_py 2023-04-21T01:02:48,977 creating build 2023-04-21T01:02:48,978 creating build/lib 2023-04-21T01:02:48,979 creating build/lib/deepspeed 2023-04-21T01:02:48,981 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-04-21T01:02:48,985 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-04-21T01:02:48,989 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-04-21T01:02:48,993 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-04-21T01:02:48,996 copying deepspeed/constants.py -> build/lib/deepspeed 2023-04-21T01:02:49,001 creating build/lib/deepspeed/moe 2023-04-21T01:02:49,002 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-04-21T01:02:49,007 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-04-21T01:02:49,010 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-04-21T01:02:49,013 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-04-21T01:02:49,017 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-04-21T01:02:49,020 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-04-21T01:02:49,028 creating build/lib/deepspeed/monitor 2023-04-21T01:02:49,029 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-04-21T01:02:49,033 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-04-21T01:02:49,036 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-04-21T01:02:49,039 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-04-21T01:02:49,042 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-04-21T01:02:49,046 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-04-21T01:02:49,049 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-04-21T01:02:49,053 creating build/lib/deepspeed/launcher 2023-04-21T01:02:49,055 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-04-21T01:02:49,059 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-04-21T01:02:49,065 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-04-21T01:02:49,068 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-04-21T01:02:49,072 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-04-21T01:02:49,078 creating build/lib/deepspeed/module_inject 2023-04-21T01:02:49,080 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-04-21T01:02:49,084 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-04-21T01:02:49,088 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-04-21T01:02:49,092 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-04-21T01:02:49,095 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-04-21T01:02:49,098 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-04-21T01:02:49,101 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-04-21T01:02:49,104 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-04-21T01:02:49,110 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-04-21T01:02:49,115 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-04-21T01:02:49,120 creating build/lib/deepspeed/comm 2023-04-21T01:02:49,122 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-04-21T01:02:49,128 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-04-21T01:02:49,132 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-04-21T01:02:49,135 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-04-21T01:02:49,138 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-04-21T01:02:49,142 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-04-21T01:02:49,145 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-04-21T01:02:49,149 creating build/lib/deepspeed/ops 2023-04-21T01:02:49,151 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-04-21T01:02:49,155 creating build/lib/deepspeed/accelerator 2023-04-21T01:02:49,157 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-04-21T01:02:49,161 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-04-21T01:02:49,164 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-04-21T01:02:49,168 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-04-21T01:02:49,174 creating build/lib/deepspeed/runtime 2023-04-21T01:02:49,176 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,181 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,185 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,190 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,194 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,199 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,205 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,211 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,222 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,226 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,229 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,233 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,238 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,243 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,261 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,267 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-04-21T01:02:49,272 creating build/lib/deepspeed/model_implementations 2023-04-21T01:02:49,273 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-04-21T01:02:49,279 creating build/lib/deepspeed/elasticity 2023-04-21T01:02:49,280 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-04-21T01:02:49,290 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-04-21T01:02:49,293 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-04-21T01:02:49,297 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-04-21T01:02:49,300 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-04-21T01:02:49,304 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-04-21T01:02:49,310 creating build/lib/deepspeed/utils 2023-04-21T01:02:49,312 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,316 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,321 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,324 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,328 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,335 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,339 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,345 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,349 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,352 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,356 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,360 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,364 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-04-21T01:02:49,370 creating build/lib/deepspeed/nebula 2023-04-21T01:02:49,372 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-04-21T01:02:49,375 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-04-21T01:02:49,378 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-04-21T01:02:49,384 creating build/lib/deepspeed/checkpoint 2023-04-21T01:02:49,385 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-04-21T01:02:49,390 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-04-21T01:02:49,394 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-04-21T01:02:49,398 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-04-21T01:02:49,409 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-04-21T01:02:49,412 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-04-21T01:02:49,415 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-04-21T01:02:49,419 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-04-21T01:02:49,422 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-04-21T01:02:49,430 creating build/lib/deepspeed/inference 2023-04-21T01:02:49,432 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-04-21T01:02:49,436 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-04-21T01:02:49,442 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-04-21T01:02:49,447 creating build/lib/deepspeed/pipe 2023-04-21T01:02:49,449 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-04-21T01:02:49,454 creating build/lib/deepspeed/compression 2023-04-21T01:02:49,455 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-04-21T01:02:49,466 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-04-21T01:02:49,472 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-04-21T01:02:49,475 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-04-21T01:02:49,479 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-04-21T01:02:49,485 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-04-21T01:02:49,489 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-04-21T01:02:49,493 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-04-21T01:02:49,499 creating build/lib/deepspeed/autotuning 2023-04-21T01:02:49,500 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-04-21T01:02:49,504 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-04-21T01:02:49,509 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-04-21T01:02:49,512 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-04-21T01:02:49,519 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-04-21T01:02:49,523 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-04-21T01:02:49,529 creating build/lib/deepspeed/profiling 2023-04-21T01:02:49,530 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-04-21T01:02:49,534 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-04-21T01:02:49,537 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-04-21T01:02:49,543 creating build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,545 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,549 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,553 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,557 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,562 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,565 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,569 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,572 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,575 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,579 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,582 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,585 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,589 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,593 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,597 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,600 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-04-21T01:02:49,605 creating build/lib/deepspeed/module_inject/containers/features 2023-04-21T01:02:49,607 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-04-21T01:02:49,611 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-04-21T01:02:49,614 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-04-21T01:02:49,619 creating build/lib/deepspeed/ops/transformer 2023-04-21T01:02:49,621 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-04-21T01:02:49,626 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-04-21T01:02:49,630 creating build/lib/deepspeed/ops/quantizer 2023-04-21T01:02:49,632 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-04-21T01:02:49,636 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-04-21T01:02:49,640 creating build/lib/deepspeed/ops/aio 2023-04-21T01:02:49,642 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-04-21T01:02:49,646 creating build/lib/deepspeed/ops/adagrad 2023-04-21T01:02:49,648 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-04-21T01:02:49,652 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-04-21T01:02:49,657 creating build/lib/deepspeed/ops/adam 2023-04-21T01:02:49,659 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-04-21T01:02:49,663 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-04-21T01:02:49,666 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-04-21T01:02:49,670 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-04-21T01:02:49,675 creating build/lib/deepspeed/ops/lamb 2023-04-21T01:02:49,677 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-04-21T01:02:49,680 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-04-21T01:02:49,686 creating build/lib/deepspeed/ops/random_ltd 2023-04-21T01:02:49,688 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-04-21T01:02:49,692 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-04-21T01:02:49,697 creating build/lib/deepspeed/ops/sparse_attention 2023-04-21T01:02:49,699 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-21T01:02:49,704 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-21T01:02:49,710 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-21T01:02:49,716 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-21T01:02:49,720 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-21T01:02:49,724 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-21T01:02:49,728 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-21T01:02:49,735 creating build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,737 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,741 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,744 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,748 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,751 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,755 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,758 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,762 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,765 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,769 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,774 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,778 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,782 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,786 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,789 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,793 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-04-21T01:02:49,798 creating build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,800 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,806 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,810 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,814 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,819 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,823 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,826 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,830 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,834 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,838 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-21T01:02:49,844 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,846 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,851 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,854 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,858 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,861 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,881 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,885 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,889 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,892 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,896 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:49,901 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-04-21T01:02:49,902 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-04-21T01:02:49,908 creating build/lib/deepspeed/runtime/data_pipeline 2023-04-21T01:02:49,909 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-04-21T01:02:49,914 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-04-21T01:02:49,917 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-04-21T01:02:49,922 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-04-21T01:02:49,928 creating build/lib/deepspeed/runtime/fp16 2023-04-21T01:02:49,930 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-04-21T01:02:49,935 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-04-21T01:02:49,939 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-04-21T01:02:49,944 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-04-21T01:02:49,950 creating build/lib/deepspeed/runtime/comm 2023-04-21T01:02:49,952 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-04-21T01:02:49,960 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-04-21T01:02:49,965 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-04-21T01:02:49,969 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-04-21T01:02:49,975 creating build/lib/deepspeed/runtime/swap_tensor 2023-04-21T01:02:49,976 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-21T01:02:49,981 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-21T01:02:49,985 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-21T01:02:49,989 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-21T01:02:49,994 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-21T01:02:49,999 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-21T01:02:50,002 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-21T01:02:50,006 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-21T01:02:50,010 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-21T01:02:50,016 creating build/lib/deepspeed/runtime/pipe 2023-04-21T01:02:50,018 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-04-21T01:02:50,024 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-04-21T01:02:50,028 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-04-21T01:02:50,033 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-04-21T01:02:50,039 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-04-21T01:02:50,048 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-04-21T01:02:50,053 creating build/lib/deepspeed/runtime/compression 2023-04-21T01:02:50,054 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-04-21T01:02:50,058 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-04-21T01:02:50,063 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-04-21T01:02:50,065 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-04-21T01:02:50,072 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-04-21T01:02:50,075 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-04-21T01:02:50,081 creating build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,083 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,093 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,096 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,100 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,114 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,118 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,126 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,131 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,138 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,142 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,146 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,150 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,153 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-04-21T01:02:50,165 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-04-21T01:02:50,167 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-04-21T01:02:50,171 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-04-21T01:02:50,175 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-04-21T01:02:50,179 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-04-21T01:02:50,194 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:50,196 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:50,202 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:50,207 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:50,211 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:50,221 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:50,226 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:50,228 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:50,232 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:50,235 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:50,238 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:50,244 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:50,250 creating build/lib/deepspeed/runtime/fp16/onebit 2023-04-21T01:02:50,252 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-04-21T01:02:50,257 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-04-21T01:02:50,262 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-04-21T01:02:50,267 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-04-21T01:02:50,274 creating build/lib/deepspeed/model_implementations/transformers 2023-04-21T01:02:50,276 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-21T01:02:50,280 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-21T01:02:50,303 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-21T01:02:50,312 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-21T01:02:50,315 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-21T01:02:50,319 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-21T01:02:50,322 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-21T01:02:50,326 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-21T01:02:50,333 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-21T01:02:50,338 creating build/lib/deepspeed/model_implementations/features 2023-04-21T01:02:50,340 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-04-21T01:02:50,343 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-04-21T01:02:50,348 creating build/lib/deepspeed/model_implementations/diffusers 2023-04-21T01:02:50,350 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-04-21T01:02:50,354 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-04-21T01:02:50,358 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-04-21T01:02:50,363 creating build/lib/deepspeed/autotuning/tuner 2023-04-21T01:02:50,365 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-04-21T01:02:50,369 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-04-21T01:02:50,373 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-04-21T01:02:50,376 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-04-21T01:02:50,379 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-04-21T01:02:50,383 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-04-21T01:02:50,391 creating build/lib/deepspeed/profiling/flops_profiler 2023-04-21T01:02:50,392 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-04-21T01:02:50,396 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-04-21T01:02:50,403 running egg_info 2023-04-21T01:02:50,535 writing deepspeed.egg-info/PKG-INFO 2023-04-21T01:02:50,541 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-04-21T01:02:50,546 writing entry points to deepspeed.egg-info/entry_points.txt 2023-04-21T01:02:50,550 writing requirements to deepspeed.egg-info/requires.txt 2023-04-21T01:02:50,552 writing top-level names to deepspeed.egg-info/top_level.txt 2023-04-21T01:02:50,730 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-04-21T01:02:50,857 reading manifest template 'MANIFEST.in' 2023-04-21T01:02:52,386 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-04-21T01:02:53,552 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-04-21T01:02:54,240 warning: no files found matching '*.tr' under directory 'csrc' 2023-04-21T01:02:54,414 warning: no files found matching '*.cc' under directory 'csrc' 2023-04-21T01:02:54,438 warning: no files found matching '*.py' under directory 'benchmarks' 2023-04-21T01:02:54,446 adding license file 'LICENSE' 2023-04-21T01:02:54,516 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-04-21T01:02:54,532 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.autotuning.config_templates' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,532 !! 2023-04-21T01:02:54,533 ############################ 2023-04-21T01:02:54,534 # Package would be ignored # 2023-04-21T01:02:54,534 ############################ 2023-04-21T01:02:54,534 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, 2023-04-21T01:02:54,534 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,535 'deepspeed.autotuning.config_templates' has been automatically added to the distribution only 2023-04-21T01:02:54,536 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,536 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,536 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2023-04-21T01:02:54,537 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,537 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,537 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,538 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,538 documentation page. 2023-04-21T01:02:54,539 !! 2023-04-21T01:02:54,540 check.warn(importable) 2023-04-21T01:02:54,540 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adagrad' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,541 !! 2023-04-21T01:02:54,541 ############################ 2023-04-21T01:02:54,542 # Package would be ignored # 2023-04-21T01:02:54,542 ############################ 2023-04-21T01:02:54,542 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, 2023-04-21T01:02:54,543 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,543 'deepspeed.ops.csrc.adagrad' has been automatically added to the distribution only 2023-04-21T01:02:54,543 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,544 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,544 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2023-04-21T01:02:54,545 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,545 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,545 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,546 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,546 documentation page. 2023-04-21T01:02:54,547 !! 2023-04-21T01:02:54,548 check.warn(importable) 2023-04-21T01:02:54,548 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adam' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,548 !! 2023-04-21T01:02:54,549 ############################ 2023-04-21T01:02:54,549 # Package would be ignored # 2023-04-21T01:02:54,550 ############################ 2023-04-21T01:02:54,550 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, 2023-04-21T01:02:54,550 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,551 'deepspeed.ops.csrc.adam' has been automatically added to the distribution only 2023-04-21T01:02:54,551 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,551 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,552 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2023-04-21T01:02:54,552 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,552 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,553 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,553 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,554 documentation page. 2023-04-21T01:02:54,554 !! 2023-04-21T01:02:54,555 check.warn(importable) 2023-04-21T01:02:54,556 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.common' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,556 !! 2023-04-21T01:02:54,557 ############################ 2023-04-21T01:02:54,557 # Package would be ignored # 2023-04-21T01:02:54,557 ############################ 2023-04-21T01:02:54,558 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, 2023-04-21T01:02:54,558 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,559 'deepspeed.ops.csrc.aio.common' has been automatically added to the distribution only 2023-04-21T01:02:54,559 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,559 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,560 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2023-04-21T01:02:54,560 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,560 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,561 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,561 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,561 documentation page. 2023-04-21T01:02:54,562 !! 2023-04-21T01:02:54,563 check.warn(importable) 2023-04-21T01:02:54,563 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_lib' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,564 !! 2023-04-21T01:02:54,564 ############################ 2023-04-21T01:02:54,565 # Package would be ignored # 2023-04-21T01:02:54,565 ############################ 2023-04-21T01:02:54,565 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, 2023-04-21T01:02:54,565 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,566 'deepspeed.ops.csrc.aio.py_lib' has been automatically added to the distribution only 2023-04-21T01:02:54,566 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,567 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,567 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2023-04-21T01:02:54,568 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,568 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,568 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,569 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,569 documentation page. 2023-04-21T01:02:54,570 !! 2023-04-21T01:02:54,570 check.warn(importable) 2023-04-21T01:02:54,571 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_test' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,571 !! 2023-04-21T01:02:54,572 ############################ 2023-04-21T01:02:54,572 # Package would be ignored # 2023-04-21T01:02:54,572 ############################ 2023-04-21T01:02:54,573 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, 2023-04-21T01:02:54,573 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,573 'deepspeed.ops.csrc.aio.py_test' has been automatically added to the distribution only 2023-04-21T01:02:54,574 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,574 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,575 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2023-04-21T01:02:54,575 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,575 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,575 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,576 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,576 documentation page. 2023-04-21T01:02:54,577 !! 2023-04-21T01:02:54,578 check.warn(importable) 2023-04-21T01:02:54,578 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.common' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,578 !! 2023-04-21T01:02:54,579 ############################ 2023-04-21T01:02:54,580 # Package would be ignored # 2023-04-21T01:02:54,580 ############################ 2023-04-21T01:02:54,580 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, 2023-04-21T01:02:54,580 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,581 'deepspeed.ops.csrc.common' has been automatically added to the distribution only 2023-04-21T01:02:54,581 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,582 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,582 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2023-04-21T01:02:54,582 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,583 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,583 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,584 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,584 documentation page. 2023-04-21T01:02:54,585 !! 2023-04-21T01:02:54,586 check.warn(importable) 2023-04-21T01:02:54,586 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.includes' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,586 !! 2023-04-21T01:02:54,587 ############################ 2023-04-21T01:02:54,587 # Package would be ignored # 2023-04-21T01:02:54,588 ############################ 2023-04-21T01:02:54,588 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, 2023-04-21T01:02:54,588 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,589 'deepspeed.ops.csrc.includes' has been automatically added to the distribution only 2023-04-21T01:02:54,589 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,589 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,590 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2023-04-21T01:02:54,590 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,590 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,591 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,591 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,592 documentation page. 2023-04-21T01:02:54,592 !! 2023-04-21T01:02:54,593 check.warn(importable) 2023-04-21T01:02:54,593 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.lamb' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,594 !! 2023-04-21T01:02:54,594 ############################ 2023-04-21T01:02:54,595 # Package would be ignored # 2023-04-21T01:02:54,595 ############################ 2023-04-21T01:02:54,595 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, 2023-04-21T01:02:54,596 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,596 'deepspeed.ops.csrc.lamb' has been automatically added to the distribution only 2023-04-21T01:02:54,596 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,597 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,598 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2023-04-21T01:02:54,598 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,598 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,599 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,600 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,600 documentation page. 2023-04-21T01:02:54,601 !! 2023-04-21T01:02:54,602 check.warn(importable) 2023-04-21T01:02:54,603 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.quantization' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,604 !! 2023-04-21T01:02:54,605 ############################ 2023-04-21T01:02:54,606 # Package would be ignored # 2023-04-21T01:02:54,606 ############################ 2023-04-21T01:02:54,606 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, 2023-04-21T01:02:54,607 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,608 'deepspeed.ops.csrc.quantization' has been automatically added to the distribution only 2023-04-21T01:02:54,608 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,609 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,609 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2023-04-21T01:02:54,610 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,610 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,611 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,612 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,613 documentation page. 2023-04-21T01:02:54,614 !! 2023-04-21T01:02:54,615 check.warn(importable) 2023-04-21T01:02:54,615 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.random_ltd' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,616 !! 2023-04-21T01:02:54,617 ############################ 2023-04-21T01:02:54,617 # Package would be ignored # 2023-04-21T01:02:54,618 ############################ 2023-04-21T01:02:54,618 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package, 2023-04-21T01:02:54,619 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,620 'deepspeed.ops.csrc.random_ltd' has been automatically added to the distribution only 2023-04-21T01:02:54,621 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,621 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,622 Please make sure that 'deepspeed.ops.csrc.random_ltd' is included as a package by using 2023-04-21T01:02:54,622 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,623 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,623 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,624 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,625 documentation page. 2023-04-21T01:02:54,626 !! 2023-04-21T01:02:54,627 check.warn(importable) 2023-04-21T01:02:54,628 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.sparse_attention' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,628 !! 2023-04-21T01:02:54,629 ############################ 2023-04-21T01:02:54,630 # Package would be ignored # 2023-04-21T01:02:54,630 ############################ 2023-04-21T01:02:54,631 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, 2023-04-21T01:02:54,631 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,632 'deepspeed.ops.csrc.sparse_attention' has been automatically added to the distribution only 2023-04-21T01:02:54,632 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,633 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,634 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2023-04-21T01:02:54,635 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,635 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,636 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,637 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,637 documentation page. 2023-04-21T01:02:54,639 !! 2023-04-21T01:02:54,640 check.warn(importable) 2023-04-21T01:02:54,640 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.csrc' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,640 !! 2023-04-21T01:02:54,642 ############################ 2023-04-21T01:02:54,642 # Package would be ignored # 2023-04-21T01:02:54,642 ############################ 2023-04-21T01:02:54,643 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package, 2023-04-21T01:02:54,643 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,644 'deepspeed.ops.csrc.spatial.csrc' has been automatically added to the distribution only 2023-04-21T01:02:54,645 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,645 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,646 Please make sure that 'deepspeed.ops.csrc.spatial.csrc' is included as a package by using 2023-04-21T01:02:54,646 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,647 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,647 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,648 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,648 documentation page. 2023-04-21T01:02:54,649 !! 2023-04-21T01:02:54,650 check.warn(importable) 2023-04-21T01:02:54,650 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.includes' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,650 !! 2023-04-21T01:02:54,651 ############################ 2023-04-21T01:02:54,652 # Package would be ignored # 2023-04-21T01:02:54,652 ############################ 2023-04-21T01:02:54,652 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package, 2023-04-21T01:02:54,653 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,653 'deepspeed.ops.csrc.spatial.includes' has been automatically added to the distribution only 2023-04-21T01:02:54,653 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,654 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,654 Please make sure that 'deepspeed.ops.csrc.spatial.includes' is included as a package by using 2023-04-21T01:02:54,655 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,655 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,655 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,656 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,656 documentation page. 2023-04-21T01:02:54,657 !! 2023-04-21T01:02:54,658 check.warn(importable) 2023-04-21T01:02:54,658 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,659 !! 2023-04-21T01:02:54,660 ############################ 2023-04-21T01:02:54,660 # Package would be ignored # 2023-04-21T01:02:54,660 ############################ 2023-04-21T01:02:54,660 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, 2023-04-21T01:02:54,661 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,661 'deepspeed.ops.csrc.transformer' has been automatically added to the distribution only 2023-04-21T01:02:54,662 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,662 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,663 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2023-04-21T01:02:54,663 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,663 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,664 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,664 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,665 documentation page. 2023-04-21T01:02:54,665 !! 2023-04-21T01:02:54,666 check.warn(importable) 2023-04-21T01:02:54,666 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.csrc' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,667 !! 2023-04-21T01:02:54,668 ############################ 2023-04-21T01:02:54,668 # Package would be ignored # 2023-04-21T01:02:54,668 ############################ 2023-04-21T01:02:54,669 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, 2023-04-21T01:02:54,669 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,670 'deepspeed.ops.csrc.transformer.inference.csrc' has been automatically added to the distribution only 2023-04-21T01:02:54,670 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,670 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,671 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2023-04-21T01:02:54,671 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,672 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,672 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,673 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,673 documentation page. 2023-04-21T01:02:54,674 !! 2023-04-21T01:02:54,674 check.warn(importable) 2023-04-21T01:02:54,675 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.includes' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,675 !! 2023-04-21T01:02:54,676 ############################ 2023-04-21T01:02:54,676 # Package would be ignored # 2023-04-21T01:02:54,677 ############################ 2023-04-21T01:02:54,677 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, 2023-04-21T01:02:54,677 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,678 'deepspeed.ops.csrc.transformer.inference.includes' has been automatically added to the distribution only 2023-04-21T01:02:54,678 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,679 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,679 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2023-04-21T01:02:54,680 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,680 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,680 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,681 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,681 documentation page. 2023-04-21T01:02:54,682 !! 2023-04-21T01:02:54,683 check.warn(importable) 2023-04-21T01:02:54,683 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.utils' as data is deprecated, please list it in `packages`. 2023-04-21T01:02:54,683 !! 2023-04-21T01:02:54,684 ############################ 2023-04-21T01:02:54,685 # Package would be ignored # 2023-04-21T01:02:54,685 ############################ 2023-04-21T01:02:54,685 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, 2023-04-21T01:02:54,686 but it is not listed in the `packages` configuration of setuptools. 2023-04-21T01:02:54,687 'deepspeed.ops.csrc.utils' has been automatically added to the distribution only 2023-04-21T01:02:54,687 because it may contain data files, but this behavior is likely to change 2023-04-21T01:02:54,687 in future versions of setuptools (and therefore is considered deprecated). 2023-04-21T01:02:54,688 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2023-04-21T01:02:54,688 the `packages` configuration field or the proper discovery methods 2023-04-21T01:02:54,688 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-21T01:02:54,689 instead of `find_packages(...)`/`find:`). 2023-04-21T01:02:54,689 You can read more about "package discovery" and "data files" on setuptools 2023-04-21T01:02:54,690 documentation page. 2023-04-21T01:02:54,691 !! 2023-04-21T01:02:54,691 check.warn(importable) 2023-04-21T01:02:54,692 creating build/lib/deepspeed/ops/csrc 2023-04-21T01:02:54,692 creating build/lib/deepspeed/ops/csrc/adagrad 2023-04-21T01:02:54,692 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-04-21T01:02:54,693 creating build/lib/deepspeed/ops/csrc/adam 2023-04-21T01:02:54,693 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-04-21T01:02:54,693 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-04-21T01:02:54,694 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-04-21T01:02:54,694 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-04-21T01:02:54,694 creating build/lib/deepspeed/ops/csrc/aio 2023-04-21T01:02:54,694 creating build/lib/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:54,695 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:54,695 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:54,695 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:54,696 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:54,696 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:54,696 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:54,697 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,697 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,697 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,698 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,698 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,698 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,699 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,699 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,699 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,700 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,702 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,706 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:54,711 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-04-21T01:02:54,712 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-04-21T01:02:54,716 creating build/lib/deepspeed/ops/csrc/common 2023-04-21T01:02:54,718 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-04-21T01:02:54,722 creating build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,724 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,728 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,732 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,736 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,740 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,745 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,749 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,754 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,757 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,762 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,767 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,771 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,774 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,779 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,783 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,787 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,802 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,806 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,814 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,818 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,822 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,828 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,832 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,837 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,842 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,846 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,851 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-21T01:02:54,855 creating build/lib/deepspeed/ops/csrc/lamb 2023-04-21T01:02:54,857 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-04-21T01:02:54,861 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-04-21T01:02:54,866 creating build/lib/deepspeed/ops/csrc/quantization 2023-04-21T01:02:54,868 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-04-21T01:02:54,872 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-04-21T01:02:54,878 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-04-21T01:02:54,883 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-04-21T01:02:54,887 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-04-21T01:02:54,889 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-04-21T01:02:54,894 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-04-21T01:02:54,899 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-04-21T01:02:54,903 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-04-21T01:02:54,908 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-04-21T01:02:54,910 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-04-21T01:02:54,914 creating build/lib/deepspeed/ops/csrc/spatial 2023-04-21T01:02:54,915 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-04-21T01:02:54,917 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-04-21T01:02:54,922 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-04-21T01:02:54,926 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-04-21T01:02:54,929 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-04-21T01:02:54,933 creating build/lib/deepspeed/ops/csrc/transformer 2023-04-21T01:02:54,934 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-21T01:02:54,940 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-21T01:02:54,946 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-04-21T01:02:54,953 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-21T01:02:54,958 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-21T01:02:54,964 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-21T01:02:54,972 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-21T01:02:54,978 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-21T01:02:54,983 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-04-21T01:02:54,984 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:54,986 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:54,992 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:54,996 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:55,003 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:55,008 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:55,016 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:55,020 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:55,026 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:55,032 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-04-21T01:02:55,034 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-04-21T01:02:55,039 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-04-21T01:02:55,044 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-04-21T01:02:55,049 creating build/lib/deepspeed/ops/csrc/utils 2023-04-21T01:02:55,051 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-04-21T01:02:55,055 creating build/lib/deepspeed/autotuning/config_templates 2023-04-21T01:02:55,056 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-04-21T01:02:55,061 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-04-21T01:02:55,064 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-04-21T01:02:55,068 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-04-21T01:02:55,072 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-04-21T01:02:55,077 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-04-21T01:02:55,081 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-04-21T01:02:55,156 running build_scripts 2023-04-21T01:02:55,158 creating build/scripts-3.7 2023-04-21T01:02:55,159 copying and adjusting bin/deepspeed -> build/scripts-3.7 2023-04-21T01:02:55,163 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2023-04-21T01:02:55,165 copying and adjusting bin/ds -> build/scripts-3.7 2023-04-21T01:02:55,169 copying bin/ds_ssh -> build/scripts-3.7 2023-04-21T01:02:55,172 copying and adjusting bin/ds_report -> build/scripts-3.7 2023-04-21T01:02:55,175 copying and adjusting bin/ds_bench -> build/scripts-3.7 2023-04-21T01:02:55,178 copying and adjusting bin/dsr -> build/scripts-3.7 2023-04-21T01:02:55,180 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2023-04-21T01:02:55,183 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2023-04-21T01:02:55,183 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2023-04-21T01:02:55,184 changing mode of build/scripts-3.7/ds from 644 to 755 2023-04-21T01:02:55,185 changing mode of build/scripts-3.7/ds_report from 644 to 755 2023-04-21T01:02:55,185 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2023-04-21T01:02:55,186 changing mode of build/scripts-3.7/dsr from 644 to 755 2023-04-21T01:02:55,187 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2023-04-21T01:02:55,296 /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2023-04-21T01:02:55,297 setuptools.SetuptoolsDeprecationWarning, 2023-04-21T01:02:55,369 installing to build/bdist.linux-armv7l/wheel 2023-04-21T01:02:55,369 running install 2023-04-21T01:02:55,431 running install_lib 2023-04-21T01:02:55,527 creating build/bdist.linux-armv7l 2023-04-21T01:02:55,528 creating build/bdist.linux-armv7l/wheel 2023-04-21T01:02:55,531 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-04-21T01:02:55,539 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-21T01:02:55,543 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-21T01:02:55,549 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-21T01:02:55,558 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-21T01:02:55,561 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-21T01:02:55,566 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-21T01:02:55,569 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-21T01:02:55,575 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-21T01:02:55,577 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-21T01:02:55,592 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-21T01:02:55,595 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-21T01:02:55,599 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-21T01:02:55,603 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-21T01:02:55,606 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-21T01:02:55,609 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-21T01:02:55,614 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-21T01:02:55,615 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-21T01:02:55,620 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-21T01:02:55,634 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-21T01:02:55,637 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-21T01:02:55,642 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-21T01:02:55,647 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,649 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,653 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,658 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,660 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,664 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,668 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,672 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,676 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,680 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,683 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,687 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,691 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,694 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,699 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-04-21T01:02:55,700 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-04-21T01:02:55,704 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-04-21T01:02:55,711 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-04-21T01:02:55,718 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,727 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,753 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,762 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,765 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,769 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-21T01:02:55,772 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,776 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,780 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,783 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,786 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,790 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,811 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,815 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-21T01:02:55,821 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-21T01:02:55,822 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-21T01:02:55,827 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-21T01:02:55,832 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-21T01:02:55,835 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-21T01:02:55,844 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-21T01:02:55,848 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-21T01:02:55,852 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-21T01:02:55,856 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-04-21T01:02:55,859 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-04-21T01:02:55,861 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-04-21T01:02:55,867 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-04-21T01:02:55,871 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:55,873 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:55,879 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:55,904 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:55,915 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:55,919 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:55,924 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,926 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,930 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,933 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,936 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,940 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,943 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,947 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,950 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,954 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,957 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-21T01:02:55,981 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:55,984 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:55,987 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:55,992 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:55,995 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-21T01:02:56,001 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-04-21T01:02:56,002 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-04-21T01:02:56,006 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-04-21T01:02:56,025 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-04-21T01:02:56,028 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-04-21T01:02:56,032 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-04-21T01:02:56,035 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-21T01:02:56,037 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-21T01:02:56,043 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-21T01:02:56,048 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-21T01:02:56,053 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-21T01:02:56,058 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-21T01:02:56,065 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-04-21T01:02:56,078 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:56,080 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:56,085 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:56,094 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:56,099 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:56,103 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:56,107 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:56,116 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:56,122 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-21T01:02:56,128 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-04-21T01:02:56,150 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-04-21T01:02:56,154 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-04-21T01:02:56,159 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-04-21T01:02:56,164 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-21T01:02:56,170 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-21T01:02:56,179 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-21T01:02:56,186 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-04-21T01:02:56,189 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-04-21T01:02:56,191 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-04-21T01:02:56,207 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:56,208 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:56,212 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:56,217 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:56,221 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:56,224 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:56,228 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-21T01:02:56,232 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,241 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,248 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,251 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,254 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,258 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,262 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,265 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,269 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,273 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,276 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,287 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-21T01:02:56,299 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-04-21T01:02:56,301 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-04-21T01:02:56,306 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-04-21T01:02:56,307 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-04-21T01:02:56,313 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-04-21T01:02:56,315 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-04-21T01:02:56,319 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-04-21T01:02:56,323 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-04-21T01:02:56,327 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-04-21T01:02:56,332 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-04-21T01:02:56,333 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-04-21T01:02:56,337 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-04-21T01:02:56,354 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-04-21T01:02:56,356 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-04-21T01:02:56,360 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-04-21T01:02:56,370 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-04-21T01:02:56,383 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-04-21T01:02:56,388 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-04-21T01:02:56,392 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-04-21T01:02:56,397 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-04-21T01:02:56,399 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-04-21T01:02:56,403 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-04-21T01:02:56,409 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-04-21T01:02:56,413 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-04-21T01:02:56,418 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-04-21T01:02:56,420 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-04-21T01:02:56,425 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-04-21T01:02:56,428 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-04-21T01:02:56,430 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-04-21T01:02:56,433 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-04-21T01:02:56,454 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-04-21T01:02:56,460 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-04-21T01:02:56,470 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,472 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,486 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,490 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,495 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,500 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,504 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,508 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,512 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,516 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,520 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,528 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,532 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,536 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,540 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,543 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,548 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,573 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,580 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,584 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,588 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,593 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,599 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,606 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,610 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,613 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,617 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,624 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-21T01:02:56,631 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-04-21T01:02:56,632 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-04-21T01:02:56,637 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-04-21T01:02:56,641 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-04-21T01:02:56,643 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-04-21T01:02:56,647 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-04-21T01:02:56,651 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-04-21T01:02:56,654 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-04-21T01:02:56,658 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-04-21T01:02:56,663 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-04-21T01:02:56,664 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-04-21T01:02:56,668 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-04-21T01:02:56,673 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-04-21T01:02:56,675 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-04-21T01:02:56,679 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-04-21T01:02:56,684 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-21T01:02:56,685 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-21T01:02:56,691 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-21T01:02:56,697 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-21T01:02:56,703 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-21T01:02:56,708 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-21T01:02:56,712 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-21T01:02:56,716 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-21T01:02:56,723 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-04-21T01:02:56,738 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-04-21T01:02:56,742 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-04-21T01:02:56,746 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-04-21T01:02:56,751 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-04-21T01:02:56,757 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,759 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,763 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,767 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,775 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,780 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,784 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,788 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,792 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,799 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,803 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,809 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,813 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,816 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,819 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,823 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,826 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-21T01:02:56,831 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-04-21T01:02:56,832 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-04-21T01:02:56,837 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-04-21T01:02:56,840 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-04-21T01:02:56,844 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-04-21T01:02:56,849 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-04-21T01:02:56,855 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:56,857 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:56,861 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:56,865 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:56,871 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-04-21T01:02:56,874 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:56,876 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:56,881 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:56,887 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:56,891 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:56,896 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-21T01:02:56,900 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:56,902 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:56,905 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:56,909 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:56,921 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:56,925 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-21T01:02:56,929 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-04-21T01:02:56,934 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-04-21T01:02:56,938 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-04-21T01:02:56,943 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-04-21T01:02:56,973 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-04-21T01:02:56,974 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-04-21T01:02:56,980 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-04-21T01:02:56,982 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-04-21T01:02:56,987 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-04-21T01:02:56,992 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-04-21T01:02:56,997 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-04-21T01:02:57,014 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-04-21T01:02:57,017 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-04-21T01:02:57,022 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-04-21T01:02:57,027 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-04-21T01:02:57,029 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-04-21T01:02:57,033 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-04-21T01:02:57,038 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-04-21T01:02:57,042 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-04-21T01:02:57,046 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,050 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,055 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,061 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,069 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,081 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-21T01:02:57,083 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-21T01:02:57,087 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-21T01:02:57,091 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-21T01:02:57,095 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-21T01:02:57,100 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-21T01:02:57,104 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-21T01:02:57,107 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-21T01:02:57,112 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-21T01:02:57,115 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-21T01:02:57,120 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,123 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,127 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,138 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-21T01:02:57,139 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-21T01:02:57,145 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-21T01:02:57,149 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-21T01:02:57,154 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-21T01:02:57,159 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-21T01:02:57,166 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-21T01:02:57,171 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-04-21T01:02:57,172 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-04-21T01:02:57,176 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-04-21T01:02:57,180 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,185 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,190 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-04-21T01:02:57,192 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-04-21T01:02:57,198 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-04-21T01:02:57,202 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-04-21T01:02:57,205 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,210 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,217 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,219 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,229 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,232 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,236 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,242 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,246 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,255 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,260 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,265 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,269 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,273 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,277 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,280 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-21T01:02:57,291 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-04-21T01:02:57,293 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-04-21T01:02:57,296 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-04-21T01:02:57,300 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-04-21T01:02:57,304 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-04-21T01:02:57,307 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-21T01:02:57,341 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-04-21T01:02:57,344 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-21T01:02:57,346 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-21T01:02:57,349 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-21T01:02:57,353 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-21T01:02:57,356 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-21T01:02:57,360 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-21T01:02:57,363 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-21T01:02:57,366 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-21T01:02:57,370 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-21T01:02:57,373 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-21T01:02:57,378 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-04-21T01:02:57,380 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-04-21T01:02:57,383 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-04-21T01:02:57,387 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-04-21T01:02:57,391 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-04-21T01:02:57,393 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-04-21T01:02:57,397 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-04-21T01:02:57,401 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-04-21T01:02:57,405 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-21T01:02:57,407 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-21T01:02:57,412 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-21T01:02:57,416 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-21T01:02:57,419 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-21T01:02:57,423 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-21T01:02:57,427 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-21T01:02:57,431 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-04-21T01:02:57,436 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,437 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,442 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,447 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,450 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,454 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,457 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,461 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,467 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,470 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,474 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,478 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,483 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,487 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-21T01:02:57,491 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-04-21T01:02:57,497 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-04-21T01:02:57,499 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-04-21T01:02:57,502 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-04-21T01:02:57,506 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-04-21T01:02:57,509 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-04-21T01:02:57,514 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-21T01:02:57,516 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-21T01:02:57,521 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-21T01:02:57,525 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-21T01:02:57,529 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-21T01:02:57,533 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-21T01:02:57,537 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-21T01:02:57,540 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-21T01:02:57,544 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-21T01:02:57,548 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-21T01:02:57,552 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-04-21T01:02:57,554 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-04-21T01:02:57,558 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-04-21T01:02:57,564 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-04-21T01:02:57,568 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-04-21T01:02:57,570 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-04-21T01:02:57,574 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-21T01:02:57,576 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-21T01:02:57,581 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-21T01:02:57,586 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-21T01:02:57,590 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-21T01:02:57,594 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-21T01:02:57,599 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-21T01:02:57,604 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-21T01:02:57,608 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-21T01:02:57,613 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-21T01:02:57,615 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-04-21T01:02:57,617 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-04-21T01:02:57,621 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-04-21T01:02:57,625 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-04-21T01:02:57,628 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-04-21T01:02:57,634 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-21T01:02:57,638 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-21T01:02:57,643 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-21T01:02:57,645 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-21T01:02:57,649 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-21T01:02:57,653 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-21T01:02:57,656 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-21T01:02:57,660 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-21T01:02:57,665 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-21T01:02:57,668 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-21T01:02:57,672 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-21T01:02:57,678 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-21T01:02:57,683 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-21T01:02:57,687 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-04-21T01:02:57,692 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-04-21T01:02:57,695 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-04-21T01:02:57,697 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-04-21T01:02:57,701 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-04-21T01:02:57,707 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-04-21T01:02:57,711 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-04-21T01:02:57,714 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-04-21T01:02:57,717 running install_egg_info 2023-04-21T01:02:57,797 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.9.1-py3.7.egg-info 2023-04-21T01:02:57,822 running install_scripts 2023-04-21T01:02:57,824 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data 2023-04-21T01:02:57,825 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts 2023-04-21T01:02:57,827 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts 2023-04-21T01:02:57,831 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts 2023-04-21T01:02:57,834 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts 2023-04-21T01:02:57,837 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts 2023-04-21T01:02:57,841 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts 2023-04-21T01:02:57,844 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts 2023-04-21T01:02:57,847 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts 2023-04-21T01:02:57,851 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts 2023-04-21T01:02:57,854 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts/deepspeed.pt to 755 2023-04-21T01:02:57,854 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts/deepspeed to 755 2023-04-21T01:02:57,855 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts/ds_bench to 755 2023-04-21T01:02:57,856 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts/ds to 755 2023-04-21T01:02:57,857 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts/ds_elastic to 755 2023-04-21T01:02:57,857 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts/ds_report to 755 2023-04-21T01:02:57,858 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts/dsr to 755 2023-04-21T01:02:57,859 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.data/scripts/ds_ssh to 755 2023-04-21T01:02:57,983 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.1.dist-info/WHEEL 2023-04-21T01:02:57,994 creating '/tmp/pip-wheel-90t94cah/deepspeed-0.9.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-04-21T01:02:58,001 adding 'deepspeed/__init__.py' 2023-04-21T01:02:58,004 adding 'deepspeed/constants.py' 2023-04-21T01:02:58,007 adding 'deepspeed/env_report.py' 2023-04-21T01:02:58,010 adding 'deepspeed/git_version_info.py' 2023-04-21T01:02:58,012 adding 'deepspeed/git_version_info_installed.py' 2023-04-21T01:02:58,016 adding 'deepspeed/accelerator/__init__.py' 2023-04-21T01:02:58,018 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-04-21T01:02:58,022 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-04-21T01:02:58,025 adding 'deepspeed/accelerator/real_accelerator.py' 2023-04-21T01:02:58,029 adding 'deepspeed/autotuning/__init__.py' 2023-04-21T01:02:58,043 adding 'deepspeed/autotuning/autotuner.py' 2023-04-21T01:02:58,053 adding 'deepspeed/autotuning/config.py' 2023-04-21T01:02:58,056 adding 'deepspeed/autotuning/constants.py' 2023-04-21T01:02:58,067 adding 'deepspeed/autotuning/scheduler.py' 2023-04-21T01:02:58,079 adding 'deepspeed/autotuning/utils.py' 2023-04-21T01:02:58,087 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-04-21T01:02:58,089 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-04-21T01:02:58,092 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-04-21T01:02:58,094 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-04-21T01:02:58,100 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-04-21T01:02:58,102 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-04-21T01:02:58,105 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-04-21T01:02:58,108 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-04-21T01:02:58,111 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-04-21T01:02:58,114 adding 'deepspeed/autotuning/tuner/utils.py' 2023-04-21T01:02:58,117 adding 'deepspeed/checkpoint/__init__.py' 2023-04-21T01:02:58,128 adding 'deepspeed/checkpoint/constants.py' 2023-04-21T01:02:58,134 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-04-21T01:02:58,144 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-04-21T01:02:58,148 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-04-21T01:02:58,173 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-04-21T01:02:58,176 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-04-21T01:02:58,179 adding 'deepspeed/checkpoint/utils.py' 2023-04-21T01:02:58,182 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-04-21T01:02:58,185 adding 'deepspeed/comm/__init__.py' 2023-04-21T01:02:58,188 adding 'deepspeed/comm/backend.py' 2023-04-21T01:02:58,195 adding 'deepspeed/comm/comm.py' 2023-04-21T01:02:58,198 adding 'deepspeed/comm/config.py' 2023-04-21T01:02:58,200 adding 'deepspeed/comm/constants.py' 2023-04-21T01:02:58,216 adding 'deepspeed/comm/torch.py' 2023-04-21T01:02:58,220 adding 'deepspeed/comm/utils.py' 2023-04-21T01:02:58,223 adding 'deepspeed/compression/__init__.py' 2023-04-21T01:02:58,231 adding 'deepspeed/compression/basic_layer.py' 2023-04-21T01:02:58,235 adding 'deepspeed/compression/compress.py' 2023-04-21T01:02:58,251 adding 'deepspeed/compression/config.py' 2023-04-21T01:02:58,255 adding 'deepspeed/compression/constants.py' 2023-04-21T01:02:58,259 adding 'deepspeed/compression/helper.py' 2023-04-21T01:02:58,262 adding 'deepspeed/compression/scheduler.py' 2023-04-21T01:02:58,265 adding 'deepspeed/compression/utils.py' 2023-04-21T01:02:58,269 adding 'deepspeed/elasticity/__init__.py' 2023-04-21T01:02:58,272 adding 'deepspeed/elasticity/config.py' 2023-04-21T01:02:58,275 adding 'deepspeed/elasticity/constants.py' 2023-04-21T01:02:58,278 adding 'deepspeed/elasticity/elastic_agent.py' 2023-04-21T01:02:58,306 adding 'deepspeed/elasticity/elasticity.py' 2023-04-21T01:02:58,309 adding 'deepspeed/elasticity/utils.py' 2023-04-21T01:02:58,312 adding 'deepspeed/inference/__init__.py' 2023-04-21T01:02:58,316 adding 'deepspeed/inference/config.py' 2023-04-21T01:02:58,324 adding 'deepspeed/inference/engine.py' 2023-04-21T01:02:58,329 adding 'deepspeed/launcher/__init__.py' 2023-04-21T01:02:58,331 adding 'deepspeed/launcher/constants.py' 2023-04-21T01:02:58,337 adding 'deepspeed/launcher/launch.py' 2023-04-21T01:02:58,341 adding 'deepspeed/launcher/multinode_runner.py' 2023-04-21T01:02:58,348 adding 'deepspeed/launcher/runner.py' 2023-04-21T01:02:58,352 adding 'deepspeed/model_implementations/__init__.py' 2023-04-21T01:02:58,355 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-04-21T01:02:58,358 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-04-21T01:02:58,361 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-04-21T01:02:58,364 adding 'deepspeed/model_implementations/features/__init__.py' 2023-04-21T01:02:58,366 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-04-21T01:02:58,370 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-04-21T01:02:58,373 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-04-21T01:02:58,375 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-04-21T01:02:58,378 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-04-21T01:02:58,380 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-04-21T01:02:58,382 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-04-21T01:02:58,385 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-04-21T01:02:58,387 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-04-21T01:02:58,391 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-04-21T01:02:58,395 adding 'deepspeed/module_inject/__init__.py' 2023-04-21T01:02:58,398 adding 'deepspeed/module_inject/auto_tp.py' 2023-04-21T01:02:58,401 adding 'deepspeed/module_inject/inject.py' 2023-04-21T01:02:58,404 adding 'deepspeed/module_inject/layers.py' 2023-04-21T01:02:58,408 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-04-21T01:02:58,411 adding 'deepspeed/module_inject/module_quantize.py' 2023-04-21T01:02:58,414 adding 'deepspeed/module_inject/policy.py' 2023-04-21T01:02:58,424 adding 'deepspeed/module_inject/replace_module.py' 2023-04-21T01:02:58,427 adding 'deepspeed/module_inject/replace_policy.py' 2023-04-21T01:02:58,430 adding 'deepspeed/module_inject/utils.py' 2023-04-21T01:02:58,434 adding 'deepspeed/module_inject/containers/__init__.py' 2023-04-21T01:02:58,439 adding 'deepspeed/module_inject/containers/base.py' 2023-04-21T01:02:58,443 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-04-21T01:02:58,446 adding 'deepspeed/module_inject/containers/bert.py' 2023-04-21T01:02:58,449 adding 'deepspeed/module_inject/containers/bloom.py' 2023-04-21T01:02:58,451 adding 'deepspeed/module_inject/containers/clip.py' 2023-04-21T01:02:58,454 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-04-21T01:02:58,457 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-04-21T01:02:58,460 adding 'deepspeed/module_inject/containers/gptj.py' 2023-04-21T01:02:58,463 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-04-21T01:02:58,466 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-04-21T01:02:58,469 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-04-21T01:02:58,472 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-04-21T01:02:58,475 adding 'deepspeed/module_inject/containers/opt.py' 2023-04-21T01:02:58,478 adding 'deepspeed/module_inject/containers/unet.py' 2023-04-21T01:02:58,480 adding 'deepspeed/module_inject/containers/vae.py' 2023-04-21T01:02:58,483 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-04-21T01:02:58,486 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-04-21T01:02:58,489 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-04-21T01:02:58,493 adding 'deepspeed/moe/__init__.py' 2023-04-21T01:02:58,495 adding 'deepspeed/moe/experts.py' 2023-04-21T01:02:58,498 adding 'deepspeed/moe/layer.py' 2023-04-21T01:02:58,501 adding 'deepspeed/moe/mappings.py' 2023-04-21T01:02:58,508 adding 'deepspeed/moe/sharded_moe.py' 2023-04-21T01:02:58,511 adding 'deepspeed/moe/utils.py' 2023-04-21T01:02:58,515 adding 'deepspeed/monitor/__init__.py' 2023-04-21T01:02:58,518 adding 'deepspeed/monitor/config.py' 2023-04-21T01:02:58,731 adding 'deepspeed/monitor/csv_monitor.py' 2023-04-21T01:02:58,734 adding 'deepspeed/monitor/monitor.py' 2023-04-21T01:02:58,736 adding 'deepspeed/monitor/tensorboard.py' 2023-04-21T01:02:58,739 adding 'deepspeed/monitor/utils.py' 2023-04-21T01:02:58,742 adding 'deepspeed/monitor/wandb.py' 2023-04-21T01:02:58,745 adding 'deepspeed/nebula/__init__.py' 2023-04-21T01:02:58,747 adding 'deepspeed/nebula/config.py' 2023-04-21T01:02:58,758 adding 'deepspeed/nebula/constants.py' 2023-04-21T01:02:58,762 adding 'deepspeed/ops/__init__.py' 2023-04-21T01:02:58,765 adding 'deepspeed/ops/adagrad/__init__.py' 2023-04-21T01:02:58,768 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-04-21T01:02:58,772 adding 'deepspeed/ops/adam/__init__.py' 2023-04-21T01:02:58,781 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-04-21T01:02:58,784 adding 'deepspeed/ops/adam/fused_adam.py' 2023-04-21T01:02:58,787 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-04-21T01:02:58,790 adding 'deepspeed/ops/aio/__init__.py' 2023-04-21T01:02:58,796 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-04-21T01:02:58,801 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-04-21T01:02:58,804 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-04-21T01:02:58,807 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-04-21T01:02:58,810 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-04-21T01:02:58,817 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-04-21T01:02:58,820 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-04-21T01:02:58,823 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-04-21T01:02:58,825 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-04-21T01:02:58,828 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-04-21T01:02:58,831 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-04-21T01:02:58,835 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-04-21T01:02:58,838 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-04-21T01:02:58,841 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-04-21T01:02:58,843 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-04-21T01:02:58,846 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-04-21T01:02:58,849 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-04-21T01:02:58,852 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-04-21T01:02:58,855 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-04-21T01:02:58,858 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-04-21T01:02:58,861 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-04-21T01:02:58,863 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-04-21T01:02:58,867 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-04-21T01:02:58,870 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-04-21T01:02:58,877 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-04-21T01:02:58,880 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-04-21T01:02:58,882 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-04-21T01:02:58,885 adding 'deepspeed/ops/csrc/includes/context.h' 2023-04-21T01:02:58,891 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-04-21T01:02:58,897 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-04-21T01:02:58,900 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-04-21T01:02:58,903 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-04-21T01:02:58,907 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-04-21T01:02:58,912 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-04-21T01:02:58,915 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-04-21T01:02:58,917 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-04-21T01:02:58,921 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-04-21T01:02:58,923 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-04-21T01:02:58,926 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-04-21T01:02:58,929 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-04-21T01:02:58,948 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-04-21T01:02:58,954 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-04-21T01:02:58,986 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-04-21T01:02:59,057 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-04-21T01:02:59,062 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-04-21T01:02:59,066 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-04-21T01:02:59,071 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-04-21T01:02:59,075 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-04-21T01:02:59,085 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-04-21T01:02:59,088 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-04-21T01:02:59,092 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-04-21T01:02:59,095 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-04-21T01:02:59,100 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-04-21T01:02:59,104 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-04-21T01:02:59,111 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-04-21T01:02:59,115 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-04-21T01:02:59,120 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-04-21T01:02:59,124 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-04-21T01:02:59,128 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-04-21T01:02:59,131 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-04-21T01:02:59,136 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-04-21T01:02:59,151 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-04-21T01:02:59,156 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-04-21T01:02:59,159 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-04-21T01:02:59,163 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-04-21T01:02:59,168 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-04-21T01:02:59,174 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-04-21T01:02:59,183 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-04-21T01:02:59,206 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-04-21T01:02:59,219 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-04-21T01:02:59,230 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-04-21T01:02:59,270 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-04-21T01:02:59,276 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-04-21T01:02:59,283 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-04-21T01:02:59,286 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-04-21T01:02:59,293 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-04-21T01:02:59,299 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-04-21T01:02:59,322 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-04-21T01:02:59,340 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-04-21T01:02:59,345 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-04-21T01:02:59,355 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-04-21T01:02:59,361 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-04-21T01:02:59,365 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-04-21T01:02:59,368 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-04-21T01:02:59,372 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-04-21T01:02:59,377 adding 'deepspeed/ops/lamb/__init__.py' 2023-04-21T01:02:59,383 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-04-21T01:02:59,388 adding 'deepspeed/ops/op_builder/__init__.py' 2023-04-21T01:02:59,390 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-04-21T01:02:59,395 adding 'deepspeed/ops/op_builder/async_io.py' 2023-04-21T01:02:59,413 adding 'deepspeed/ops/op_builder/builder.py' 2023-04-21T01:02:59,425 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-04-21T01:02:59,427 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-04-21T01:02:59,430 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-04-21T01:02:59,432 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-04-21T01:02:59,435 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-04-21T01:02:59,438 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-04-21T01:02:59,440 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-04-21T01:02:59,443 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-04-21T01:02:59,445 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-04-21T01:02:59,448 adding 'deepspeed/ops/op_builder/transformer.py' 2023-04-21T01:02:59,451 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-04-21T01:02:59,453 adding 'deepspeed/ops/op_builder/utils.py' 2023-04-21T01:02:59,457 adding 'deepspeed/ops/quantizer/__init__.py' 2023-04-21T01:02:59,459 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-04-21T01:02:59,462 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-04-21T01:02:59,465 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-04-21T01:02:59,469 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-04-21T01:02:59,472 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-04-21T01:02:59,482 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-04-21T01:02:59,487 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-04-21T01:02:59,492 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-04-21T01:02:59,495 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-04-21T01:02:59,503 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-04-21T01:02:59,508 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-04-21T01:02:59,511 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-04-21T01:02:59,514 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-04-21T01:02:59,517 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-04-21T01:02:59,520 adding 'deepspeed/ops/transformer/__init__.py' 2023-04-21T01:02:59,526 adding 'deepspeed/ops/transformer/transformer.py' 2023-04-21T01:02:59,530 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-04-21T01:02:59,532 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-04-21T01:02:59,535 adding 'deepspeed/ops/transformer/inference/config.py' 2023-04-21T01:02:59,538 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-04-21T01:02:59,542 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-04-21T01:02:59,545 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-04-21T01:02:59,550 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-04-21T01:02:59,553 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-04-21T01:02:59,565 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-04-21T01:02:59,569 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-04-21T01:02:59,573 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-04-21T01:02:59,575 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-04-21T01:02:59,578 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-04-21T01:02:59,581 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-04-21T01:02:59,583 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-04-21T01:02:59,586 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-04-21T01:02:59,588 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-04-21T01:02:59,600 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-04-21T01:02:59,603 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-04-21T01:02:59,605 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-04-21T01:02:59,608 adding 'deepspeed/pipe/__init__.py' 2023-04-21T01:02:59,612 adding 'deepspeed/profiling/__init__.py' 2023-04-21T01:02:59,614 adding 'deepspeed/profiling/config.py' 2023-04-21T01:02:59,617 adding 'deepspeed/profiling/constants.py' 2023-04-21T01:02:59,620 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-04-21T01:02:59,632 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-04-21T01:02:59,637 adding 'deepspeed/runtime/__init__.py' 2023-04-21T01:02:59,643 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-04-21T01:02:59,653 adding 'deepspeed/runtime/config.py' 2023-04-21T01:02:59,657 adding 'deepspeed/runtime/config_utils.py' 2023-04-21T01:02:59,662 adding 'deepspeed/runtime/constants.py' 2023-04-21T01:02:59,665 adding 'deepspeed/runtime/dataloader.py' 2023-04-21T01:02:59,668 adding 'deepspeed/runtime/eigenvalue.py' 2023-04-21T01:02:59,709 adding 'deepspeed/runtime/engine.py' 2023-04-21T01:02:59,730 adding 'deepspeed/runtime/hybrid_engine.py' 2023-04-21T01:02:59,739 adding 'deepspeed/runtime/lr_schedules.py' 2023-04-21T01:02:59,742 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-04-21T01:02:59,745 adding 'deepspeed/runtime/quantize.py' 2023-04-21T01:02:59,748 adding 'deepspeed/runtime/sparse_tensor.py' 2023-04-21T01:02:59,753 adding 'deepspeed/runtime/state_dict_factory.py' 2023-04-21T01:02:59,763 adding 'deepspeed/runtime/utils.py' 2023-04-21T01:02:59,768 adding 'deepspeed/runtime/weight_quantizer.py' 2023-04-21T01:02:59,771 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-04-21T01:02:59,780 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-04-21T01:02:59,784 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-04-21T01:02:59,787 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-04-21T01:02:59,793 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-04-21T01:02:59,796 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-04-21T01:02:59,798 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-04-21T01:02:59,804 adding 'deepspeed/runtime/comm/__init__.py' 2023-04-21T01:02:59,807 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-04-21T01:02:59,811 adding 'deepspeed/runtime/comm/mpi.py' 2023-04-21T01:02:59,814 adding 'deepspeed/runtime/comm/nccl.py' 2023-04-21T01:02:59,818 adding 'deepspeed/runtime/compression/__init__.py' 2023-04-21T01:02:59,823 adding 'deepspeed/runtime/compression/cupy.py' 2023-04-21T01:02:59,826 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-04-21T01:02:59,829 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-04-21T01:02:59,833 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-04-21T01:02:59,836 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-04-21T01:02:59,840 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-04-21T01:02:59,843 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-04-21T01:02:59,846 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-04-21T01:02:59,849 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-04-21T01:02:59,851 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-04-21T01:02:59,855 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-04-21T01:02:59,861 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-04-21T01:02:59,866 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-04-21T01:02:59,882 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-04-21T01:02:59,885 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-04-21T01:02:59,889 adding 'deepspeed/runtime/fp16/__init__.py' 2023-04-21T01:02:59,894 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-04-21T01:02:59,899 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-04-21T01:02:59,905 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-04-21T01:02:59,909 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-04-21T01:02:59,914 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-04-21T01:02:59,920 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-04-21T01:02:59,926 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-04-21T01:02:59,931 adding 'deepspeed/runtime/pipe/__init__.py' 2023-04-21T01:02:59,946 adding 'deepspeed/runtime/pipe/engine.py' 2023-04-21T01:02:59,955 adding 'deepspeed/runtime/pipe/module.py' 2023-04-21T01:02:59,959 adding 'deepspeed/runtime/pipe/p2p.py' 2023-04-21T01:02:59,964 adding 'deepspeed/runtime/pipe/schedule.py' 2023-04-21T01:02:59,970 adding 'deepspeed/runtime/pipe/topology.py' 2023-04-21T01:02:59,974 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-04-21T01:02:59,976 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-04-21T01:02:59,980 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-04-21T01:02:59,982 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-04-21T01:02:59,988 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-04-21T01:02:59,992 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-04-21T01:02:59,998 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-04-21T01:03:00,002 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-04-21T01:03:00,035 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-04-21T01:03:00,040 adding 'deepspeed/runtime/zero/__init__.py' 2023-04-21T01:03:00,044 adding 'deepspeed/runtime/zero/config.py' 2023-04-21T01:03:00,048 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-04-21T01:03:00,052 adding 'deepspeed/runtime/zero/linear.py' 2023-04-21T01:03:00,056 adding 'deepspeed/runtime/zero/offload_config.py' 2023-04-21T01:03:00,062 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-04-21T01:03:00,082 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-04-21T01:03:00,091 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-04-21T01:03:00,122 adding 'deepspeed/runtime/zero/stage3.py' 2023-04-21T01:03:00,155 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-04-21T01:03:00,160 adding 'deepspeed/runtime/zero/test.py' 2023-04-21T01:03:00,164 adding 'deepspeed/runtime/zero/tiling.py' 2023-04-21T01:03:00,168 adding 'deepspeed/runtime/zero/utils.py' 2023-04-21T01:03:00,172 adding 'deepspeed/utils/__init__.py' 2023-04-21T01:03:00,175 adding 'deepspeed/utils/comms_logging.py' 2023-04-21T01:03:00,178 adding 'deepspeed/utils/debug.py' 2023-04-21T01:03:00,181 adding 'deepspeed/utils/exceptions.py' 2023-04-21T01:03:00,186 adding 'deepspeed/utils/groups.py' 2023-04-21T01:03:00,189 adding 'deepspeed/utils/init_on_device.py' 2023-04-21T01:03:00,192 adding 'deepspeed/utils/logging.py' 2023-04-21T01:03:00,195 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-04-21T01:03:00,198 adding 'deepspeed/utils/nvtx.py' 2023-04-21T01:03:00,201 adding 'deepspeed/utils/tensor_fragment.py' 2023-04-21T01:03:00,205 adding 'deepspeed/utils/timer.py' 2023-04-21T01:03:00,208 adding 'deepspeed/utils/types.py' 2023-04-21T01:03:00,214 adding 'deepspeed/utils/zero_to_fp32.py' 2023-04-21T01:03:00,220 adding 'deepspeed-0.9.1.data/scripts/deepspeed' 2023-04-21T01:03:00,222 adding 'deepspeed-0.9.1.data/scripts/deepspeed.pt' 2023-04-21T01:03:00,224 adding 'deepspeed-0.9.1.data/scripts/ds' 2023-04-21T01:03:00,227 adding 'deepspeed-0.9.1.data/scripts/ds_bench' 2023-04-21T01:03:00,229 adding 'deepspeed-0.9.1.data/scripts/ds_elastic' 2023-04-21T01:03:00,232 adding 'deepspeed-0.9.1.data/scripts/ds_report' 2023-04-21T01:03:00,234 adding 'deepspeed-0.9.1.data/scripts/ds_ssh' 2023-04-21T01:03:00,236 adding 'deepspeed-0.9.1.data/scripts/dsr' 2023-04-21T01:03:00,244 adding 'deepspeed-0.9.1.dist-info/LICENSE' 2023-04-21T01:03:00,252 adding 'deepspeed-0.9.1.dist-info/METADATA' 2023-04-21T01:03:00,255 adding 'deepspeed-0.9.1.dist-info/WHEEL' 2023-04-21T01:03:00,257 adding 'deepspeed-0.9.1.dist-info/entry_points.txt' 2023-04-21T01:03:00,259 adding 'deepspeed-0.9.1.dist-info/top_level.txt' 2023-04-21T01:03:00,274 adding 'deepspeed-0.9.1.dist-info/RECORD' 2023-04-21T01:03:00,308 removing build/bdist.linux-armv7l/wheel 2023-04-21T01:03:00,602 deepspeed build time = 13.709510087966919 secs 2023-04-21T01:03:00,782 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-04-21T01:03:00,813 Created wheel for deepspeed: filename=deepspeed-0.9.1-py3-none-any.whl size=798527 sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 2023-04-21T01:03:00,815 Stored in directory: /tmp/pip-ephem-wheel-cache-upuqf6g5/wheels/b1/be/95/b2a980803f04bf660d2bf5e3f6b10210ce6ab1df38f584e7d2 2023-04-21T01:03:00,880 Successfully built deepspeed 2023-04-21T01:03:00,972 Removed build tracker: '/tmp/pip-build-tracker-i6ic_5c0'