2022-12-01T20:36:50,634 Created temporary directory: /tmp/pip-ephem-wheel-cache-htzwtpqm 2022-12-01T20:36:50,638 Created temporary directory: /tmp/pip-build-tracker-zcr1208s 2022-12-01T20:36:50,639 Initialized build tracking at /tmp/pip-build-tracker-zcr1208s 2022-12-01T20:36:50,640 Created build tracker: /tmp/pip-build-tracker-zcr1208s 2022-12-01T20:36:50,640 Entered build tracker: /tmp/pip-build-tracker-zcr1208s 2022-12-01T20:36:50,641 Created temporary directory: /tmp/pip-wheel-3_svlaz4 2022-12-01T20:36:50,649 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2022-12-01T20:36:50,654 Created temporary directory: /tmp/pip-ephem-wheel-cache-3z2zptii 2022-12-01T20:36:50,705 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2022-12-01T20:36:50,712 2 location(s) to search for versions of deepspeed: 2022-12-01T20:36:50,712 * https://pypi.org/simple/deepspeed/ 2022-12-01T20:36:50,712 * https://www.piwheels.org/simple/deepspeed/ 2022-12-01T20:36:50,713 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2022-12-01T20:36:50,714 Getting page https://pypi.org/simple/deepspeed/ 2022-12-01T20:36:50,717 Found index url https://pypi.org/simple 2022-12-01T20:36:50,905 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2022-12-01T20:36:50,936 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-12-01T20:36:50,937 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2022-12-01T20:36:50,937 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-12-01T20:36:50,938 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2022-12-01T20:36:50,939 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-12-01T20:36:50,939 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2022-12-01T20:36:50,940 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-12-01T20:36:50,941 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2022-12-01T20:36:50,941 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-12-01T20:36:50,942 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2022-12-01T20:36:50,943 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2022-12-01T20:36:50,943 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2022-12-01T20:36:50,944 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2022-12-01T20:36:50,945 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2022-12-01T20:36:50,945 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2022-12-01T20:36:50,946 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2022-12-01T20:36:50,947 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2022-12-01T20:36:50,947 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2022-12-01T20:36:50,948 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2022-12-01T20:36:50,949 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2022-12-01T20:36:50,950 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2022-12-01T20:36:50,950 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2022-12-01T20:36:50,951 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2022-12-01T20:36:50,952 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2022-12-01T20:36:50,953 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2022-12-01T20:36:50,953 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2022-12-01T20:36:50,954 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2022-12-01T20:36:50,955 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2022-12-01T20:36:50,955 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2022-12-01T20:36:50,956 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2022-12-01T20:36:50,957 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2022-12-01T20:36:50,957 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2022-12-01T20:36:50,958 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2022-12-01T20:36:50,959 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2022-12-01T20:36:50,959 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2022-12-01T20:36:50,960 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2022-12-01T20:36:50,961 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2022-12-01T20:36:50,962 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2022-12-01T20:36:50,962 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2022-12-01T20:36:50,963 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2022-12-01T20:36:50,964 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2022-12-01T20:36:50,964 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2022-12-01T20:36:50,965 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2022-12-01T20:36:50,966 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2022-12-01T20:36:50,966 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2022-12-01T20:36:50,967 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2022-12-01T20:36:50,968 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2022-12-01T20:36:50,969 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2022-12-01T20:36:50,969 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2022-12-01T20:36:50,970 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2022-12-01T20:36:50,971 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2022-12-01T20:36:50,971 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2022-12-01T20:36:50,972 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2022-12-01T20:36:50,973 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2022-12-01T20:36:50,973 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2022-12-01T20:36:50,974 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2022-12-01T20:36:50,975 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2022-12-01T20:36:50,975 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2022-12-01T20:36:50,976 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2022-12-01T20:36:50,977 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2022-12-01T20:36:50,977 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2022-12-01T20:36:50,978 Getting page https://www.piwheels.org/simple/deepspeed/ 2022-12-01T20:36:50,981 Found index url https://www.piwheels.org/simple 2022-12-01T20:36:51,195 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2022-12-01T20:36:51,217 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,218 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,219 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,219 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,220 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,220 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,221 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,221 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,222 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,222 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,223 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,224 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,224 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,225 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,225 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,226 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,226 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,227 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,227 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,228 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,228 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,229 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,229 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,230 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,230 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,231 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,232 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,232 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,233 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,233 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2022-12-01T20:36:51,234 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2022-12-01T20:36:51,234 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2022-12-01T20:36:51,286 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2022-12-01T20:36:51,317 Collecting deepspeed==0.7.6 2022-12-01T20:36:51,322 Created temporary directory: /tmp/pip-unpack-cilsq7bt 2022-12-01T20:36:51,869 Downloading deepspeed-0.7.6.tar.gz (709 kB) 2022-12-01T20:36:54,307 Added deepspeed==0.7.6 from https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz to build tracker '/tmp/pip-build-tracker-zcr1208s' 2022-12-01T20:36:54,310 Running setup.py (path:/tmp/pip-wheel-3_svlaz4/deepspeed_cb625877c68a4063843542bd5a16313e/setup.py) egg_info for package deepspeed 2022-12-01T20:36:54,311 Created temporary directory: /tmp/pip-pip-egg-info-k50xny0w 2022-12-01T20:36:54,312 Preparing metadata (setup.py): started 2022-12-01T20:36:54,314 Running command python setup.py egg_info 2022-12-01T20:36:57,324 fatal: not a git repository (or any of the parent directories): .git 2022-12-01T20:36:58,600 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2022-12-01T20:36:58,601  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2022-12-01T20:36:58,601 DS_BUILD_OPS=0 2022-12-01T20:36:58,602  [WARNING]  unable to import torch, please install it first 2022-12-01T20:36:58,602  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2022-12-01T20:36:58,602  [WARNING]  async_io: please install the libaio-dev package with apt 2022-12-01T20:36:58,603  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2022-12-01T20:36:58,603  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-12-01T20:36:58,603  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-12-01T20:36:58,604 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'utils': False, 'quantizer': False, 'transformer_inference': False, 'spatial_inference': False} 2022-12-01T20:36:58,604 version=0.7.6, git_hash=unknown, git_branch=unknown 2022-12-01T20:36:58,604 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2022-12-01T20:36:58,605 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'utils': True, 'quantizer': True, 'transformer_inference': False, 'spatial_inference': False} 2022-12-01T20:36:58,605 ext_modules=[] 2022-12-01T20:36:58,605 running egg_info 2022-12-01T20:36:58,606 creating /tmp/pip-pip-egg-info-k50xny0w/deepspeed.egg-info 2022-12-01T20:36:58,696 writing /tmp/pip-pip-egg-info-k50xny0w/deepspeed.egg-info/PKG-INFO 2022-12-01T20:36:58,703 writing dependency_links to /tmp/pip-pip-egg-info-k50xny0w/deepspeed.egg-info/dependency_links.txt 2022-12-01T20:36:58,707 writing entry points to /tmp/pip-pip-egg-info-k50xny0w/deepspeed.egg-info/entry_points.txt 2022-12-01T20:36:58,712 writing requirements to /tmp/pip-pip-egg-info-k50xny0w/deepspeed.egg-info/requires.txt 2022-12-01T20:36:58,715 writing top-level names to /tmp/pip-pip-egg-info-k50xny0w/deepspeed.egg-info/top_level.txt 2022-12-01T20:36:58,718 writing manifest file '/tmp/pip-pip-egg-info-k50xny0w/deepspeed.egg-info/SOURCES.txt' 2022-12-01T20:36:59,173 reading manifest file '/tmp/pip-pip-egg-info-k50xny0w/deepspeed.egg-info/SOURCES.txt' 2022-12-01T20:36:59,176 reading manifest template 'MANIFEST.in' 2022-12-01T20:37:00,303 warning: no files found matching '*.hip' under directory 'deepspeed' 2022-12-01T20:37:01,127 warning: no files found matching '*.cc' under directory 'deepspeed' 2022-12-01T20:37:01,689 warning: no files found matching '*.tr' under directory 'csrc' 2022-12-01T20:37:01,824 warning: no files found matching '*.cc' under directory 'csrc' 2022-12-01T20:37:01,861 adding license file 'LICENSE' 2022-12-01T20:37:01,907 writing manifest file '/tmp/pip-pip-egg-info-k50xny0w/deepspeed.egg-info/SOURCES.txt' 2022-12-01T20:37:01,911 deepspeed build time = 4.576318740844727 secs 2022-12-01T20:37:02,128 Preparing metadata (setup.py): finished with status 'done' 2022-12-01T20:37:02,147 Source in /tmp/pip-wheel-3_svlaz4/deepspeed_cb625877c68a4063843542bd5a16313e has version 0.7.6, which satisfies requirement deepspeed==0.7.6 from https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz 2022-12-01T20:37:02,149 Removed deepspeed==0.7.6 from https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz from build tracker '/tmp/pip-build-tracker-zcr1208s' 2022-12-01T20:37:02,165 Created temporary directory: /tmp/pip-unpack-2j5tzx4_ 2022-12-01T20:37:02,167 Building wheels for collected packages: deepspeed 2022-12-01T20:37:02,176 Created temporary directory: /tmp/pip-wheel-7cpl60vn 2022-12-01T20:37:02,176 Building wheel for deepspeed (setup.py): started 2022-12-01T20:37:02,178 Destination directory: /tmp/pip-wheel-7cpl60vn 2022-12-01T20:37:02,179 Running command python setup.py bdist_wheel 2022-12-01T20:37:04,439 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2022-12-01T20:37:04,461  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2022-12-01T20:37:04,505 DS_BUILD_OPS=0 2022-12-01T20:37:04,507  [WARNING]  unable to import torch, please install it first 2022-12-01T20:37:04,805  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2022-12-01T20:37:04,970  [WARNING]  async_io: please install the libaio-dev package with apt 2022-12-01T20:37:04,970  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2022-12-01T20:37:04,973  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-12-01T20:37:04,975  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-12-01T20:37:04,975 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'utils': False, 'quantizer': False, 'transformer_inference': False, 'spatial_inference': False} 2022-12-01T20:37:05,016 fatal: not a git repository (or any of the parent directories): .git 2022-12-01T20:37:05,021 version=0.7.6, git_hash=unknown, git_branch=unknown 2022-12-01T20:37:05,023 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2022-12-01T20:37:05,024 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'utils': True, 'quantizer': True, 'transformer_inference': False, 'spatial_inference': False} 2022-12-01T20:37:05,024 ext_modules=[] 2022-12-01T20:37:06,305 running bdist_wheel 2022-12-01T20:37:07,170 running build 2022-12-01T20:37:07,171 running build_py 2022-12-01T20:37:07,270 creating build 2022-12-01T20:37:07,271 creating build/lib 2022-12-01T20:37:07,272 creating build/lib/benchmarks 2022-12-01T20:37:07,274 copying benchmarks/__init__.py -> build/lib/benchmarks 2022-12-01T20:37:07,279 creating build/lib/deepspeed 2022-12-01T20:37:07,280 copying deepspeed/constants.py -> build/lib/deepspeed 2022-12-01T20:37:07,284 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2022-12-01T20:37:07,287 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2022-12-01T20:37:07,290 copying deepspeed/__init__.py -> build/lib/deepspeed 2022-12-01T20:37:07,294 copying deepspeed/env_report.py -> build/lib/deepspeed 2022-12-01T20:37:07,300 creating build/lib/benchmarks/communication 2022-12-01T20:37:07,301 copying benchmarks/communication/all_gather.py -> build/lib/benchmarks/communication 2022-12-01T20:37:07,305 copying benchmarks/communication/constants.py -> build/lib/benchmarks/communication 2022-12-01T20:37:07,309 copying benchmarks/communication/all_to_all.py -> build/lib/benchmarks/communication 2022-12-01T20:37:07,312 copying benchmarks/communication/utils.py -> build/lib/benchmarks/communication 2022-12-01T20:37:07,316 copying benchmarks/communication/broadcast.py -> build/lib/benchmarks/communication 2022-12-01T20:37:07,319 copying benchmarks/communication/__init__.py -> build/lib/benchmarks/communication 2022-12-01T20:37:07,322 copying benchmarks/communication/pt2pt.py -> build/lib/benchmarks/communication 2022-12-01T20:37:07,325 copying benchmarks/communication/all_reduce.py -> build/lib/benchmarks/communication 2022-12-01T20:37:07,329 copying benchmarks/communication/run_all.py -> build/lib/benchmarks/communication 2022-12-01T20:37:07,334 creating build/lib/deepspeed/moe 2022-12-01T20:37:07,335 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2022-12-01T20:37:07,340 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2022-12-01T20:37:07,344 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2022-12-01T20:37:07,347 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2022-12-01T20:37:07,350 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2022-12-01T20:37:07,355 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2022-12-01T20:37:07,360 creating build/lib/deepspeed/elasticity 2022-12-01T20:37:07,361 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2022-12-01T20:37:07,365 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2022-12-01T20:37:07,369 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2022-12-01T20:37:07,373 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2022-12-01T20:37:07,376 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2022-12-01T20:37:07,379 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2022-12-01T20:37:07,384 creating build/lib/deepspeed/model_implementations 2022-12-01T20:37:07,386 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2022-12-01T20:37:07,391 creating build/lib/deepspeed/accelerator 2022-12-01T20:37:07,392 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2022-12-01T20:37:07,396 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2022-12-01T20:37:07,399 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2022-12-01T20:37:07,403 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2022-12-01T20:37:07,409 creating build/lib/deepspeed/module_inject 2022-12-01T20:37:07,411 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2022-12-01T20:37:07,415 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2022-12-01T20:37:07,418 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2022-12-01T20:37:07,422 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2022-12-01T20:37:07,426 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2022-12-01T20:37:07,432 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2022-12-01T20:37:07,436 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2022-12-01T20:37:07,446 creating build/lib/deepspeed/utils 2022-12-01T20:37:07,448 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,453 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,458 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,462 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,466 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,470 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,476 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,480 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,484 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,488 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,493 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,497 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,501 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2022-12-01T20:37:07,507 creating build/lib/deepspeed/autotuning 2022-12-01T20:37:07,510 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2022-12-01T20:37:07,515 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2022-12-01T20:37:07,519 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2022-12-01T20:37:07,525 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2022-12-01T20:37:07,530 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2022-12-01T20:37:07,537 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2022-12-01T20:37:07,543 creating build/lib/deepspeed/runtime 2022-12-01T20:37:07,545 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,550 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,555 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,562 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,566 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,570 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,575 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,581 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,585 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,593 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,598 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,610 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,615 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,618 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,622 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2022-12-01T20:37:07,628 creating build/lib/deepspeed/compression 2022-12-01T20:37:07,630 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2022-12-01T20:37:07,636 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2022-12-01T20:37:07,643 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2022-12-01T20:37:07,648 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2022-12-01T20:37:07,652 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2022-12-01T20:37:07,656 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2022-12-01T20:37:07,660 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2022-12-01T20:37:07,665 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2022-12-01T20:37:07,670 creating build/lib/deepspeed/pipe 2022-12-01T20:37:07,672 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2022-12-01T20:37:07,677 creating build/lib/deepspeed/inference 2022-12-01T20:37:07,680 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2022-12-01T20:37:07,685 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2022-12-01T20:37:07,691 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2022-12-01T20:37:07,697 creating build/lib/deepspeed/launcher 2022-12-01T20:37:07,698 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2022-12-01T20:37:07,703 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2022-12-01T20:37:07,708 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2022-12-01T20:37:07,711 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2022-12-01T20:37:07,715 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2022-12-01T20:37:07,719 creating build/lib/deepspeed/profiling 2022-12-01T20:37:07,721 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2022-12-01T20:37:07,725 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2022-12-01T20:37:07,728 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2022-12-01T20:37:07,732 creating build/lib/deepspeed/comm 2022-12-01T20:37:07,734 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2022-12-01T20:37:07,739 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2022-12-01T20:37:07,743 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2022-12-01T20:37:07,746 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2022-12-01T20:37:07,750 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2022-12-01T20:37:07,754 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2022-12-01T20:37:07,757 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2022-12-01T20:37:07,763 creating build/lib/deepspeed/monitor 2022-12-01T20:37:07,765 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2022-12-01T20:37:07,769 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2022-12-01T20:37:07,772 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2022-12-01T20:37:07,775 copying deepspeed/monitor/constants.py -> build/lib/deepspeed/monitor 2022-12-01T20:37:07,779 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2022-12-01T20:37:07,782 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2022-12-01T20:37:07,785 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2022-12-01T20:37:07,789 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2022-12-01T20:37:07,793 creating build/lib/deepspeed/checkpoint 2022-12-01T20:37:07,795 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-12-01T20:37:07,800 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2022-12-01T20:37:07,803 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2022-12-01T20:37:07,806 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2022-12-01T20:37:07,810 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-12-01T20:37:07,814 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2022-12-01T20:37:07,818 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2022-12-01T20:37:07,821 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2022-12-01T20:37:07,824 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-12-01T20:37:07,830 creating build/lib/deepspeed/ops 2022-12-01T20:37:07,831 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2022-12-01T20:37:07,836 creating build/lib/deepspeed/nebula 2022-12-01T20:37:07,838 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2022-12-01T20:37:07,841 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2022-12-01T20:37:07,845 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2022-12-01T20:37:07,849 creating build/lib/deepspeed/model_implementations/diffusers 2022-12-01T20:37:07,850 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2022-12-01T20:37:07,854 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2022-12-01T20:37:07,856 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2022-12-01T20:37:07,862 creating build/lib/deepspeed/model_implementations/transformers 2022-12-01T20:37:07,864 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2022-12-01T20:37:07,868 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2022-12-01T20:37:07,872 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2022-12-01T20:37:07,877 creating build/lib/deepspeed/autotuning/tuner 2022-12-01T20:37:07,880 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-12-01T20:37:07,885 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-12-01T20:37:07,889 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-12-01T20:37:07,893 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2022-12-01T20:37:07,897 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2022-12-01T20:37:07,901 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2022-12-01T20:37:07,907 creating build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,910 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,918 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,922 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,926 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,929 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,934 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,938 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,943 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,952 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,955 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,960 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,970 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,973 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2022-12-01T20:37:07,979 creating build/lib/deepspeed/runtime/fp16 2022-12-01T20:37:07,980 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2022-12-01T20:37:07,986 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2022-12-01T20:37:07,991 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2022-12-01T20:37:07,994 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2022-12-01T20:37:07,999 creating build/lib/deepspeed/runtime/activation_checkpointing 2022-12-01T20:37:08,000 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-12-01T20:37:08,004 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-12-01T20:37:08,010 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-12-01T20:37:08,014 creating build/lib/deepspeed/runtime/swap_tensor 2022-12-01T20:37:08,016 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-01T20:37:08,020 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-01T20:37:08,023 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-01T20:37:08,027 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-01T20:37:08,031 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-01T20:37:08,034 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-01T20:37:08,040 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-01T20:37:08,044 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-01T20:37:08,049 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-01T20:37:08,054 creating build/lib/deepspeed/runtime/compression 2022-12-01T20:37:08,055 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2022-12-01T20:37:08,059 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2022-12-01T20:37:08,064 creating build/lib/deepspeed/runtime/pipe 2022-12-01T20:37:08,065 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2022-12-01T20:37:08,070 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2022-12-01T20:37:08,074 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2022-12-01T20:37:08,079 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2022-12-01T20:37:08,087 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2022-12-01T20:37:08,092 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2022-12-01T20:37:08,097 creating build/lib/deepspeed/runtime/checkpoint_engine 2022-12-01T20:37:08,099 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-12-01T20:37:08,103 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-12-01T20:37:08,106 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-12-01T20:37:08,109 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-12-01T20:37:08,114 creating build/lib/deepspeed/runtime/data_pipeline 2022-12-01T20:37:08,115 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2022-12-01T20:37:08,118 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2022-12-01T20:37:08,124 creating build/lib/deepspeed/runtime/comm 2022-12-01T20:37:08,125 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2022-12-01T20:37:08,130 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2022-12-01T20:37:08,135 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2022-12-01T20:37:08,138 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2022-12-01T20:37:08,142 creating build/lib/deepspeed/runtime/fp16/onebit 2022-12-01T20:37:08,144 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-12-01T20:37:08,150 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-12-01T20:37:08,155 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-12-01T20:37:08,159 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-12-01T20:37:08,163 creating build/lib/deepspeed/profiling/flops_profiler 2022-12-01T20:37:08,165 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2022-12-01T20:37:08,169 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2022-12-01T20:37:08,176 creating build/lib/deepspeed/ops/adagrad 2022-12-01T20:37:08,178 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2022-12-01T20:37:08,182 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2022-12-01T20:37:08,187 creating build/lib/deepspeed/ops/adam 2022-12-01T20:37:08,189 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2022-12-01T20:37:08,194 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2022-12-01T20:37:08,197 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2022-12-01T20:37:08,201 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2022-12-01T20:37:08,206 creating build/lib/deepspeed/ops/transformer 2022-12-01T20:37:08,207 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2022-12-01T20:37:08,213 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2022-12-01T20:37:08,218 creating build/lib/deepspeed/ops/sparse_attention 2022-12-01T20:37:08,220 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-01T20:37:08,224 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-01T20:37:08,230 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-01T20:37:08,235 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-01T20:37:08,240 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-01T20:37:08,244 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-01T20:37:08,247 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-01T20:37:08,255 creating build/lib/deepspeed/ops/quantizer 2022-12-01T20:37:08,257 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2022-12-01T20:37:08,261 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2022-12-01T20:37:08,267 creating build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,269 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,272 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,276 copying deepspeed/ops/op_builder/builder_names.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,279 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,283 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,286 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,289 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,293 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,296 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,301 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,304 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,308 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,311 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,314 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,317 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,321 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2022-12-01T20:37:08,325 creating build/lib/deepspeed/ops/aio 2022-12-01T20:37:08,327 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2022-12-01T20:37:08,331 creating build/lib/deepspeed/ops/lamb 2022-12-01T20:37:08,333 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2022-12-01T20:37:08,337 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2022-12-01T20:37:08,343 creating build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,344 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,349 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,353 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,357 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,361 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,366 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,369 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,374 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,378 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,381 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-01T20:37:08,386 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2022-12-01T20:37:08,387 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-12-01T20:37:08,391 running egg_info 2022-12-01T20:37:08,575 writing deepspeed.egg-info/PKG-INFO 2022-12-01T20:37:08,580 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2022-12-01T20:37:08,584 writing entry points to deepspeed.egg-info/entry_points.txt 2022-12-01T20:37:08,588 writing requirements to deepspeed.egg-info/requires.txt 2022-12-01T20:37:08,591 writing top-level names to deepspeed.egg-info/top_level.txt 2022-12-01T20:37:08,760 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2022-12-01T20:37:08,840 reading manifest template 'MANIFEST.in' 2022-12-01T20:37:09,901 warning: no files found matching '*.hip' under directory 'deepspeed' 2022-12-01T20:37:10,703 warning: no files found matching '*.cc' under directory 'deepspeed' 2022-12-01T20:37:11,257 warning: no files found matching '*.tr' under directory 'csrc' 2022-12-01T20:37:11,396 warning: no files found matching '*.cc' under directory 'csrc' 2022-12-01T20:37:11,434 adding license file 'LICENSE' 2022-12-01T20:37:11,496 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2022-12-01T20:37:11,502 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'benchmarks.inference' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,502 !! 2022-12-01T20:37:11,503 ############################ 2022-12-01T20:37:11,503 # Package would be ignored # 2022-12-01T20:37:11,504 ############################ 2022-12-01T20:37:11,504 Python recognizes 'benchmarks.inference' as an importable package, 2022-12-01T20:37:11,504 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,505 'benchmarks.inference' has been automatically added to the distribution only 2022-12-01T20:37:11,505 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,505 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,506 Please make sure that 'benchmarks.inference' is included as a package by using 2022-12-01T20:37:11,506 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,507 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,507 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,507 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,508 documentation page. 2022-12-01T20:37:11,509 !! 2022-12-01T20:37:11,509 check.warn(importable) 2022-12-01T20:37:11,513 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.autotuning.config_templates' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,513 !! 2022-12-01T20:37:11,514 ############################ 2022-12-01T20:37:11,514 # Package would be ignored # 2022-12-01T20:37:11,514 ############################ 2022-12-01T20:37:11,515 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, 2022-12-01T20:37:11,515 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,515 'deepspeed.autotuning.config_templates' has been automatically added to the distribution only 2022-12-01T20:37:11,516 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,516 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,517 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2022-12-01T20:37:11,517 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,517 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,517 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,518 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,518 documentation page. 2022-12-01T20:37:11,519 !! 2022-12-01T20:37:11,520 check.warn(importable) 2022-12-01T20:37:11,520 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adagrad' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,520 !! 2022-12-01T20:37:11,521 ############################ 2022-12-01T20:37:11,522 # Package would be ignored # 2022-12-01T20:37:11,522 ############################ 2022-12-01T20:37:11,522 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, 2022-12-01T20:37:11,522 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,523 'deepspeed.ops.csrc.adagrad' has been automatically added to the distribution only 2022-12-01T20:37:11,523 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,524 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,524 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2022-12-01T20:37:11,525 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,525 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,525 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,526 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,526 documentation page. 2022-12-01T20:37:11,527 !! 2022-12-01T20:37:11,527 check.warn(importable) 2022-12-01T20:37:11,528 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adam' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,528 !! 2022-12-01T20:37:11,529 ############################ 2022-12-01T20:37:11,529 # Package would be ignored # 2022-12-01T20:37:11,529 ############################ 2022-12-01T20:37:11,530 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, 2022-12-01T20:37:11,530 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,531 'deepspeed.ops.csrc.adam' has been automatically added to the distribution only 2022-12-01T20:37:11,531 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,531 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,532 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2022-12-01T20:37:11,532 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,532 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,533 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,533 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,533 documentation page. 2022-12-01T20:37:11,534 !! 2022-12-01T20:37:11,535 check.warn(importable) 2022-12-01T20:37:11,535 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.common' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,535 !! 2022-12-01T20:37:11,536 ############################ 2022-12-01T20:37:11,537 # Package would be ignored # 2022-12-01T20:37:11,537 ############################ 2022-12-01T20:37:11,537 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, 2022-12-01T20:37:11,537 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,538 'deepspeed.ops.csrc.aio.common' has been automatically added to the distribution only 2022-12-01T20:37:11,539 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,539 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,539 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2022-12-01T20:37:11,540 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,540 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,540 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,541 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,541 documentation page. 2022-12-01T20:37:11,542 !! 2022-12-01T20:37:11,543 check.warn(importable) 2022-12-01T20:37:11,543 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_lib' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,543 !! 2022-12-01T20:37:11,544 ############################ 2022-12-01T20:37:11,544 # Package would be ignored # 2022-12-01T20:37:11,545 ############################ 2022-12-01T20:37:11,545 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, 2022-12-01T20:37:11,545 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,546 'deepspeed.ops.csrc.aio.py_lib' has been automatically added to the distribution only 2022-12-01T20:37:11,546 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,546 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,547 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2022-12-01T20:37:11,547 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,548 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,548 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,548 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,549 documentation page. 2022-12-01T20:37:11,550 !! 2022-12-01T20:37:11,550 check.warn(importable) 2022-12-01T20:37:11,550 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_test' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,551 !! 2022-12-01T20:37:11,552 ############################ 2022-12-01T20:37:11,552 # Package would be ignored # 2022-12-01T20:37:11,552 ############################ 2022-12-01T20:37:11,552 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, 2022-12-01T20:37:11,553 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,553 'deepspeed.ops.csrc.aio.py_test' has been automatically added to the distribution only 2022-12-01T20:37:11,553 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,554 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,554 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2022-12-01T20:37:11,555 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,555 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,555 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,556 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,556 documentation page. 2022-12-01T20:37:11,557 !! 2022-12-01T20:37:11,557 check.warn(importable) 2022-12-01T20:37:11,558 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.common' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,558 !! 2022-12-01T20:37:11,559 ############################ 2022-12-01T20:37:11,559 # Package would be ignored # 2022-12-01T20:37:11,559 ############################ 2022-12-01T20:37:11,560 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, 2022-12-01T20:37:11,560 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,560 'deepspeed.ops.csrc.common' has been automatically added to the distribution only 2022-12-01T20:37:11,561 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,561 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,562 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2022-12-01T20:37:11,562 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,562 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,562 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,563 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,563 documentation page. 2022-12-01T20:37:11,564 !! 2022-12-01T20:37:11,565 check.warn(importable) 2022-12-01T20:37:11,565 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.includes' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,565 !! 2022-12-01T20:37:11,566 ############################ 2022-12-01T20:37:11,566 # Package would be ignored # 2022-12-01T20:37:11,567 ############################ 2022-12-01T20:37:11,567 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, 2022-12-01T20:37:11,567 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,568 'deepspeed.ops.csrc.includes' has been automatically added to the distribution only 2022-12-01T20:37:11,568 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,568 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,569 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2022-12-01T20:37:11,569 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,569 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,570 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,570 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,571 documentation page. 2022-12-01T20:37:11,571 !! 2022-12-01T20:37:11,572 check.warn(importable) 2022-12-01T20:37:11,572 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.lamb' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,572 !! 2022-12-01T20:37:11,573 ############################ 2022-12-01T20:37:11,574 # Package would be ignored # 2022-12-01T20:37:11,574 ############################ 2022-12-01T20:37:11,574 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, 2022-12-01T20:37:11,575 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,575 'deepspeed.ops.csrc.lamb' has been automatically added to the distribution only 2022-12-01T20:37:11,575 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,576 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,576 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2022-12-01T20:37:11,577 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,577 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,577 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,578 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,578 documentation page. 2022-12-01T20:37:11,579 !! 2022-12-01T20:37:11,580 check.warn(importable) 2022-12-01T20:37:11,580 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.quantization' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,581 !! 2022-12-01T20:37:11,582 ############################ 2022-12-01T20:37:11,582 # Package would be ignored # 2022-12-01T20:37:11,583 ############################ 2022-12-01T20:37:11,583 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, 2022-12-01T20:37:11,583 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,584 'deepspeed.ops.csrc.quantization' has been automatically added to the distribution only 2022-12-01T20:37:11,584 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,585 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,585 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2022-12-01T20:37:11,586 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,586 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,586 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,587 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,587 documentation page. 2022-12-01T20:37:11,589 !! 2022-12-01T20:37:11,589 check.warn(importable) 2022-12-01T20:37:11,590 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.sparse_attention' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,590 !! 2022-12-01T20:37:11,591 ############################ 2022-12-01T20:37:11,591 # Package would be ignored # 2022-12-01T20:37:11,591 ############################ 2022-12-01T20:37:11,592 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, 2022-12-01T20:37:11,592 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,593 'deepspeed.ops.csrc.sparse_attention' has been automatically added to the distribution only 2022-12-01T20:37:11,593 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,594 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,594 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2022-12-01T20:37:11,595 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,595 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,595 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,596 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,596 documentation page. 2022-12-01T20:37:11,597 !! 2022-12-01T20:37:11,598 check.warn(importable) 2022-12-01T20:37:11,598 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.csrc' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,599 !! 2022-12-01T20:37:11,600 ############################ 2022-12-01T20:37:11,600 # Package would be ignored # 2022-12-01T20:37:11,601 ############################ 2022-12-01T20:37:11,601 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package, 2022-12-01T20:37:11,601 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,602 'deepspeed.ops.csrc.spatial.csrc' has been automatically added to the distribution only 2022-12-01T20:37:11,602 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,603 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,603 Please make sure that 'deepspeed.ops.csrc.spatial.csrc' is included as a package by using 2022-12-01T20:37:11,604 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,604 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,604 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,605 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,606 documentation page. 2022-12-01T20:37:11,607 !! 2022-12-01T20:37:11,607 check.warn(importable) 2022-12-01T20:37:11,607 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.includes' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,608 !! 2022-12-01T20:37:11,609 ############################ 2022-12-01T20:37:11,609 # Package would be ignored # 2022-12-01T20:37:11,609 ############################ 2022-12-01T20:37:11,610 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package, 2022-12-01T20:37:11,610 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,611 'deepspeed.ops.csrc.spatial.includes' has been automatically added to the distribution only 2022-12-01T20:37:11,611 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,611 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,612 Please make sure that 'deepspeed.ops.csrc.spatial.includes' is included as a package by using 2022-12-01T20:37:11,613 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,613 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,613 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,614 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,614 documentation page. 2022-12-01T20:37:11,615 !! 2022-12-01T20:37:11,616 check.warn(importable) 2022-12-01T20:37:11,616 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,616 !! 2022-12-01T20:37:11,617 ############################ 2022-12-01T20:37:11,618 # Package would be ignored # 2022-12-01T20:37:11,618 ############################ 2022-12-01T20:37:11,618 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, 2022-12-01T20:37:11,619 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,619 'deepspeed.ops.csrc.transformer' has been automatically added to the distribution only 2022-12-01T20:37:11,620 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,620 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,620 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2022-12-01T20:37:11,621 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,621 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,621 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,622 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,622 documentation page. 2022-12-01T20:37:11,623 !! 2022-12-01T20:37:11,624 check.warn(importable) 2022-12-01T20:37:11,624 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.csrc' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,625 !! 2022-12-01T20:37:11,625 ############################ 2022-12-01T20:37:11,626 # Package would be ignored # 2022-12-01T20:37:11,626 ############################ 2022-12-01T20:37:11,626 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, 2022-12-01T20:37:11,627 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,627 'deepspeed.ops.csrc.transformer.inference.csrc' has been automatically added to the distribution only 2022-12-01T20:37:11,628 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,628 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,629 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2022-12-01T20:37:11,629 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,629 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,630 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,630 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,631 documentation page. 2022-12-01T20:37:11,631 !! 2022-12-01T20:37:11,632 check.warn(importable) 2022-12-01T20:37:11,632 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.includes' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,633 !! 2022-12-01T20:37:11,634 ############################ 2022-12-01T20:37:11,634 # Package would be ignored # 2022-12-01T20:37:11,634 ############################ 2022-12-01T20:37:11,635 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, 2022-12-01T20:37:11,635 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,636 'deepspeed.ops.csrc.transformer.inference.includes' has been automatically added to the distribution only 2022-12-01T20:37:11,636 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,636 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,637 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2022-12-01T20:37:11,637 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,637 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,638 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,639 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,639 documentation page. 2022-12-01T20:37:11,640 !! 2022-12-01T20:37:11,641 check.warn(importable) 2022-12-01T20:37:11,641 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.utils' as data is deprecated, please list it in `packages`. 2022-12-01T20:37:11,641 !! 2022-12-01T20:37:11,642 ############################ 2022-12-01T20:37:11,642 # Package would be ignored # 2022-12-01T20:37:11,643 ############################ 2022-12-01T20:37:11,643 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, 2022-12-01T20:37:11,643 but it is not listed in the `packages` configuration of setuptools. 2022-12-01T20:37:11,644 'deepspeed.ops.csrc.utils' has been automatically added to the distribution only 2022-12-01T20:37:11,644 because it may contain data files, but this behavior is likely to change 2022-12-01T20:37:11,645 in future versions of setuptools (and therefore is considered deprecated). 2022-12-01T20:37:11,645 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2022-12-01T20:37:11,646 the `packages` configuration field or the proper discovery methods 2022-12-01T20:37:11,646 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-01T20:37:11,646 instead of `find_packages(...)`/`find:`). 2022-12-01T20:37:11,647 You can read more about "package discovery" and "data files" on setuptools 2022-12-01T20:37:11,647 documentation page. 2022-12-01T20:37:11,648 !! 2022-12-01T20:37:11,649 check.warn(importable) 2022-12-01T20:37:11,649 creating build/lib/benchmarks/inference 2022-12-01T20:37:11,649 copying benchmarks/inference/bert-bench.py -> build/lib/benchmarks/inference 2022-12-01T20:37:11,650 copying benchmarks/inference/collect_results.py -> build/lib/benchmarks/inference 2022-12-01T20:37:11,650 copying benchmarks/inference/gpt-bench.py -> build/lib/benchmarks/inference 2022-12-01T20:37:11,650 creating build/lib/deepspeed/autotuning/config_templates 2022-12-01T20:37:11,651 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2022-12-01T20:37:11,651 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2022-12-01T20:37:11,651 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2022-12-01T20:37:11,652 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2022-12-01T20:37:11,652 creating build/lib/deepspeed/ops/csrc 2022-12-01T20:37:11,652 creating build/lib/deepspeed/ops/csrc/adagrad 2022-12-01T20:37:11,652 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2022-12-01T20:37:11,653 creating build/lib/deepspeed/ops/csrc/adam 2022-12-01T20:37:11,653 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2022-12-01T20:37:11,653 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2022-12-01T20:37:11,654 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2022-12-01T20:37:11,654 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2022-12-01T20:37:11,654 creating build/lib/deepspeed/ops/csrc/aio 2022-12-01T20:37:11,655 creating build/lib/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:11,655 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:11,655 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:11,656 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:11,656 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:11,657 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:11,663 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:11,667 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:11,669 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:11,673 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:11,677 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:11,681 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:11,685 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:11,690 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:11,694 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:11,698 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:11,702 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:11,706 creating build/lib/deepspeed/ops/csrc/aio/py_test 2022-12-01T20:37:11,707 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2022-12-01T20:37:11,712 creating build/lib/deepspeed/ops/csrc/common 2022-12-01T20:37:11,713 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2022-12-01T20:37:11,717 creating build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,719 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,723 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,727 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,731 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,735 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,740 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,744 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,749 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,753 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,758 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,762 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,766 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,770 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,774 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,778 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,782 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,787 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,791 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,797 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,802 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,806 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,811 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,816 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,821 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,826 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,831 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,835 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-01T20:37:11,840 creating build/lib/deepspeed/ops/csrc/lamb 2022-12-01T20:37:11,842 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2022-12-01T20:37:11,847 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2022-12-01T20:37:11,853 creating build/lib/deepspeed/ops/csrc/quantization 2022-12-01T20:37:11,855 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2022-12-01T20:37:11,859 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2022-12-01T20:37:11,866 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2022-12-01T20:37:11,871 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2022-12-01T20:37:11,877 creating build/lib/deepspeed/ops/csrc/sparse_attention 2022-12-01T20:37:11,879 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2022-12-01T20:37:11,884 creating build/lib/deepspeed/ops/csrc/spatial 2022-12-01T20:37:11,885 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2022-12-01T20:37:11,888 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2022-12-01T20:37:11,893 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2022-12-01T20:37:11,897 creating build/lib/deepspeed/ops/csrc/spatial/includes 2022-12-01T20:37:11,898 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2022-12-01T20:37:11,902 creating build/lib/deepspeed/ops/csrc/transformer 2022-12-01T20:37:11,903 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-01T20:37:11,909 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-01T20:37:11,914 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2022-12-01T20:37:11,921 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-01T20:37:11,925 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-01T20:37:11,931 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-01T20:37:11,939 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-01T20:37:11,944 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-01T20:37:11,949 creating build/lib/deepspeed/ops/csrc/transformer/inference 2022-12-01T20:37:11,950 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:11,951 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:11,957 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:11,961 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:11,966 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:11,971 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:11,979 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:11,984 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:11,990 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:11,996 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-12-01T20:37:11,997 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-12-01T20:37:12,003 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-12-01T20:37:12,008 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-12-01T20:37:12,013 creating build/lib/deepspeed/ops/csrc/utils 2022-12-01T20:37:12,014 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2022-12-01T20:37:12,019 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-12-01T20:37:12,023 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-12-01T20:37:12,027 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-12-01T20:37:12,094 running build_scripts 2022-12-01T20:37:12,095 creating build/scripts-3.7 2022-12-01T20:37:12,096 copying and adjusting bin/deepspeed -> build/scripts-3.7 2022-12-01T20:37:12,099 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2022-12-01T20:37:12,102 copying and adjusting bin/ds -> build/scripts-3.7 2022-12-01T20:37:12,105 copying bin/ds_ssh -> build/scripts-3.7 2022-12-01T20:37:12,109 copying and adjusting bin/ds_report -> build/scripts-3.7 2022-12-01T20:37:12,111 copying and adjusting bin/ds_bench -> build/scripts-3.7 2022-12-01T20:37:12,114 copying and adjusting bin/dsr -> build/scripts-3.7 2022-12-01T20:37:12,116 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2022-12-01T20:37:12,118 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2022-12-01T20:37:12,119 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2022-12-01T20:37:12,119 changing mode of build/scripts-3.7/ds from 644 to 755 2022-12-01T20:37:12,120 changing mode of build/scripts-3.7/ds_report from 644 to 755 2022-12-01T20:37:12,120 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2022-12-01T20:37:12,121 changing mode of build/scripts-3.7/dsr from 644 to 755 2022-12-01T20:37:12,121 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2022-12-01T20:37:12,223 /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2022-12-01T20:37:12,223 setuptools.SetuptoolsDeprecationWarning, 2022-12-01T20:37:12,330 installing to build/bdist.linux-armv7l/wheel 2022-12-01T20:37:12,330 running install 2022-12-01T20:37:12,391 running install_lib 2022-12-01T20:37:12,488 creating build/bdist.linux-armv7l 2022-12-01T20:37:12,488 creating build/bdist.linux-armv7l/wheel 2022-12-01T20:37:12,492 creating build/bdist.linux-armv7l/wheel/benchmarks 2022-12-01T20:37:12,495 creating build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-01T20:37:12,497 copying build/lib/benchmarks/communication/all_gather.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-01T20:37:12,502 copying build/lib/benchmarks/communication/constants.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-01T20:37:12,505 copying build/lib/benchmarks/communication/all_to_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-01T20:37:12,510 copying build/lib/benchmarks/communication/utils.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-01T20:37:12,514 copying build/lib/benchmarks/communication/broadcast.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-01T20:37:12,518 copying build/lib/benchmarks/communication/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-01T20:37:12,521 copying build/lib/benchmarks/communication/pt2pt.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-01T20:37:12,525 copying build/lib/benchmarks/communication/all_reduce.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-01T20:37:12,528 copying build/lib/benchmarks/communication/run_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-01T20:37:12,533 creating build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-12-01T20:37:12,534 copying build/lib/benchmarks/inference/bert-bench.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-12-01T20:37:12,538 copying build/lib/benchmarks/inference/collect_results.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-12-01T20:37:12,543 copying build/lib/benchmarks/inference/gpt-bench.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-12-01T20:37:12,546 copying build/lib/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks 2022-12-01T20:37:12,551 creating build/bdist.linux-armv7l/wheel/deepspeed 2022-12-01T20:37:12,553 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-01T20:37:12,555 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-01T20:37:12,560 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-01T20:37:12,564 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-01T20:37:12,568 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-01T20:37:12,571 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-01T20:37:12,577 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-01T20:37:12,581 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-01T20:37:12,583 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-01T20:37:12,587 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-01T20:37:12,592 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-01T20:37:12,595 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-01T20:37:12,599 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-01T20:37:12,602 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-01T20:37:12,608 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2022-12-01T20:37:12,611 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2022-12-01T20:37:12,613 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2022-12-01T20:37:12,617 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2022-12-01T20:37:12,620 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2022-12-01T20:37:12,626 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2022-12-01T20:37:12,628 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2022-12-01T20:37:12,632 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2022-12-01T20:37:12,636 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2022-12-01T20:37:12,639 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2022-12-01T20:37:12,644 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2022-12-01T20:37:12,645 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2022-12-01T20:37:12,649 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2022-12-01T20:37:12,653 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2022-12-01T20:37:12,657 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2022-12-01T20:37:12,663 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-01T20:37:12,665 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-01T20:37:12,669 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-01T20:37:12,673 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-01T20:37:12,678 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-01T20:37:12,683 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-01T20:37:12,689 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-01T20:37:12,693 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-01T20:37:12,700 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-12-01T20:37:12,705 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,707 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,712 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,717 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,721 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,725 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,729 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,734 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,738 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,742 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,746 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,751 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,755 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,759 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-01T20:37:12,764 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-01T20:37:12,766 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-01T20:37:12,771 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-01T20:37:12,775 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-01T20:37:12,781 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-01T20:37:12,783 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-01T20:37:12,788 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-01T20:37:12,792 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-01T20:37:12,796 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-01T20:37:12,800 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-01T20:37:12,804 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-01T20:37:12,808 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-01T20:37:12,813 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-01T20:37:12,819 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-01T20:37:12,824 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-12-01T20:37:12,825 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-12-01T20:37:12,828 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-12-01T20:37:12,832 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-12-01T20:37:12,835 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-12-01T20:37:12,840 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:12,842 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,844 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,851 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,854 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,859 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,862 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,867 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,871 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,875 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,884 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,887 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,892 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,901 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,904 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-01T20:37:12,910 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-12-01T20:37:12,911 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-12-01T20:37:12,917 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-12-01T20:37:12,919 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-12-01T20:37:12,924 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-12-01T20:37:12,928 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-12-01T20:37:12,933 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-12-01T20:37:12,936 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-12-01T20:37:12,941 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-12-01T20:37:12,945 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-12-01T20:37:12,948 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:12,952 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:12,957 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-12-01T20:37:12,959 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-12-01T20:37:12,962 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-12-01T20:37:12,968 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-12-01T20:37:12,971 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:12,977 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:12,980 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:12,986 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-01T20:37:12,988 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-01T20:37:12,992 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-01T20:37:12,995 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-01T20:37:13,000 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-01T20:37:13,004 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-01T20:37:13,007 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-01T20:37:13,011 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-01T20:37:13,016 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-01T20:37:13,021 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-01T20:37:13,025 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:13,030 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:13,036 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:13,041 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:13,047 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:13,053 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-12-01T20:37:13,055 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-12-01T20:37:13,059 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-12-01T20:37:13,063 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:13,075 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-01T20:37:13,078 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-01T20:37:13,083 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-01T20:37:13,087 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-01T20:37:13,092 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-01T20:37:13,099 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-01T20:37:13,104 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-01T20:37:13,109 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-12-01T20:37:13,110 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-12-01T20:37:13,114 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-12-01T20:37:13,117 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-12-01T20:37:13,120 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-12-01T20:37:13,124 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:13,129 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-12-01T20:37:13,131 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-12-01T20:37:13,134 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-12-01T20:37:13,139 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-12-01T20:37:13,140 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-12-01T20:37:13,145 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-12-01T20:37:13,149 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-12-01T20:37:13,153 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-12-01T20:37:13,155 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:13,158 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:13,162 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-01T20:37:13,166 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-12-01T20:37:13,171 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-01T20:37:13,172 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-01T20:37:13,177 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-01T20:37:13,184 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-01T20:37:13,187 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-01T20:37:13,192 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-01T20:37:13,196 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-01T20:37:13,200 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-01T20:37:13,204 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-01T20:37:13,208 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2022-12-01T20:37:13,209 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2022-12-01T20:37:13,214 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-12-01T20:37:13,215 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-12-01T20:37:13,219 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-12-01T20:37:13,224 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-12-01T20:37:13,227 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-12-01T20:37:13,232 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-01T20:37:13,233 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-01T20:37:13,239 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-01T20:37:13,243 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-01T20:37:13,246 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-01T20:37:13,251 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-01T20:37:13,255 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-12-01T20:37:13,256 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-12-01T20:37:13,261 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-12-01T20:37:13,262 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-12-01T20:37:13,266 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-12-01T20:37:13,272 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-12-01T20:37:13,275 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-12-01T20:37:13,279 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-01T20:37:13,281 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-01T20:37:13,287 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-01T20:37:13,290 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-01T20:37:13,293 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-01T20:37:13,296 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-01T20:37:13,300 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-01T20:37:13,303 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-01T20:37:13,308 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-01T20:37:13,310 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-01T20:37:13,313 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-01T20:37:13,316 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-01T20:37:13,320 copying build/lib/deepspeed/monitor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-01T20:37:13,324 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-01T20:37:13,327 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-01T20:37:13,330 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-01T20:37:13,333 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-01T20:37:13,336 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-12-01T20:37:13,341 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-01T20:37:13,343 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-01T20:37:13,347 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-01T20:37:13,350 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-01T20:37:13,353 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-01T20:37:13,357 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-01T20:37:13,362 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-01T20:37:13,366 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-01T20:37:13,369 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-01T20:37:13,372 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-01T20:37:13,378 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2022-12-01T20:37:13,381 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-12-01T20:37:13,382 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-12-01T20:37:13,387 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-12-01T20:37:13,391 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-12-01T20:37:13,392 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-12-01T20:37:13,397 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-12-01T20:37:13,400 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-12-01T20:37:13,404 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-12-01T20:37:13,408 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-12-01T20:37:13,410 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-12-01T20:37:13,417 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,418 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,423 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,427 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,431 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,435 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,440 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,444 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,449 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,453 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,458 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-01T20:37:13,461 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-12-01T20:37:13,466 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-01T20:37:13,467 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-01T20:37:13,471 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-01T20:37:13,477 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-01T20:37:13,481 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-01T20:37:13,486 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-01T20:37:13,490 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-01T20:37:13,494 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-12-01T20:37:13,496 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-12-01T20:37:13,499 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-12-01T20:37:13,503 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-12-01T20:37:13,506 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-12-01T20:37:13,510 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-01T20:37:13,517 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2022-12-01T20:37:13,520 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2022-12-01T20:37:13,521 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2022-12-01T20:37:13,527 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-12-01T20:37:13,528 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-12-01T20:37:13,532 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-12-01T20:37:13,535 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-12-01T20:37:13,539 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-12-01T20:37:13,545 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-01T20:37:13,546 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-01T20:37:13,550 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-01T20:37:13,555 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-01T20:37:13,560 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-01T20:37:13,565 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-01T20:37:13,571 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2022-12-01T20:37:13,573 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:13,575 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:13,579 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:13,583 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:13,587 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:13,592 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:13,597 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:13,604 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:13,610 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-01T20:37:13,615 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-12-01T20:37:13,617 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-12-01T20:37:13,621 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-12-01T20:37:13,625 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-12-01T20:37:13,630 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-01T20:37:13,634 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-01T20:37:13,641 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-01T20:37:13,651 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2022-12-01T20:37:13,652 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2022-12-01T20:37:13,657 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2022-12-01T20:37:13,658 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2022-12-01T20:37:13,663 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2022-12-01T20:37:13,666 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2022-12-01T20:37:13,668 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2022-12-01T20:37:13,672 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2022-12-01T20:37:13,676 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2022-12-01T20:37:13,678 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2022-12-01T20:37:13,684 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2022-12-01T20:37:13,686 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2022-12-01T20:37:13,693 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,694 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,698 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,701 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,705 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,708 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,712 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,716 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,719 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,723 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,726 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,730 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,733 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,736 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,740 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,745 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,748 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,753 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,758 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,761 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,765 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,769 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,772 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,776 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,779 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,783 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,786 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,791 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-01T20:37:13,797 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-12-01T20:37:13,799 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-12-01T20:37:13,803 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-12-01T20:37:13,810 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-12-01T20:37:13,815 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-12-01T20:37:13,820 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2022-12-01T20:37:13,824 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:13,826 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:13,830 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:13,834 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:13,839 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:13,843 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:13,846 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:13,852 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:13,856 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:13,860 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-01T20:37:13,864 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:13,866 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:13,870 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:13,873 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:13,878 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:13,881 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:13,884 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-01T20:37:13,889 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2022-12-01T20:37:13,890 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2022-12-01T20:37:13,895 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-12-01T20:37:13,896 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-12-01T20:37:13,901 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-12-01T20:37:13,904 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2022-12-01T20:37:13,908 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-12-01T20:37:13,910 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-12-01T20:37:13,913 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-12-01T20:37:13,918 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,919 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,923 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,926 copying build/lib/deepspeed/ops/op_builder/builder_names.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,929 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,932 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,935 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,938 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,942 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,945 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,950 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,953 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,956 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,959 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,962 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,966 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,969 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-01T20:37:13,973 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2022-12-01T20:37:13,975 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2022-12-01T20:37:13,979 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-12-01T20:37:13,981 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-12-01T20:37:13,985 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-12-01T20:37:13,989 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-12-01T20:37:13,991 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-12-01T20:37:13,994 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-12-01T20:37:13,998 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-12-01T20:37:14,000 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-12-01T20:37:14,004 running install_egg_info 2022-12-01T20:37:14,105 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.7.6-py3.7.egg-info 2022-12-01T20:37:14,130 running install_scripts 2022-12-01T20:37:14,235 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data 2022-12-01T20:37:14,236 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts 2022-12-01T20:37:14,237 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts 2022-12-01T20:37:14,241 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts 2022-12-01T20:37:14,244 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts 2022-12-01T20:37:14,248 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts 2022-12-01T20:37:14,251 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts 2022-12-01T20:37:14,254 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts 2022-12-01T20:37:14,257 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts 2022-12-01T20:37:14,260 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts 2022-12-01T20:37:14,263 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts/deepspeed.pt to 755 2022-12-01T20:37:14,263 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts/ds_ssh to 755 2022-12-01T20:37:14,264 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts/ds_bench to 755 2022-12-01T20:37:14,264 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts/ds to 755 2022-12-01T20:37:14,264 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts/deepspeed to 755 2022-12-01T20:37:14,265 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts/dsr to 755 2022-12-01T20:37:14,265 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts/ds_elastic to 755 2022-12-01T20:37:14,266 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.data/scripts/ds_report to 755 2022-12-01T20:37:14,549 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2022-12-01T20:37:14,557 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.6.dist-info/WHEEL 2022-12-01T20:37:14,561 creating '/tmp/pip-wheel-7cpl60vn/deepspeed-0.7.6-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2022-12-01T20:37:14,565 adding 'benchmarks/__init__.py' 2022-12-01T20:37:14,569 adding 'benchmarks/communication/__init__.py' 2022-12-01T20:37:14,572 adding 'benchmarks/communication/all_gather.py' 2022-12-01T20:37:14,575 adding 'benchmarks/communication/all_reduce.py' 2022-12-01T20:37:14,577 adding 'benchmarks/communication/all_to_all.py' 2022-12-01T20:37:14,580 adding 'benchmarks/communication/broadcast.py' 2022-12-01T20:37:14,582 adding 'benchmarks/communication/constants.py' 2022-12-01T20:37:14,585 adding 'benchmarks/communication/pt2pt.py' 2022-12-01T20:37:14,587 adding 'benchmarks/communication/run_all.py' 2022-12-01T20:37:14,591 adding 'benchmarks/communication/utils.py' 2022-12-01T20:37:14,594 adding 'benchmarks/inference/bert-bench.py' 2022-12-01T20:37:14,597 adding 'benchmarks/inference/collect_results.py' 2022-12-01T20:37:14,600 adding 'benchmarks/inference/gpt-bench.py' 2022-12-01T20:37:14,605 adding 'deepspeed/__init__.py' 2022-12-01T20:37:14,608 adding 'deepspeed/constants.py' 2022-12-01T20:37:14,611 adding 'deepspeed/env_report.py' 2022-12-01T20:37:14,613 adding 'deepspeed/git_version_info.py' 2022-12-01T20:37:14,615 adding 'deepspeed/git_version_info_installed.py' 2022-12-01T20:37:14,618 adding 'deepspeed/accelerator/__init__.py' 2022-12-01T20:37:14,621 adding 'deepspeed/accelerator/abstract_accelerator.py' 2022-12-01T20:37:14,624 adding 'deepspeed/accelerator/cuda_accelerator.py' 2022-12-01T20:37:14,626 adding 'deepspeed/accelerator/real_accelerator.py' 2022-12-01T20:37:14,630 adding 'deepspeed/autotuning/__init__.py' 2022-12-01T20:37:14,642 adding 'deepspeed/autotuning/autotuner.py' 2022-12-01T20:37:14,646 adding 'deepspeed/autotuning/config.py' 2022-12-01T20:37:14,649 adding 'deepspeed/autotuning/constants.py' 2022-12-01T20:37:14,654 adding 'deepspeed/autotuning/scheduler.py' 2022-12-01T20:37:14,659 adding 'deepspeed/autotuning/utils.py' 2022-12-01T20:37:14,662 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2022-12-01T20:37:14,664 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2022-12-01T20:37:14,666 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2022-12-01T20:37:14,669 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2022-12-01T20:37:14,672 adding 'deepspeed/autotuning/tuner/__init__.py' 2022-12-01T20:37:14,674 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2022-12-01T20:37:14,677 adding 'deepspeed/autotuning/tuner/cost_model.py' 2022-12-01T20:37:14,679 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2022-12-01T20:37:14,682 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2022-12-01T20:37:14,684 adding 'deepspeed/autotuning/tuner/utils.py' 2022-12-01T20:37:14,688 adding 'deepspeed/checkpoint/__init__.py' 2022-12-01T20:37:14,691 adding 'deepspeed/checkpoint/constants.py' 2022-12-01T20:37:14,694 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2022-12-01T20:37:14,697 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2022-12-01T20:37:14,701 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2022-12-01T20:37:14,703 adding 'deepspeed/checkpoint/reshape_utils.py' 2022-12-01T20:37:14,706 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2022-12-01T20:37:14,709 adding 'deepspeed/checkpoint/utils.py' 2022-12-01T20:37:14,711 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2022-12-01T20:37:14,715 adding 'deepspeed/comm/__init__.py' 2022-12-01T20:37:14,717 adding 'deepspeed/comm/backend.py' 2022-12-01T20:37:14,724 adding 'deepspeed/comm/comm.py' 2022-12-01T20:37:14,727 adding 'deepspeed/comm/config.py' 2022-12-01T20:37:14,729 adding 'deepspeed/comm/constants.py' 2022-12-01T20:37:14,732 adding 'deepspeed/comm/torch.py' 2022-12-01T20:37:14,735 adding 'deepspeed/comm/utils.py' 2022-12-01T20:37:14,739 adding 'deepspeed/compression/__init__.py' 2022-12-01T20:37:14,746 adding 'deepspeed/compression/basic_layer.py' 2022-12-01T20:37:14,750 adding 'deepspeed/compression/compress.py' 2022-12-01T20:37:14,754 adding 'deepspeed/compression/config.py' 2022-12-01T20:37:14,758 adding 'deepspeed/compression/constants.py' 2022-12-01T20:37:14,761 adding 'deepspeed/compression/helper.py' 2022-12-01T20:37:14,764 adding 'deepspeed/compression/scheduler.py' 2022-12-01T20:37:14,767 adding 'deepspeed/compression/utils.py' 2022-12-01T20:37:14,771 adding 'deepspeed/elasticity/__init__.py' 2022-12-01T20:37:14,773 adding 'deepspeed/elasticity/config.py' 2022-12-01T20:37:14,776 adding 'deepspeed/elasticity/constants.py' 2022-12-01T20:37:14,781 adding 'deepspeed/elasticity/elastic_agent.py' 2022-12-01T20:37:14,786 adding 'deepspeed/elasticity/elasticity.py' 2022-12-01T20:37:14,788 adding 'deepspeed/elasticity/utils.py' 2022-12-01T20:37:14,792 adding 'deepspeed/inference/__init__.py' 2022-12-01T20:37:14,795 adding 'deepspeed/inference/config.py' 2022-12-01T20:37:14,802 adding 'deepspeed/inference/engine.py' 2022-12-01T20:37:14,806 adding 'deepspeed/launcher/__init__.py' 2022-12-01T20:37:14,808 adding 'deepspeed/launcher/constants.py' 2022-12-01T20:37:14,812 adding 'deepspeed/launcher/launch.py' 2022-12-01T20:37:14,816 adding 'deepspeed/launcher/multinode_runner.py' 2022-12-01T20:37:14,822 adding 'deepspeed/launcher/runner.py' 2022-12-01T20:37:14,826 adding 'deepspeed/model_implementations/__init__.py' 2022-12-01T20:37:14,829 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2022-12-01T20:37:14,831 adding 'deepspeed/model_implementations/diffusers/unet.py' 2022-12-01T20:37:14,834 adding 'deepspeed/model_implementations/diffusers/vae.py' 2022-12-01T20:37:14,837 adding 'deepspeed/model_implementations/transformers/__init__.py' 2022-12-01T20:37:14,840 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2022-12-01T20:37:14,843 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2022-12-01T20:37:14,846 adding 'deepspeed/module_inject/__init__.py' 2022-12-01T20:37:14,849 adding 'deepspeed/module_inject/inject.py' 2022-12-01T20:37:14,852 adding 'deepspeed/module_inject/layers.py' 2022-12-01T20:37:14,856 adding 'deepspeed/module_inject/load_checkpoint.py' 2022-12-01T20:37:14,858 adding 'deepspeed/module_inject/module_quantize.py' 2022-12-01T20:37:14,871 adding 'deepspeed/module_inject/replace_module.py' 2022-12-01T20:37:14,876 adding 'deepspeed/module_inject/replace_policy.py' 2022-12-01T20:37:14,880 adding 'deepspeed/moe/__init__.py' 2022-12-01T20:37:14,882 adding 'deepspeed/moe/experts.py' 2022-12-01T20:37:14,885 adding 'deepspeed/moe/layer.py' 2022-12-01T20:37:14,888 adding 'deepspeed/moe/mappings.py' 2022-12-01T20:37:14,894 adding 'deepspeed/moe/sharded_moe.py' 2022-12-01T20:37:14,898 adding 'deepspeed/moe/utils.py' 2022-12-01T20:37:14,901 adding 'deepspeed/monitor/__init__.py' 2022-12-01T20:37:14,903 adding 'deepspeed/monitor/config.py' 2022-12-01T20:37:14,905 adding 'deepspeed/monitor/constants.py' 2022-12-01T20:37:14,908 adding 'deepspeed/monitor/csv_monitor.py' 2022-12-01T20:37:14,910 adding 'deepspeed/monitor/monitor.py' 2022-12-01T20:37:14,913 adding 'deepspeed/monitor/tensorboard.py' 2022-12-01T20:37:14,915 adding 'deepspeed/monitor/utils.py' 2022-12-01T20:37:14,917 adding 'deepspeed/monitor/wandb.py' 2022-12-01T20:37:14,920 adding 'deepspeed/nebula/__init__.py' 2022-12-01T20:37:14,923 adding 'deepspeed/nebula/config.py' 2022-12-01T20:37:14,925 adding 'deepspeed/nebula/constants.py' 2022-12-01T20:37:14,929 adding 'deepspeed/ops/__init__.py' 2022-12-01T20:37:14,932 adding 'deepspeed/ops/adagrad/__init__.py' 2022-12-01T20:37:14,935 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2022-12-01T20:37:14,938 adding 'deepspeed/ops/adam/__init__.py' 2022-12-01T20:37:14,942 adding 'deepspeed/ops/adam/cpu_adam.py' 2022-12-01T20:37:14,945 adding 'deepspeed/ops/adam/fused_adam.py' 2022-12-01T20:37:14,948 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2022-12-01T20:37:14,951 adding 'deepspeed/ops/aio/__init__.py' 2022-12-01T20:37:14,956 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2022-12-01T20:37:14,961 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2022-12-01T20:37:14,963 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2022-12-01T20:37:14,966 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2022-12-01T20:37:14,969 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2022-12-01T20:37:14,975 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2022-12-01T20:37:14,978 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2022-12-01T20:37:14,981 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2022-12-01T20:37:14,983 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2022-12-01T20:37:14,986 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2022-12-01T20:37:14,988 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2022-12-01T20:37:14,992 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2022-12-01T20:37:14,994 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2022-12-01T20:37:14,997 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2022-12-01T20:37:15,000 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2022-12-01T20:37:15,003 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2022-12-01T20:37:15,005 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2022-12-01T20:37:15,008 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2022-12-01T20:37:15,011 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2022-12-01T20:37:15,013 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2022-12-01T20:37:15,016 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2022-12-01T20:37:15,020 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2022-12-01T20:37:15,024 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2022-12-01T20:37:15,027 adding 'deepspeed/ops/csrc/includes/Timer.h' 2022-12-01T20:37:15,029 adding 'deepspeed/ops/csrc/includes/compat.h' 2022-12-01T20:37:15,032 adding 'deepspeed/ops/csrc/includes/context.h' 2022-12-01T20:37:15,035 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2022-12-01T20:37:15,038 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2022-12-01T20:37:15,042 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2022-12-01T20:37:15,044 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2022-12-01T20:37:15,047 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2022-12-01T20:37:15,051 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2022-12-01T20:37:15,053 adding 'deepspeed/ops/csrc/includes/dropout.h' 2022-12-01T20:37:15,056 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2022-12-01T20:37:15,059 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2022-12-01T20:37:15,061 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2022-12-01T20:37:15,064 adding 'deepspeed/ops/csrc/includes/gelu.h' 2022-12-01T20:37:15,067 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2022-12-01T20:37:15,069 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2022-12-01T20:37:15,074 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2022-12-01T20:37:15,078 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2022-12-01T20:37:15,080 adding 'deepspeed/ops/csrc/includes/quantization.h' 2022-12-01T20:37:15,085 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2022-12-01T20:37:15,087 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2022-12-01T20:37:15,092 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2022-12-01T20:37:15,095 adding 'deepspeed/ops/csrc/includes/simd.h' 2022-12-01T20:37:15,098 adding 'deepspeed/ops/csrc/includes/softmax.h' 2022-12-01T20:37:15,101 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2022-12-01T20:37:15,103 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2022-12-01T20:37:15,107 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2022-12-01T20:37:15,112 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2022-12-01T20:37:15,115 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2022-12-01T20:37:15,122 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2022-12-01T20:37:15,125 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2022-12-01T20:37:15,129 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2022-12-01T20:37:15,133 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2022-12-01T20:37:15,138 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2022-12-01T20:37:15,141 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2022-12-01T20:37:15,144 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2022-12-01T20:37:15,149 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2022-12-01T20:37:15,154 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2022-12-01T20:37:15,164 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2022-12-01T20:37:15,168 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2022-12-01T20:37:15,172 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2022-12-01T20:37:15,182 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2022-12-01T20:37:15,189 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2022-12-01T20:37:15,194 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2022-12-01T20:37:15,201 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2022-12-01T20:37:15,204 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2022-12-01T20:37:15,211 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2022-12-01T20:37:15,215 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2022-12-01T20:37:15,227 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2022-12-01T20:37:15,231 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2022-12-01T20:37:15,236 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2022-12-01T20:37:15,242 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2022-12-01T20:37:15,248 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2022-12-01T20:37:15,251 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2022-12-01T20:37:15,255 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2022-12-01T20:37:15,258 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2022-12-01T20:37:15,261 adding 'deepspeed/ops/lamb/__init__.py' 2022-12-01T20:37:15,265 adding 'deepspeed/ops/lamb/fused_lamb.py' 2022-12-01T20:37:15,269 adding 'deepspeed/ops/op_builder/__init__.py' 2022-12-01T20:37:15,271 adding 'deepspeed/ops/op_builder/all_ops.py' 2022-12-01T20:37:15,274 adding 'deepspeed/ops/op_builder/async_io.py' 2022-12-01T20:37:15,281 adding 'deepspeed/ops/op_builder/builder.py' 2022-12-01T20:37:15,283 adding 'deepspeed/ops/op_builder/builder_names.py' 2022-12-01T20:37:15,286 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2022-12-01T20:37:15,288 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2022-12-01T20:37:15,290 adding 'deepspeed/ops/op_builder/fused_adam.py' 2022-12-01T20:37:15,293 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2022-12-01T20:37:15,295 adding 'deepspeed/ops/op_builder/quantizer.py' 2022-12-01T20:37:15,297 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2022-12-01T20:37:15,300 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2022-12-01T20:37:15,302 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2022-12-01T20:37:15,304 adding 'deepspeed/ops/op_builder/transformer.py' 2022-12-01T20:37:15,307 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2022-12-01T20:37:15,309 adding 'deepspeed/ops/op_builder/utils.py' 2022-12-01T20:37:15,312 adding 'deepspeed/ops/quantizer/__init__.py' 2022-12-01T20:37:15,315 adding 'deepspeed/ops/quantizer/quantizer.py' 2022-12-01T20:37:15,318 adding 'deepspeed/ops/sparse_attention/__init__.py' 2022-12-01T20:37:15,321 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2022-12-01T20:37:15,330 adding 'deepspeed/ops/sparse_attention/matmul.py' 2022-12-01T20:37:15,335 adding 'deepspeed/ops/sparse_attention/softmax.py' 2022-12-01T20:37:15,339 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2022-12-01T20:37:15,343 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2022-12-01T20:37:15,350 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2022-12-01T20:37:15,354 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2022-12-01T20:37:15,357 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2022-12-01T20:37:15,360 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2022-12-01T20:37:15,363 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2022-12-01T20:37:15,366 adding 'deepspeed/ops/transformer/__init__.py' 2022-12-01T20:37:15,372 adding 'deepspeed/ops/transformer/transformer.py' 2022-12-01T20:37:15,376 adding 'deepspeed/ops/transformer/inference/__init__.py' 2022-12-01T20:37:15,378 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2022-12-01T20:37:15,381 adding 'deepspeed/ops/transformer/inference/config.py' 2022-12-01T20:37:15,383 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2022-12-01T20:37:15,386 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2022-12-01T20:37:15,389 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2022-12-01T20:37:15,395 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2022-12-01T20:37:15,398 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2022-12-01T20:37:15,404 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2022-12-01T20:37:15,407 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2022-12-01T20:37:15,410 adding 'deepspeed/pipe/__init__.py' 2022-12-01T20:37:15,413 adding 'deepspeed/profiling/__init__.py' 2022-12-01T20:37:15,415 adding 'deepspeed/profiling/config.py' 2022-12-01T20:37:15,418 adding 'deepspeed/profiling/constants.py' 2022-12-01T20:37:15,421 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2022-12-01T20:37:15,432 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2022-12-01T20:37:15,437 adding 'deepspeed/runtime/__init__.py' 2022-12-01T20:37:15,442 adding 'deepspeed/runtime/bf16_optimizer.py' 2022-12-01T20:37:15,451 adding 'deepspeed/runtime/config.py' 2022-12-01T20:37:15,455 adding 'deepspeed/runtime/config_utils.py' 2022-12-01T20:37:15,460 adding 'deepspeed/runtime/constants.py' 2022-12-01T20:37:15,462 adding 'deepspeed/runtime/dataloader.py' 2022-12-01T20:37:15,465 adding 'deepspeed/runtime/eigenvalue.py' 2022-12-01T20:37:15,504 adding 'deepspeed/runtime/engine.py' 2022-12-01T20:37:15,515 adding 'deepspeed/runtime/lr_schedules.py' 2022-12-01T20:37:15,518 adding 'deepspeed/runtime/progressive_layer_drop.py' 2022-12-01T20:37:15,521 adding 'deepspeed/runtime/quantize.py' 2022-12-01T20:37:15,524 adding 'deepspeed/runtime/sparse_tensor.py' 2022-12-01T20:37:15,529 adding 'deepspeed/runtime/state_dict_factory.py' 2022-12-01T20:37:15,539 adding 'deepspeed/runtime/utils.py' 2022-12-01T20:37:15,543 adding 'deepspeed/runtime/weight_quantizer.py' 2022-12-01T20:37:15,546 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2022-12-01T20:37:15,555 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2022-12-01T20:37:15,558 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2022-12-01T20:37:15,561 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2022-12-01T20:37:15,563 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2022-12-01T20:37:15,566 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2022-12-01T20:37:15,568 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2022-12-01T20:37:15,571 adding 'deepspeed/runtime/comm/__init__.py' 2022-12-01T20:37:15,574 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2022-12-01T20:37:15,578 adding 'deepspeed/runtime/comm/mpi.py' 2022-12-01T20:37:15,581 adding 'deepspeed/runtime/comm/nccl.py' 2022-12-01T20:37:15,585 adding 'deepspeed/runtime/compression/__init__.py' 2022-12-01T20:37:15,587 adding 'deepspeed/runtime/compression/cupy.py' 2022-12-01T20:37:15,590 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2022-12-01T20:37:15,593 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2022-12-01T20:37:15,596 adding 'deepspeed/runtime/fp16/__init__.py' 2022-12-01T20:37:15,602 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2022-12-01T20:37:15,606 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2022-12-01T20:37:15,612 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2022-12-01T20:37:15,615 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2022-12-01T20:37:15,621 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2022-12-01T20:37:15,627 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2022-12-01T20:37:15,633 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2022-12-01T20:37:15,637 adding 'deepspeed/runtime/pipe/__init__.py' 2022-12-01T20:37:15,651 adding 'deepspeed/runtime/pipe/engine.py' 2022-12-01T20:37:15,660 adding 'deepspeed/runtime/pipe/module.py' 2022-12-01T20:37:15,664 adding 'deepspeed/runtime/pipe/p2p.py' 2022-12-01T20:37:15,668 adding 'deepspeed/runtime/pipe/schedule.py' 2022-12-01T20:37:15,673 adding 'deepspeed/runtime/pipe/topology.py' 2022-12-01T20:37:15,677 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2022-12-01T20:37:15,679 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2022-12-01T20:37:15,682 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2022-12-01T20:37:15,685 adding 'deepspeed/runtime/swap_tensor/constants.py' 2022-12-01T20:37:15,690 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2022-12-01T20:37:15,694 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2022-12-01T20:37:15,700 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2022-12-01T20:37:15,704 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2022-12-01T20:37:15,707 adding 'deepspeed/runtime/swap_tensor/utils.py' 2022-12-01T20:37:15,711 adding 'deepspeed/runtime/zero/__init__.py' 2022-12-01T20:37:15,714 adding 'deepspeed/runtime/zero/config.py' 2022-12-01T20:37:15,719 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2022-12-01T20:37:15,722 adding 'deepspeed/runtime/zero/linear.py' 2022-12-01T20:37:15,725 adding 'deepspeed/runtime/zero/offload_config.py' 2022-12-01T20:37:15,731 adding 'deepspeed/runtime/zero/parameter_offload.py' 2022-12-01T20:37:15,750 adding 'deepspeed/runtime/zero/partition_parameters.py' 2022-12-01T20:37:15,757 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2022-12-01T20:37:15,788 adding 'deepspeed/runtime/zero/stage3.py' 2022-12-01T20:37:15,820 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2022-12-01T20:37:15,825 adding 'deepspeed/runtime/zero/test.py' 2022-12-01T20:37:15,829 adding 'deepspeed/runtime/zero/tiling.py' 2022-12-01T20:37:15,832 adding 'deepspeed/runtime/zero/utils.py' 2022-12-01T20:37:15,835 adding 'deepspeed/utils/__init__.py' 2022-12-01T20:37:15,838 adding 'deepspeed/utils/comms_logging.py' 2022-12-01T20:37:15,841 adding 'deepspeed/utils/debug.py' 2022-12-01T20:37:15,843 adding 'deepspeed/utils/exceptions.py' 2022-12-01T20:37:15,848 adding 'deepspeed/utils/groups.py' 2022-12-01T20:37:15,851 adding 'deepspeed/utils/init_on_device.py' 2022-12-01T20:37:15,853 adding 'deepspeed/utils/logging.py' 2022-12-01T20:37:15,856 adding 'deepspeed/utils/mixed_precision_linkage.py' 2022-12-01T20:37:15,858 adding 'deepspeed/utils/nvtx.py' 2022-12-01T20:37:15,861 adding 'deepspeed/utils/tensor_fragment.py' 2022-12-01T20:37:15,864 adding 'deepspeed/utils/timer.py' 2022-12-01T20:37:15,867 adding 'deepspeed/utils/types.py' 2022-12-01T20:37:15,872 adding 'deepspeed/utils/zero_to_fp32.py' 2022-12-01T20:37:15,876 adding 'deepspeed-0.7.6.data/scripts/deepspeed' 2022-12-01T20:37:15,879 adding 'deepspeed-0.7.6.data/scripts/deepspeed.pt' 2022-12-01T20:37:15,881 adding 'deepspeed-0.7.6.data/scripts/ds' 2022-12-01T20:37:15,883 adding 'deepspeed-0.7.6.data/scripts/ds_bench' 2022-12-01T20:37:15,885 adding 'deepspeed-0.7.6.data/scripts/ds_elastic' 2022-12-01T20:37:15,887 adding 'deepspeed-0.7.6.data/scripts/ds_report' 2022-12-01T20:37:15,890 adding 'deepspeed-0.7.6.data/scripts/ds_ssh' 2022-12-01T20:37:15,892 adding 'deepspeed-0.7.6.data/scripts/dsr' 2022-12-01T20:37:15,896 adding 'deepspeed-0.7.6.dist-info/LICENSE' 2022-12-01T20:37:15,903 adding 'deepspeed-0.7.6.dist-info/METADATA' 2022-12-01T20:37:15,905 adding 'deepspeed-0.7.6.dist-info/WHEEL' 2022-12-01T20:37:15,907 adding 'deepspeed-0.7.6.dist-info/entry_points.txt' 2022-12-01T20:37:15,909 adding 'deepspeed-0.7.6.dist-info/top_level.txt' 2022-12-01T20:37:15,922 adding 'deepspeed-0.7.6.dist-info/RECORD' 2022-12-01T20:37:15,962 removing build/bdist.linux-armv7l/wheel 2022-12-01T20:37:16,153 deepspeed build time = 11.12778639793396 secs 2022-12-01T20:37:16,418 Building wheel for deepspeed (setup.py): finished with status 'done' 2022-12-01T20:37:16,446 Created wheel for deepspeed: filename=deepspeed-0.7.6-py3-none-any.whl size=714364 sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c 2022-12-01T20:37:16,448 Stored in directory: /tmp/pip-ephem-wheel-cache-3z2zptii/wheels/7e/72/e3/200ada51e286d0670507a5f87ab3c2f2c373dd533bda435383 2022-12-01T20:37:16,509 Successfully built deepspeed 2022-12-01T20:37:16,567 Removed build tracker: '/tmp/pip-build-tracker-zcr1208s'