2022-12-12T21:05:17,158 Created temporary directory: /tmp/pip-ephem-wheel-cache-kmwlhwj8 2022-12-12T21:05:17,163 Created temporary directory: /tmp/pip-build-tracker-wn2n73p0 2022-12-12T21:05:17,164 Initialized build tracking at /tmp/pip-build-tracker-wn2n73p0 2022-12-12T21:05:17,164 Created build tracker: /tmp/pip-build-tracker-wn2n73p0 2022-12-12T21:05:17,164 Entered build tracker: /tmp/pip-build-tracker-wn2n73p0 2022-12-12T21:05:17,165 Created temporary directory: /tmp/pip-wheel-yxazsh_a 2022-12-12T21:05:17,173 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2022-12-12T21:05:17,178 Created temporary directory: /tmp/pip-ephem-wheel-cache-3787lbc9 2022-12-12T21:05:17,230 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2022-12-12T21:05:17,237 2 location(s) to search for versions of deepspeed: 2022-12-12T21:05:17,237 * https://pypi.org/simple/deepspeed/ 2022-12-12T21:05:17,237 * https://www.piwheels.org/simple/deepspeed/ 2022-12-12T21:05:17,238 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2022-12-12T21:05:17,239 Getting page https://pypi.org/simple/deepspeed/ 2022-12-12T21:05:17,242 Found index url https://pypi.org/simple 2022-12-12T21:05:17,430 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2022-12-12T21:05:17,460 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-12-12T21:05:17,461 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2022-12-12T21:05:17,462 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-12-12T21:05:17,462 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2022-12-12T21:05:17,463 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-12-12T21:05:17,464 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2022-12-12T21:05:17,464 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-12-12T21:05:17,465 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2022-12-12T21:05:17,466 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2022-12-12T21:05:17,466 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2022-12-12T21:05:17,467 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2022-12-12T21:05:17,468 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2022-12-12T21:05:17,468 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2022-12-12T21:05:17,469 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2022-12-12T21:05:17,470 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2022-12-12T21:05:17,471 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2022-12-12T21:05:17,471 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2022-12-12T21:05:17,472 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2022-12-12T21:05:17,473 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2022-12-12T21:05:17,473 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2022-12-12T21:05:17,474 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2022-12-12T21:05:17,475 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2022-12-12T21:05:17,475 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2022-12-12T21:05:17,476 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2022-12-12T21:05:17,477 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2022-12-12T21:05:17,478 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2022-12-12T21:05:17,478 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2022-12-12T21:05:17,479 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2022-12-12T21:05:17,480 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2022-12-12T21:05:17,480 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2022-12-12T21:05:17,481 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2022-12-12T21:05:17,482 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2022-12-12T21:05:17,482 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2022-12-12T21:05:17,483 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2022-12-12T21:05:17,484 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2022-12-12T21:05:17,485 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2022-12-12T21:05:17,485 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2022-12-12T21:05:17,486 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2022-12-12T21:05:17,487 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2022-12-12T21:05:17,487 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2022-12-12T21:05:17,488 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2022-12-12T21:05:17,489 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2022-12-12T21:05:17,489 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2022-12-12T21:05:17,490 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2022-12-12T21:05:17,491 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2022-12-12T21:05:17,492 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2022-12-12T21:05:17,492 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2022-12-12T21:05:17,493 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2022-12-12T21:05:17,494 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2022-12-12T21:05:17,498 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2022-12-12T21:05:17,499 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2022-12-12T21:05:17,500 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2022-12-12T21:05:17,500 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2022-12-12T21:05:17,501 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2022-12-12T21:05:17,502 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2022-12-12T21:05:17,503 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2022-12-12T21:05:17,503 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2022-12-12T21:05:17,504 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2022-12-12T21:05:17,505 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2022-12-12T21:05:17,505 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2022-12-12T21:05:17,506 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2022-12-12T21:05:17,507 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2022-12-12T21:05:17,508 Getting page https://www.piwheels.org/simple/deepspeed/ 2022-12-12T21:05:17,510 Found index url https://www.piwheels.org/simple 2022-12-12T21:05:18,918 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2022-12-12T21:05:18,941 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,942 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,942 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,943 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,944 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,944 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,945 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,945 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,946 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,946 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,947 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,947 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,948 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,948 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,949 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,950 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,950 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,951 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,951 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,952 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,952 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,953 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,953 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,954 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,954 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,955 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,955 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,956 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,956 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,957 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,957 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2022-12-12T21:05:18,958 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2022-12-12T21:05:18,959 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2022-12-12T21:05:19,011 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2022-12-12T21:05:19,041 Collecting deepspeed==0.7.7 2022-12-12T21:05:19,046 Created temporary directory: /tmp/pip-unpack-mzuyqqcb 2022-12-12T21:05:19,302 Downloading deepspeed-0.7.7.tar.gz (712 kB) 2022-12-12T21:05:21,742 Added deepspeed==0.7.7 from https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz to build tracker '/tmp/pip-build-tracker-wn2n73p0' 2022-12-12T21:05:21,745 Running setup.py (path:/tmp/pip-wheel-yxazsh_a/deepspeed_7653d1c80ad943169f6f752939864644/setup.py) egg_info for package deepspeed 2022-12-12T21:05:21,746 Created temporary directory: /tmp/pip-pip-egg-info-5uanyoec 2022-12-12T21:05:21,747 Preparing metadata (setup.py): started 2022-12-12T21:05:21,749 Running command python setup.py egg_info 2022-12-12T21:05:24,691 fatal: not a git repository (or any of the parent directories): .git 2022-12-12T21:05:25,809 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2022-12-12T21:05:25,809  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2022-12-12T21:05:25,810 DS_BUILD_OPS=0 2022-12-12T21:05:25,810  [WARNING]  unable to import torch, please install it first 2022-12-12T21:05:25,810  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2022-12-12T21:05:25,810  [WARNING]  async_io: please install the libaio-dev package with apt 2022-12-12T21:05:25,811  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2022-12-12T21:05:25,811  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-12-12T21:05:25,811  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-12-12T21:05:25,812 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'utils': False, 'quantizer': False, 'transformer_inference': False, 'spatial_inference': False} 2022-12-12T21:05:25,813 version=0.7.7, git_hash=unknown, git_branch=unknown 2022-12-12T21:05:25,813 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2022-12-12T21:05:25,814 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'utils': True, 'quantizer': True, 'transformer_inference': False, 'spatial_inference': False} 2022-12-12T21:05:25,814 ext_modules=[] 2022-12-12T21:05:25,814 running egg_info 2022-12-12T21:05:25,815 creating /tmp/pip-pip-egg-info-5uanyoec/deepspeed.egg-info 2022-12-12T21:05:25,875 writing /tmp/pip-pip-egg-info-5uanyoec/deepspeed.egg-info/PKG-INFO 2022-12-12T21:05:25,881 writing dependency_links to /tmp/pip-pip-egg-info-5uanyoec/deepspeed.egg-info/dependency_links.txt 2022-12-12T21:05:25,885 writing entry points to /tmp/pip-pip-egg-info-5uanyoec/deepspeed.egg-info/entry_points.txt 2022-12-12T21:05:25,890 writing requirements to /tmp/pip-pip-egg-info-5uanyoec/deepspeed.egg-info/requires.txt 2022-12-12T21:05:25,892 writing top-level names to /tmp/pip-pip-egg-info-5uanyoec/deepspeed.egg-info/top_level.txt 2022-12-12T21:05:25,894 writing manifest file '/tmp/pip-pip-egg-info-5uanyoec/deepspeed.egg-info/SOURCES.txt' 2022-12-12T21:05:26,232 reading manifest file '/tmp/pip-pip-egg-info-5uanyoec/deepspeed.egg-info/SOURCES.txt' 2022-12-12T21:05:26,235 reading manifest template 'MANIFEST.in' 2022-12-12T21:05:27,345 warning: no files found matching '*.hip' under directory 'deepspeed' 2022-12-12T21:05:28,186 warning: no files found matching '*.cc' under directory 'deepspeed' 2022-12-12T21:05:28,761 warning: no files found matching '*.tr' under directory 'csrc' 2022-12-12T21:05:28,902 warning: no files found matching '*.cc' under directory 'csrc' 2022-12-12T21:05:28,941 adding license file 'LICENSE' 2022-12-12T21:05:28,988 writing manifest file '/tmp/pip-pip-egg-info-5uanyoec/deepspeed.egg-info/SOURCES.txt' 2022-12-12T21:05:28,991 deepspeed build time = 4.288293123245239 secs 2022-12-12T21:05:29,206 Preparing metadata (setup.py): finished with status 'done' 2022-12-12T21:05:29,226 Source in /tmp/pip-wheel-yxazsh_a/deepspeed_7653d1c80ad943169f6f752939864644 has version 0.7.7, which satisfies requirement deepspeed==0.7.7 from https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz 2022-12-12T21:05:29,228 Removed deepspeed==0.7.7 from https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz from build tracker '/tmp/pip-build-tracker-wn2n73p0' 2022-12-12T21:05:29,244 Created temporary directory: /tmp/pip-unpack-8dfc_ibw 2022-12-12T21:05:29,246 Building wheels for collected packages: deepspeed 2022-12-12T21:05:29,255 Created temporary directory: /tmp/pip-wheel-gwk8zcq3 2022-12-12T21:05:29,256 Building wheel for deepspeed (setup.py): started 2022-12-12T21:05:29,258 Destination directory: /tmp/pip-wheel-gwk8zcq3 2022-12-12T21:05:29,258 Running command python setup.py bdist_wheel 2022-12-12T21:05:31,289 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2022-12-12T21:05:31,311  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2022-12-12T21:05:31,354 DS_BUILD_OPS=0 2022-12-12T21:05:31,356  [WARNING]  unable to import torch, please install it first 2022-12-12T21:05:31,653  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2022-12-12T21:05:31,825  [WARNING]  async_io: please install the libaio-dev package with apt 2022-12-12T21:05:31,826  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2022-12-12T21:05:31,829  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-12-12T21:05:31,830  [WARNING]  Please install torch if trying to pre-compile inference kernels 2022-12-12T21:05:31,831 Install Ops={'cpu_adam': False, 'cpu_adagrad': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'utils': False, 'quantizer': False, 'transformer_inference': False, 'spatial_inference': False} 2022-12-12T21:05:31,873 fatal: not a git repository (or any of the parent directories): .git 2022-12-12T21:05:31,878 version=0.7.7, git_hash=unknown, git_branch=unknown 2022-12-12T21:05:31,880 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2022-12-12T21:05:31,880 compatible_ops={'cpu_adam': True, 'cpu_adagrad': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'utils': True, 'quantizer': True, 'transformer_inference': False, 'spatial_inference': False} 2022-12-12T21:05:31,881 ext_modules=[] 2022-12-12T21:05:33,007 running bdist_wheel 2022-12-12T21:05:33,760 running build 2022-12-12T21:05:33,761 running build_py 2022-12-12T21:05:33,829 creating build 2022-12-12T21:05:33,830 creating build/lib 2022-12-12T21:05:33,831 creating build/lib/benchmarks 2022-12-12T21:05:33,833 copying benchmarks/__init__.py -> build/lib/benchmarks 2022-12-12T21:05:33,838 creating build/lib/deepspeed 2022-12-12T21:05:33,839 copying deepspeed/__init__.py -> build/lib/deepspeed 2022-12-12T21:05:33,844 copying deepspeed/constants.py -> build/lib/deepspeed 2022-12-12T21:05:33,847 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2022-12-12T21:05:33,850 copying deepspeed/env_report.py -> build/lib/deepspeed 2022-12-12T21:05:33,854 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2022-12-12T21:05:33,859 creating build/lib/benchmarks/communication 2022-12-12T21:05:33,860 copying benchmarks/communication/all_reduce.py -> build/lib/benchmarks/communication 2022-12-12T21:05:33,864 copying benchmarks/communication/all_gather.py -> build/lib/benchmarks/communication 2022-12-12T21:05:33,868 copying benchmarks/communication/__init__.py -> build/lib/benchmarks/communication 2022-12-12T21:05:33,870 copying benchmarks/communication/broadcast.py -> build/lib/benchmarks/communication 2022-12-12T21:05:33,874 copying benchmarks/communication/constants.py -> build/lib/benchmarks/communication 2022-12-12T21:05:33,877 copying benchmarks/communication/all_to_all.py -> build/lib/benchmarks/communication 2022-12-12T21:05:33,880 copying benchmarks/communication/utils.py -> build/lib/benchmarks/communication 2022-12-12T21:05:33,884 copying benchmarks/communication/pt2pt.py -> build/lib/benchmarks/communication 2022-12-12T21:05:33,888 copying benchmarks/communication/run_all.py -> build/lib/benchmarks/communication 2022-12-12T21:05:33,893 creating build/lib/deepspeed/monitor 2022-12-12T21:05:33,895 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2022-12-12T21:05:33,898 copying deepspeed/monitor/constants.py -> build/lib/deepspeed/monitor 2022-12-12T21:05:33,901 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2022-12-12T21:05:33,904 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2022-12-12T21:05:33,907 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2022-12-12T21:05:33,910 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2022-12-12T21:05:33,913 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2022-12-12T21:05:33,916 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2022-12-12T21:05:33,921 creating build/lib/deepspeed/nebula 2022-12-12T21:05:33,922 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2022-12-12T21:05:33,925 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2022-12-12T21:05:33,928 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2022-12-12T21:05:33,933 creating build/lib/deepspeed/runtime 2022-12-12T21:05:33,935 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,939 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,942 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,953 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,957 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,961 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,966 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,973 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,976 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,981 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,985 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,988 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,994 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:33,997 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:34,001 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2022-12-12T21:05:34,006 creating build/lib/deepspeed/module_inject 2022-12-12T21:05:34,007 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2022-12-12T21:05:34,010 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2022-12-12T21:05:34,014 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2022-12-12T21:05:34,017 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2022-12-12T21:05:34,022 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2022-12-12T21:05:34,026 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2022-12-12T21:05:34,031 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2022-12-12T21:05:34,039 creating build/lib/deepspeed/ops 2022-12-12T21:05:34,040 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2022-12-12T21:05:34,045 creating build/lib/deepspeed/compression 2022-12-12T21:05:34,046 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2022-12-12T21:05:34,049 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2022-12-12T21:05:34,055 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2022-12-12T21:05:34,059 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2022-12-12T21:05:34,064 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2022-12-12T21:05:34,069 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2022-12-12T21:05:34,073 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2022-12-12T21:05:34,079 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2022-12-12T21:05:34,084 creating build/lib/deepspeed/inference 2022-12-12T21:05:34,086 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2022-12-12T21:05:34,089 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2022-12-12T21:05:34,093 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2022-12-12T21:05:34,099 creating build/lib/deepspeed/elasticity 2022-12-12T21:05:34,100 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2022-12-12T21:05:34,104 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2022-12-12T21:05:34,107 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2022-12-12T21:05:34,111 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2022-12-12T21:05:34,115 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2022-12-12T21:05:34,119 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2022-12-12T21:05:34,126 creating build/lib/deepspeed/utils 2022-12-12T21:05:34,127 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,132 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,135 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,138 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,141 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,144 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,147 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,150 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,153 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,157 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,160 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,164 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,168 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2022-12-12T21:05:34,172 creating build/lib/deepspeed/moe 2022-12-12T21:05:34,174 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2022-12-12T21:05:34,176 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2022-12-12T21:05:34,180 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2022-12-12T21:05:34,184 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2022-12-12T21:05:34,187 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2022-12-12T21:05:34,191 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2022-12-12T21:05:34,196 creating build/lib/deepspeed/launcher 2022-12-12T21:05:34,197 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2022-12-12T21:05:34,202 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2022-12-12T21:05:34,204 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2022-12-12T21:05:34,207 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2022-12-12T21:05:34,211 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2022-12-12T21:05:34,217 creating build/lib/deepspeed/model_implementations 2022-12-12T21:05:34,219 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2022-12-12T21:05:34,223 creating build/lib/deepspeed/accelerator 2022-12-12T21:05:34,225 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2022-12-12T21:05:34,230 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2022-12-12T21:05:34,234 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2022-12-12T21:05:34,238 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2022-12-12T21:05:34,244 creating build/lib/deepspeed/autotuning 2022-12-12T21:05:34,246 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2022-12-12T21:05:34,250 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2022-12-12T21:05:34,254 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2022-12-12T21:05:34,259 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2022-12-12T21:05:34,264 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2022-12-12T21:05:34,269 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2022-12-12T21:05:34,277 creating build/lib/deepspeed/profiling 2022-12-12T21:05:34,279 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2022-12-12T21:05:34,283 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2022-12-12T21:05:34,286 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2022-12-12T21:05:34,292 creating build/lib/deepspeed/checkpoint 2022-12-12T21:05:34,294 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2022-12-12T21:05:34,298 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2022-12-12T21:05:34,302 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2022-12-12T21:05:34,306 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-12-12T21:05:34,311 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-12-12T21:05:34,315 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2022-12-12T21:05:34,319 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2022-12-12T21:05:34,323 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2022-12-12T21:05:34,327 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2022-12-12T21:05:34,333 creating build/lib/deepspeed/pipe 2022-12-12T21:05:34,335 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2022-12-12T21:05:34,340 creating build/lib/deepspeed/comm 2022-12-12T21:05:34,342 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2022-12-12T21:05:34,347 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2022-12-12T21:05:34,350 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2022-12-12T21:05:34,354 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2022-12-12T21:05:34,358 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2022-12-12T21:05:34,362 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2022-12-12T21:05:34,367 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2022-12-12T21:05:34,374 creating build/lib/deepspeed/runtime/compression 2022-12-12T21:05:34,376 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2022-12-12T21:05:34,380 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2022-12-12T21:05:34,386 creating build/lib/deepspeed/runtime/swap_tensor 2022-12-12T21:05:34,388 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-12T21:05:34,392 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-12T21:05:34,396 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-12T21:05:34,401 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-12T21:05:34,406 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-12T21:05:34,411 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-12T21:05:34,414 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-12T21:05:34,419 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-12T21:05:34,425 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2022-12-12T21:05:34,431 creating build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,433 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,437 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,441 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,445 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,449 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,453 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,458 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,463 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,466 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,474 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,478 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,488 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,499 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2022-12-12T21:05:34,507 creating build/lib/deepspeed/runtime/fp16 2022-12-12T21:05:34,508 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2022-12-12T21:05:34,511 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2022-12-12T21:05:34,516 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2022-12-12T21:05:34,521 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2022-12-12T21:05:34,527 creating build/lib/deepspeed/runtime/data_pipeline 2022-12-12T21:05:34,529 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2022-12-12T21:05:34,532 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2022-12-12T21:05:34,537 creating build/lib/deepspeed/runtime/activation_checkpointing 2022-12-12T21:05:34,539 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-12-12T21:05:34,542 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-12-12T21:05:34,545 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2022-12-12T21:05:34,553 creating build/lib/deepspeed/runtime/pipe 2022-12-12T21:05:34,554 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2022-12-12T21:05:34,558 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2022-12-12T21:05:34,565 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2022-12-12T21:05:34,569 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2022-12-12T21:05:34,576 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2022-12-12T21:05:34,581 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2022-12-12T21:05:34,588 creating build/lib/deepspeed/runtime/comm 2022-12-12T21:05:34,589 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2022-12-12T21:05:34,593 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2022-12-12T21:05:34,596 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2022-12-12T21:05:34,600 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2022-12-12T21:05:34,606 creating build/lib/deepspeed/runtime/checkpoint_engine 2022-12-12T21:05:34,608 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-12-12T21:05:34,611 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-12-12T21:05:34,614 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-12-12T21:05:34,618 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2022-12-12T21:05:34,623 creating build/lib/deepspeed/runtime/fp16/onebit 2022-12-12T21:05:34,625 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-12-12T21:05:34,630 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-12-12T21:05:34,634 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-12-12T21:05:34,640 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2022-12-12T21:05:34,647 creating build/lib/deepspeed/ops/adam 2022-12-12T21:05:34,648 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2022-12-12T21:05:34,653 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2022-12-12T21:05:34,657 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2022-12-12T21:05:34,660 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2022-12-12T21:05:34,666 creating build/lib/deepspeed/ops/adagrad 2022-12-12T21:05:34,667 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2022-12-12T21:05:34,671 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2022-12-12T21:05:34,676 creating build/lib/deepspeed/ops/transformer 2022-12-12T21:05:34,677 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2022-12-12T21:05:34,681 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2022-12-12T21:05:34,687 creating build/lib/deepspeed/ops/quantizer 2022-12-12T21:05:34,688 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2022-12-12T21:05:34,692 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2022-12-12T21:05:34,698 creating build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,700 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,703 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,707 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,710 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,713 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,717 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,720 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,723 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,727 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,730 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,733 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,739 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,742 copying deepspeed/ops/op_builder/builder_names.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,746 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,749 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,752 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2022-12-12T21:05:34,757 creating build/lib/deepspeed/ops/lamb 2022-12-12T21:05:34,758 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2022-12-12T21:05:34,762 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2022-12-12T21:05:34,767 creating build/lib/deepspeed/ops/aio 2022-12-12T21:05:34,769 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2022-12-12T21:05:34,774 creating build/lib/deepspeed/ops/sparse_attention 2022-12-12T21:05:34,775 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-12T21:05:34,779 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-12T21:05:34,785 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-12T21:05:34,789 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-12T21:05:34,794 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-12T21:05:34,800 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-12T21:05:34,804 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2022-12-12T21:05:34,810 creating build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,811 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,817 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,820 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,823 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,828 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,832 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,836 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,840 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,844 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,849 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2022-12-12T21:05:34,855 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2022-12-12T21:05:34,856 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-12-12T21:05:34,861 creating build/lib/deepspeed/model_implementations/transformers 2022-12-12T21:05:34,862 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2022-12-12T21:05:34,865 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2022-12-12T21:05:34,870 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2022-12-12T21:05:34,874 creating build/lib/deepspeed/model_implementations/diffusers 2022-12-12T21:05:34,876 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2022-12-12T21:05:34,879 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2022-12-12T21:05:34,883 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2022-12-12T21:05:34,888 creating build/lib/deepspeed/autotuning/tuner 2022-12-12T21:05:34,889 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2022-12-12T21:05:34,893 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2022-12-12T21:05:34,897 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-12-12T21:05:34,901 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-12-12T21:05:34,904 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2022-12-12T21:05:34,908 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2022-12-12T21:05:34,912 creating build/lib/deepspeed/profiling/flops_profiler 2022-12-12T21:05:34,914 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2022-12-12T21:05:34,917 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2022-12-12T21:05:34,924 running egg_info 2022-12-12T21:05:35,050 writing deepspeed.egg-info/PKG-INFO 2022-12-12T21:05:35,055 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2022-12-12T21:05:35,060 writing entry points to deepspeed.egg-info/entry_points.txt 2022-12-12T21:05:35,064 writing requirements to deepspeed.egg-info/requires.txt 2022-12-12T21:05:35,067 writing top-level names to deepspeed.egg-info/top_level.txt 2022-12-12T21:05:35,206 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2022-12-12T21:05:35,285 reading manifest template 'MANIFEST.in' 2022-12-12T21:05:36,369 warning: no files found matching '*.hip' under directory 'deepspeed' 2022-12-12T21:05:37,181 warning: no files found matching '*.cc' under directory 'deepspeed' 2022-12-12T21:05:37,744 warning: no files found matching '*.tr' under directory 'csrc' 2022-12-12T21:05:37,889 warning: no files found matching '*.cc' under directory 'csrc' 2022-12-12T21:05:37,928 adding license file 'LICENSE' 2022-12-12T21:05:37,991 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2022-12-12T21:05:37,998 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'benchmarks.inference' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:37,998 !! 2022-12-12T21:05:37,999 ############################ 2022-12-12T21:05:38,000 # Package would be ignored # 2022-12-12T21:05:38,000 ############################ 2022-12-12T21:05:38,000 Python recognizes 'benchmarks.inference' as an importable package, 2022-12-12T21:05:38,000 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,001 'benchmarks.inference' has been automatically added to the distribution only 2022-12-12T21:05:38,001 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,002 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,002 Please make sure that 'benchmarks.inference' is included as a package by using 2022-12-12T21:05:38,002 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,003 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,003 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,004 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,004 documentation page. 2022-12-12T21:05:38,005 !! 2022-12-12T21:05:38,005 check.warn(importable) 2022-12-12T21:05:38,014 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.autotuning.config_templates' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,014 !! 2022-12-12T21:05:38,015 ############################ 2022-12-12T21:05:38,015 # Package would be ignored # 2022-12-12T21:05:38,016 ############################ 2022-12-12T21:05:38,016 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, 2022-12-12T21:05:38,016 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,017 'deepspeed.autotuning.config_templates' has been automatically added to the distribution only 2022-12-12T21:05:38,017 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,017 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,018 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2022-12-12T21:05:38,018 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,019 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,019 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,019 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,020 documentation page. 2022-12-12T21:05:38,021 !! 2022-12-12T21:05:38,021 check.warn(importable) 2022-12-12T21:05:38,022 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adagrad' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,022 !! 2022-12-12T21:05:38,023 ############################ 2022-12-12T21:05:38,023 # Package would be ignored # 2022-12-12T21:05:38,024 ############################ 2022-12-12T21:05:38,024 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, 2022-12-12T21:05:38,024 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,025 'deepspeed.ops.csrc.adagrad' has been automatically added to the distribution only 2022-12-12T21:05:38,025 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,025 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,026 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2022-12-12T21:05:38,026 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,027 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,027 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,027 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,028 documentation page. 2022-12-12T21:05:38,029 !! 2022-12-12T21:05:38,029 check.warn(importable) 2022-12-12T21:05:38,029 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adam' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,030 !! 2022-12-12T21:05:38,031 ############################ 2022-12-12T21:05:38,031 # Package would be ignored # 2022-12-12T21:05:38,031 ############################ 2022-12-12T21:05:38,031 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, 2022-12-12T21:05:38,032 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,032 'deepspeed.ops.csrc.adam' has been automatically added to the distribution only 2022-12-12T21:05:38,033 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,033 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,034 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2022-12-12T21:05:38,034 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,034 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,034 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,035 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,035 documentation page. 2022-12-12T21:05:38,036 !! 2022-12-12T21:05:38,037 check.warn(importable) 2022-12-12T21:05:38,037 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.common' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,037 !! 2022-12-12T21:05:38,038 ############################ 2022-12-12T21:05:38,039 # Package would be ignored # 2022-12-12T21:05:38,039 ############################ 2022-12-12T21:05:38,039 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, 2022-12-12T21:05:38,039 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,040 'deepspeed.ops.csrc.aio.common' has been automatically added to the distribution only 2022-12-12T21:05:38,040 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,041 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,041 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2022-12-12T21:05:38,041 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,042 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,042 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,043 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,043 documentation page. 2022-12-12T21:05:38,044 !! 2022-12-12T21:05:38,044 check.warn(importable) 2022-12-12T21:05:38,045 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_lib' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,045 !! 2022-12-12T21:05:38,046 ############################ 2022-12-12T21:05:38,046 # Package would be ignored # 2022-12-12T21:05:38,047 ############################ 2022-12-12T21:05:38,047 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, 2022-12-12T21:05:38,047 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,048 'deepspeed.ops.csrc.aio.py_lib' has been automatically added to the distribution only 2022-12-12T21:05:38,048 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,048 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,049 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2022-12-12T21:05:38,049 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,050 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,050 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,050 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,051 documentation page. 2022-12-12T21:05:38,051 !! 2022-12-12T21:05:38,052 check.warn(importable) 2022-12-12T21:05:38,052 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_test' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,053 !! 2022-12-12T21:05:38,054 ############################ 2022-12-12T21:05:38,054 # Package would be ignored # 2022-12-12T21:05:38,054 ############################ 2022-12-12T21:05:38,054 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, 2022-12-12T21:05:38,055 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,055 'deepspeed.ops.csrc.aio.py_test' has been automatically added to the distribution only 2022-12-12T21:05:38,056 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,056 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,056 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2022-12-12T21:05:38,057 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,057 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,057 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,058 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,058 documentation page. 2022-12-12T21:05:38,059 !! 2022-12-12T21:05:38,060 check.warn(importable) 2022-12-12T21:05:38,060 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.common' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,060 !! 2022-12-12T21:05:38,061 ############################ 2022-12-12T21:05:38,061 # Package would be ignored # 2022-12-12T21:05:38,062 ############################ 2022-12-12T21:05:38,062 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, 2022-12-12T21:05:38,062 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,063 'deepspeed.ops.csrc.common' has been automatically added to the distribution only 2022-12-12T21:05:38,063 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,063 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,064 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2022-12-12T21:05:38,064 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,064 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,065 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,065 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,066 documentation page. 2022-12-12T21:05:38,066 !! 2022-12-12T21:05:38,067 check.warn(importable) 2022-12-12T21:05:38,067 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.includes' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,068 !! 2022-12-12T21:05:38,068 ############################ 2022-12-12T21:05:38,069 # Package would be ignored # 2022-12-12T21:05:38,069 ############################ 2022-12-12T21:05:38,069 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, 2022-12-12T21:05:38,070 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,070 'deepspeed.ops.csrc.includes' has been automatically added to the distribution only 2022-12-12T21:05:38,070 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,071 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,071 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2022-12-12T21:05:38,072 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,072 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,072 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,073 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,073 documentation page. 2022-12-12T21:05:38,074 !! 2022-12-12T21:05:38,075 check.warn(importable) 2022-12-12T21:05:38,075 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.lamb' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,075 !! 2022-12-12T21:05:38,076 ############################ 2022-12-12T21:05:38,076 # Package would be ignored # 2022-12-12T21:05:38,077 ############################ 2022-12-12T21:05:38,077 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, 2022-12-12T21:05:38,077 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,078 'deepspeed.ops.csrc.lamb' has been automatically added to the distribution only 2022-12-12T21:05:38,078 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,079 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,079 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2022-12-12T21:05:38,080 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,080 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,080 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,081 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,081 documentation page. 2022-12-12T21:05:38,082 !! 2022-12-12T21:05:38,083 check.warn(importable) 2022-12-12T21:05:38,083 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.quantization' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,084 !! 2022-12-12T21:05:38,085 ############################ 2022-12-12T21:05:38,085 # Package would be ignored # 2022-12-12T21:05:38,085 ############################ 2022-12-12T21:05:38,086 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, 2022-12-12T21:05:38,086 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,087 'deepspeed.ops.csrc.quantization' has been automatically added to the distribution only 2022-12-12T21:05:38,087 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,087 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,088 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2022-12-12T21:05:38,088 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,089 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,089 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,090 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,090 documentation page. 2022-12-12T21:05:38,091 !! 2022-12-12T21:05:38,091 check.warn(importable) 2022-12-12T21:05:38,092 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.sparse_attention' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,092 !! 2022-12-12T21:05:38,093 ############################ 2022-12-12T21:05:38,093 # Package would be ignored # 2022-12-12T21:05:38,094 ############################ 2022-12-12T21:05:38,094 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, 2022-12-12T21:05:38,094 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,095 'deepspeed.ops.csrc.sparse_attention' has been automatically added to the distribution only 2022-12-12T21:05:38,095 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,096 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,096 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2022-12-12T21:05:38,097 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,097 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,097 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,098 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,098 documentation page. 2022-12-12T21:05:38,099 !! 2022-12-12T21:05:38,100 check.warn(importable) 2022-12-12T21:05:38,100 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.csrc' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,100 !! 2022-12-12T21:05:38,101 ############################ 2022-12-12T21:05:38,102 # Package would be ignored # 2022-12-12T21:05:38,102 ############################ 2022-12-12T21:05:38,102 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package, 2022-12-12T21:05:38,103 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,103 'deepspeed.ops.csrc.spatial.csrc' has been automatically added to the distribution only 2022-12-12T21:05:38,104 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,104 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,105 Please make sure that 'deepspeed.ops.csrc.spatial.csrc' is included as a package by using 2022-12-12T21:05:38,105 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,105 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,106 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,106 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,107 documentation page. 2022-12-12T21:05:38,108 !! 2022-12-12T21:05:38,108 check.warn(importable) 2022-12-12T21:05:38,109 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.includes' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,109 !! 2022-12-12T21:05:38,110 ############################ 2022-12-12T21:05:38,110 # Package would be ignored # 2022-12-12T21:05:38,110 ############################ 2022-12-12T21:05:38,111 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package, 2022-12-12T21:05:38,111 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,112 'deepspeed.ops.csrc.spatial.includes' has been automatically added to the distribution only 2022-12-12T21:05:38,112 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,112 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,113 Please make sure that 'deepspeed.ops.csrc.spatial.includes' is included as a package by using 2022-12-12T21:05:38,113 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,114 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,114 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,115 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,115 documentation page. 2022-12-12T21:05:38,116 !! 2022-12-12T21:05:38,116 check.warn(importable) 2022-12-12T21:05:38,117 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,117 !! 2022-12-12T21:05:38,118 ############################ 2022-12-12T21:05:38,118 # Package would be ignored # 2022-12-12T21:05:38,119 ############################ 2022-12-12T21:05:38,119 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, 2022-12-12T21:05:38,119 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,120 'deepspeed.ops.csrc.transformer' has been automatically added to the distribution only 2022-12-12T21:05:38,120 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,121 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,121 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2022-12-12T21:05:38,122 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,122 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,122 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,123 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,123 documentation page. 2022-12-12T21:05:38,124 !! 2022-12-12T21:05:38,125 check.warn(importable) 2022-12-12T21:05:38,125 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.csrc' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,125 !! 2022-12-12T21:05:38,126 ############################ 2022-12-12T21:05:38,127 # Package would be ignored # 2022-12-12T21:05:38,127 ############################ 2022-12-12T21:05:38,127 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, 2022-12-12T21:05:38,128 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,128 'deepspeed.ops.csrc.transformer.inference.csrc' has been automatically added to the distribution only 2022-12-12T21:05:38,129 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,129 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,130 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2022-12-12T21:05:38,130 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,130 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,130 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,131 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,131 documentation page. 2022-12-12T21:05:38,132 !! 2022-12-12T21:05:38,133 check.warn(importable) 2022-12-12T21:05:38,133 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.includes' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,134 !! 2022-12-12T21:05:38,135 ############################ 2022-12-12T21:05:38,135 # Package would be ignored # 2022-12-12T21:05:38,135 ############################ 2022-12-12T21:05:38,136 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, 2022-12-12T21:05:38,136 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,137 'deepspeed.ops.csrc.transformer.inference.includes' has been automatically added to the distribution only 2022-12-12T21:05:38,137 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,137 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,138 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2022-12-12T21:05:38,138 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,139 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,139 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,139 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,140 documentation page. 2022-12-12T21:05:38,141 !! 2022-12-12T21:05:38,141 check.warn(importable) 2022-12-12T21:05:38,142 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.utils' as data is deprecated, please list it in `packages`. 2022-12-12T21:05:38,142 !! 2022-12-12T21:05:38,143 ############################ 2022-12-12T21:05:38,143 # Package would be ignored # 2022-12-12T21:05:38,144 ############################ 2022-12-12T21:05:38,144 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, 2022-12-12T21:05:38,144 but it is not listed in the `packages` configuration of setuptools. 2022-12-12T21:05:38,145 'deepspeed.ops.csrc.utils' has been automatically added to the distribution only 2022-12-12T21:05:38,145 because it may contain data files, but this behavior is likely to change 2022-12-12T21:05:38,146 in future versions of setuptools (and therefore is considered deprecated). 2022-12-12T21:05:38,146 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2022-12-12T21:05:38,147 the `packages` configuration field or the proper discovery methods 2022-12-12T21:05:38,147 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2022-12-12T21:05:38,147 instead of `find_packages(...)`/`find:`). 2022-12-12T21:05:38,148 You can read more about "package discovery" and "data files" on setuptools 2022-12-12T21:05:38,148 documentation page. 2022-12-12T21:05:38,149 !! 2022-12-12T21:05:38,150 check.warn(importable) 2022-12-12T21:05:38,150 creating build/lib/benchmarks/inference 2022-12-12T21:05:38,150 copying benchmarks/inference/bert-bench.py -> build/lib/benchmarks/inference 2022-12-12T21:05:38,151 copying benchmarks/inference/collect_results.py -> build/lib/benchmarks/inference 2022-12-12T21:05:38,151 copying benchmarks/inference/gpt-bench.py -> build/lib/benchmarks/inference 2022-12-12T21:05:38,151 creating build/lib/deepspeed/ops/csrc 2022-12-12T21:05:38,152 creating build/lib/deepspeed/ops/csrc/adagrad 2022-12-12T21:05:38,152 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2022-12-12T21:05:38,152 creating build/lib/deepspeed/ops/csrc/adam 2022-12-12T21:05:38,153 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2022-12-12T21:05:38,153 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2022-12-12T21:05:38,154 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2022-12-12T21:05:38,154 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2022-12-12T21:05:38,154 creating build/lib/deepspeed/ops/csrc/aio 2022-12-12T21:05:38,154 creating build/lib/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:38,155 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:38,155 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:38,155 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:38,156 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:38,156 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:38,156 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:38,157 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:38,157 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:38,162 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:38,166 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:38,171 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:38,175 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:38,180 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:38,184 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:38,188 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:38,193 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:38,197 creating build/lib/deepspeed/ops/csrc/aio/py_test 2022-12-12T21:05:38,198 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2022-12-12T21:05:38,202 creating build/lib/deepspeed/ops/csrc/common 2022-12-12T21:05:38,204 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2022-12-12T21:05:38,209 creating build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,210 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,214 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,218 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,222 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,227 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,232 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,236 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,240 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,244 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,249 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,254 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,257 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,261 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,265 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,269 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,273 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,277 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,281 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,286 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,291 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,294 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,299 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,302 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,307 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,311 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,315 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,320 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2022-12-12T21:05:38,324 creating build/lib/deepspeed/ops/csrc/lamb 2022-12-12T21:05:38,325 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2022-12-12T21:05:38,329 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2022-12-12T21:05:38,333 creating build/lib/deepspeed/ops/csrc/quantization 2022-12-12T21:05:38,335 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2022-12-12T21:05:38,339 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2022-12-12T21:05:38,345 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2022-12-12T21:05:38,349 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2022-12-12T21:05:38,354 creating build/lib/deepspeed/ops/csrc/sparse_attention 2022-12-12T21:05:38,355 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2022-12-12T21:05:38,360 creating build/lib/deepspeed/ops/csrc/spatial 2022-12-12T21:05:38,360 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2022-12-12T21:05:38,362 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2022-12-12T21:05:38,366 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2022-12-12T21:05:38,370 creating build/lib/deepspeed/ops/csrc/spatial/includes 2022-12-12T21:05:38,371 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2022-12-12T21:05:38,375 creating build/lib/deepspeed/ops/csrc/transformer 2022-12-12T21:05:38,377 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-12T21:05:38,382 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-12T21:05:38,387 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2022-12-12T21:05:38,393 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-12T21:05:38,398 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-12T21:05:38,402 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-12T21:05:38,410 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-12T21:05:38,415 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2022-12-12T21:05:38,421 creating build/lib/deepspeed/ops/csrc/transformer/inference 2022-12-12T21:05:38,421 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:38,423 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:38,428 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:38,432 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:38,438 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:38,444 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:38,452 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:38,455 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:38,461 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:38,466 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-12-12T21:05:38,468 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-12-12T21:05:38,473 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-12-12T21:05:38,477 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2022-12-12T21:05:38,482 creating build/lib/deepspeed/ops/csrc/utils 2022-12-12T21:05:38,483 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2022-12-12T21:05:38,487 creating build/lib/deepspeed/autotuning/config_templates 2022-12-12T21:05:38,488 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2022-12-12T21:05:38,492 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2022-12-12T21:05:38,495 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2022-12-12T21:05:38,499 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2022-12-12T21:05:38,502 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-12-12T21:05:38,507 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-12-12T21:05:38,510 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2022-12-12T21:05:38,575 running build_scripts 2022-12-12T21:05:38,576 creating build/scripts-3.7 2022-12-12T21:05:38,577 copying and adjusting bin/deepspeed -> build/scripts-3.7 2022-12-12T21:05:38,580 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2022-12-12T21:05:38,583 copying and adjusting bin/ds -> build/scripts-3.7 2022-12-12T21:05:38,586 copying bin/ds_ssh -> build/scripts-3.7 2022-12-12T21:05:38,589 copying and adjusting bin/ds_report -> build/scripts-3.7 2022-12-12T21:05:38,592 copying and adjusting bin/ds_bench -> build/scripts-3.7 2022-12-12T21:05:38,594 copying and adjusting bin/dsr -> build/scripts-3.7 2022-12-12T21:05:38,596 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2022-12-12T21:05:38,598 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2022-12-12T21:05:38,599 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2022-12-12T21:05:38,599 changing mode of build/scripts-3.7/ds from 644 to 755 2022-12-12T21:05:38,600 changing mode of build/scripts-3.7/ds_report from 644 to 755 2022-12-12T21:05:38,600 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2022-12-12T21:05:38,601 changing mode of build/scripts-3.7/dsr from 644 to 755 2022-12-12T21:05:38,601 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2022-12-12T21:05:38,669 /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2022-12-12T21:05:38,670 setuptools.SetuptoolsDeprecationWarning, 2022-12-12T21:05:38,733 installing to build/bdist.linux-armv7l/wheel 2022-12-12T21:05:38,733 running install 2022-12-12T21:05:38,794 running install_lib 2022-12-12T21:05:38,859 creating build/bdist.linux-armv7l 2022-12-12T21:05:38,860 creating build/bdist.linux-armv7l/wheel 2022-12-12T21:05:38,863 creating build/bdist.linux-armv7l/wheel/benchmarks 2022-12-12T21:05:38,864 copying build/lib/benchmarks/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks 2022-12-12T21:05:38,868 creating build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-12-12T21:05:38,870 copying build/lib/benchmarks/inference/collect_results.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-12-12T21:05:38,874 copying build/lib/benchmarks/inference/gpt-bench.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-12-12T21:05:38,878 copying build/lib/benchmarks/inference/bert-bench.py -> build/bdist.linux-armv7l/wheel/benchmarks/inference 2022-12-12T21:05:38,882 creating build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-12T21:05:38,884 copying build/lib/benchmarks/communication/all_reduce.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-12T21:05:38,887 copying build/lib/benchmarks/communication/all_gather.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-12T21:05:38,891 copying build/lib/benchmarks/communication/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-12T21:05:38,893 copying build/lib/benchmarks/communication/broadcast.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-12T21:05:38,897 copying build/lib/benchmarks/communication/constants.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-12T21:05:38,900 copying build/lib/benchmarks/communication/all_to_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-12T21:05:38,904 copying build/lib/benchmarks/communication/utils.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-12T21:05:38,908 copying build/lib/benchmarks/communication/pt2pt.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-12T21:05:38,911 copying build/lib/benchmarks/communication/run_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2022-12-12T21:05:38,916 creating build/bdist.linux-armv7l/wheel/deepspeed 2022-12-12T21:05:38,918 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-12T21:05:38,920 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-12T21:05:38,923 copying build/lib/deepspeed/monitor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-12T21:05:38,926 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-12T21:05:38,929 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-12T21:05:38,932 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-12T21:05:38,935 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-12T21:05:38,938 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-12T21:05:38,942 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2022-12-12T21:05:38,945 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-12-12T21:05:38,950 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-12-12T21:05:38,952 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-12-12T21:05:38,955 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-12-12T21:05:38,958 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2022-12-12T21:05:38,961 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-12-12T21:05:38,966 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:38,967 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:38,971 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:38,974 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:38,985 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:38,990 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:38,994 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:39,000 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-12-12T21:05:39,002 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-12-12T21:05:39,005 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2022-12-12T21:05:39,008 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:39,015 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-12T21:05:39,016 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-12T21:05:39,020 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-12T21:05:39,023 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-12T21:05:39,027 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-12T21:05:39,032 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-12T21:05:39,036 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-12T21:05:39,039 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-12T21:05:39,044 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-12T21:05:39,049 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2022-12-12T21:05:39,054 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,056 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,060 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,063 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,067 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,072 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,076 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,080 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,085 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,088 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,096 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,100 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,110 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,119 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2022-12-12T21:05:39,124 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:39,127 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:39,133 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:39,138 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-12-12T21:05:39,139 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-12-12T21:05:39,143 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-12-12T21:05:39,145 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-12-12T21:05:39,149 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-12-12T21:05:39,152 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-12-12T21:05:39,157 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2022-12-12T21:05:39,162 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-12-12T21:05:39,166 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-12-12T21:05:39,170 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2022-12-12T21:05:39,175 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:39,179 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:39,185 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-12-12T21:05:39,186 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-12-12T21:05:39,189 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2022-12-12T21:05:39,193 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:39,197 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-12-12T21:05:39,199 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-12-12T21:05:39,202 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-12-12T21:05:39,205 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2022-12-12T21:05:39,211 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-12T21:05:39,212 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-12T21:05:39,216 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-12T21:05:39,223 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-12T21:05:39,227 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-12T21:05:39,232 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-12T21:05:39,237 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2022-12-12T21:05:39,244 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-12-12T21:05:39,246 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-12-12T21:05:39,250 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-12-12T21:05:39,254 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-12-12T21:05:39,258 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2022-12-12T21:05:39,263 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:39,268 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2022-12-12T21:05:39,273 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-12-12T21:05:39,274 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-12-12T21:05:39,277 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-12-12T21:05:39,280 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-12-12T21:05:39,284 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2022-12-12T21:05:39,289 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-12T21:05:39,290 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-12T21:05:39,294 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-12T21:05:39,297 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-12T21:05:39,301 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-12T21:05:39,306 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-12T21:05:39,310 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-12T21:05:39,315 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2022-12-12T21:05:39,322 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-12-12T21:05:39,326 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2022-12-12T21:05:39,329 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-12-12T21:05:39,330 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-12-12T21:05:39,335 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-12-12T21:05:39,339 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-12-12T21:05:39,342 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2022-12-12T21:05:39,346 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2022-12-12T21:05:39,350 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-12-12T21:05:39,352 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-12-12T21:05:39,355 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2022-12-12T21:05:39,360 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-12-12T21:05:39,362 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-12-12T21:05:39,365 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2022-12-12T21:05:39,372 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,373 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,377 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,381 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,384 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,389 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,393 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,397 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,400 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,405 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,409 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2022-12-12T21:05:39,415 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2022-12-12T21:05:39,417 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-12-12T21:05:39,419 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-12-12T21:05:39,423 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-12-12T21:05:39,427 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-12-12T21:05:39,430 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2022-12-12T21:05:39,436 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2022-12-12T21:05:39,437 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2022-12-12T21:05:39,443 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-12T21:05:39,444 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-12T21:05:39,449 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-12T21:05:39,454 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-12T21:05:39,459 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-12T21:05:39,465 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2022-12-12T21:05:39,467 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:39,469 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:39,476 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:39,482 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:39,488 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:39,493 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:39,497 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:39,500 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:39,505 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2022-12-12T21:05:39,511 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-12-12T21:05:39,513 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-12-12T21:05:39,518 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-12-12T21:05:39,522 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2022-12-12T21:05:39,526 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-12T21:05:39,534 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-12T21:05:39,539 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-12T21:05:39,545 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2022-12-12T21:05:39,551 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,552 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,557 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,561 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,567 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,571 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,575 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,578 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,582 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,586 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,589 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,593 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,597 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,601 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,605 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,608 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,612 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,615 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,619 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,623 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,627 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,630 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,635 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,638 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,641 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,645 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,649 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,653 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2022-12-12T21:05:39,658 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-12-12T21:05:39,660 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-12-12T21:05:39,666 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-12-12T21:05:39,670 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-12-12T21:05:39,673 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2022-12-12T21:05:39,678 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2022-12-12T21:05:39,681 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2022-12-12T21:05:39,682 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2022-12-12T21:05:39,687 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2022-12-12T21:05:39,691 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2022-12-12T21:05:39,692 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2022-12-12T21:05:39,697 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-12-12T21:05:39,698 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-12-12T21:05:39,703 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2022-12-12T21:05:39,708 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2022-12-12T21:05:39,709 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2022-12-12T21:05:39,714 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2022-12-12T21:05:39,715 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2022-12-12T21:05:39,720 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2022-12-12T21:05:39,722 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:39,724 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:39,728 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:39,731 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:39,735 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:39,738 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:39,741 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:39,745 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:39,749 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:39,753 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2022-12-12T21:05:39,758 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:39,759 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:39,763 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:39,768 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:39,771 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:39,776 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:39,779 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2022-12-12T21:05:39,783 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2022-12-12T21:05:39,785 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2022-12-12T21:05:39,789 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2022-12-12T21:05:39,791 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2022-12-12T21:05:39,796 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-12-12T21:05:39,798 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-12-12T21:05:39,801 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2022-12-12T21:05:39,805 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,807 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,810 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,814 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,817 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,820 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,823 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,827 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,830 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,833 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,837 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,840 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,846 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,849 copying build/lib/deepspeed/ops/op_builder/builder_names.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,852 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,856 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,859 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2022-12-12T21:05:39,863 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-12-12T21:05:39,865 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-12-12T21:05:39,868 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2022-12-12T21:05:39,874 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2022-12-12T21:05:39,875 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2022-12-12T21:05:39,880 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-12T21:05:39,882 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-12T21:05:39,885 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-12T21:05:39,891 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-12T21:05:39,897 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-12-12T21:05:39,898 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-12-12T21:05:39,902 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-12-12T21:05:39,905 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-12-12T21:05:39,909 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2022-12-12T21:05:39,912 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-12T21:05:39,917 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-12T21:05:39,922 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-12T21:05:39,927 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2022-12-12T21:05:39,931 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-12T21:05:39,933 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-12T21:05:39,936 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-12T21:05:39,943 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-12T21:05:39,947 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-12T21:05:39,952 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-12T21:05:39,956 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-12T21:05:39,960 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-12T21:05:39,964 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2022-12-12T21:05:39,969 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-12-12T21:05:39,971 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-12-12T21:05:39,975 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-12-12T21:05:39,979 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2022-12-12T21:05:39,985 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-12T21:05:39,986 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-12T21:05:39,990 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-12T21:05:39,993 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-12T21:05:39,998 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-12T21:05:40,002 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-12T21:05:40,005 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2022-12-12T21:05:40,009 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-12-12T21:05:40,014 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,016 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,021 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,025 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,030 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,034 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,038 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,041 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,045 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,048 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,053 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,057 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,062 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,066 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2022-12-12T21:05:40,070 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-12T21:05:40,072 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-12T21:05:40,075 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-12T21:05:40,079 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-12T21:05:40,084 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-12T21:05:40,087 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-12T21:05:40,091 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2022-12-12T21:05:40,096 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-12T21:05:40,097 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-12T21:05:40,104 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-12T21:05:40,106 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-12T21:05:40,110 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-12T21:05:40,114 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2022-12-12T21:05:40,120 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2022-12-12T21:05:40,121 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2022-12-12T21:05:40,126 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2022-12-12T21:05:40,127 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2022-12-12T21:05:40,130 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2022-12-12T21:05:40,135 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2022-12-12T21:05:40,139 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2022-12-12T21:05:40,141 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2022-12-12T21:05:40,144 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2022-12-12T21:05:40,148 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2022-12-12T21:05:40,152 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2022-12-12T21:05:40,154 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2022-12-12T21:05:40,158 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2022-12-12T21:05:40,161 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2022-12-12T21:05:40,165 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2022-12-12T21:05:40,170 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-12T21:05:40,171 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-12T21:05:40,175 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-12T21:05:40,179 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-12T21:05:40,184 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-12T21:05:40,185 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-12T21:05:40,189 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-12T21:05:40,193 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-12T21:05:40,197 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-12T21:05:40,200 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-12T21:05:40,203 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2022-12-12T21:05:40,207 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-12T21:05:40,212 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-12-12T21:05:40,214 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-12-12T21:05:40,218 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-12-12T21:05:40,221 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-12-12T21:05:40,224 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2022-12-12T21:05:40,227 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-12T21:05:40,232 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2022-12-12T21:05:40,240 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-12-12T21:05:40,241 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-12-12T21:05:40,245 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-12-12T21:05:40,248 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2022-12-12T21:05:40,252 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-12-12T21:05:40,254 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-12-12T21:05:40,257 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2022-12-12T21:05:40,265 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-12T21:05:40,266 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-12T21:05:40,270 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-12T21:05:40,273 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-12T21:05:40,277 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-12T21:05:40,281 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-12T21:05:40,285 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-12T21:05:40,288 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-12T21:05:40,292 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-12T21:05:40,296 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2022-12-12T21:05:40,300 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2022-12-12T21:05:40,302 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2022-12-12T21:05:40,306 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-12T21:05:40,308 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-12T21:05:40,311 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-12T21:05:40,315 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-12T21:05:40,318 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-12T21:05:40,322 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-12T21:05:40,325 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-12T21:05:40,329 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2022-12-12T21:05:40,334 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2022-12-12T21:05:40,337 running install_egg_info 2022-12-12T21:05:40,410 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.7.7-py3.7.egg-info 2022-12-12T21:05:40,435 running install_scripts 2022-12-12T21:05:40,545 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data 2022-12-12T21:05:40,545 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts 2022-12-12T21:05:40,547 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts 2022-12-12T21:05:40,550 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts 2022-12-12T21:05:40,554 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts 2022-12-12T21:05:40,557 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts 2022-12-12T21:05:40,560 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts 2022-12-12T21:05:40,563 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts 2022-12-12T21:05:40,566 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts 2022-12-12T21:05:40,569 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts 2022-12-12T21:05:40,572 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts/ds to 755 2022-12-12T21:05:40,573 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts/deepspeed to 755 2022-12-12T21:05:40,573 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts/ds_bench to 755 2022-12-12T21:05:40,574 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts/ds_report to 755 2022-12-12T21:05:40,574 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts/ds_elastic to 755 2022-12-12T21:05:40,575 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts/ds_ssh to 755 2022-12-12T21:05:40,575 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts/deepspeed.pt to 755 2022-12-12T21:05:40,576 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.data/scripts/dsr to 755 2022-12-12T21:05:40,859 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2022-12-12T21:05:40,868 creating build/bdist.linux-armv7l/wheel/deepspeed-0.7.7.dist-info/WHEEL 2022-12-12T21:05:40,872 creating '/tmp/pip-wheel-gwk8zcq3/deepspeed-0.7.7-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2022-12-12T21:05:40,877 adding 'benchmarks/__init__.py' 2022-12-12T21:05:40,881 adding 'benchmarks/communication/__init__.py' 2022-12-12T21:05:40,884 adding 'benchmarks/communication/all_gather.py' 2022-12-12T21:05:40,887 adding 'benchmarks/communication/all_reduce.py' 2022-12-12T21:05:40,890 adding 'benchmarks/communication/all_to_all.py' 2022-12-12T21:05:40,892 adding 'benchmarks/communication/broadcast.py' 2022-12-12T21:05:40,895 adding 'benchmarks/communication/constants.py' 2022-12-12T21:05:40,897 adding 'benchmarks/communication/pt2pt.py' 2022-12-12T21:05:40,900 adding 'benchmarks/communication/run_all.py' 2022-12-12T21:05:40,903 adding 'benchmarks/communication/utils.py' 2022-12-12T21:05:40,907 adding 'benchmarks/inference/bert-bench.py' 2022-12-12T21:05:40,910 adding 'benchmarks/inference/collect_results.py' 2022-12-12T21:05:40,913 adding 'benchmarks/inference/gpt-bench.py' 2022-12-12T21:05:40,919 adding 'deepspeed/__init__.py' 2022-12-12T21:05:40,921 adding 'deepspeed/constants.py' 2022-12-12T21:05:40,924 adding 'deepspeed/env_report.py' 2022-12-12T21:05:40,926 adding 'deepspeed/git_version_info.py' 2022-12-12T21:05:40,929 adding 'deepspeed/git_version_info_installed.py' 2022-12-12T21:05:40,932 adding 'deepspeed/accelerator/__init__.py' 2022-12-12T21:05:40,934 adding 'deepspeed/accelerator/abstract_accelerator.py' 2022-12-12T21:05:40,937 adding 'deepspeed/accelerator/cuda_accelerator.py' 2022-12-12T21:05:40,940 adding 'deepspeed/accelerator/real_accelerator.py' 2022-12-12T21:05:40,944 adding 'deepspeed/autotuning/__init__.py' 2022-12-12T21:05:40,956 adding 'deepspeed/autotuning/autotuner.py' 2022-12-12T21:05:40,960 adding 'deepspeed/autotuning/config.py' 2022-12-12T21:05:40,963 adding 'deepspeed/autotuning/constants.py' 2022-12-12T21:05:40,968 adding 'deepspeed/autotuning/scheduler.py' 2022-12-12T21:05:40,973 adding 'deepspeed/autotuning/utils.py' 2022-12-12T21:05:40,976 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2022-12-12T21:05:40,978 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2022-12-12T21:05:40,981 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2022-12-12T21:05:40,983 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2022-12-12T21:05:40,986 adding 'deepspeed/autotuning/tuner/__init__.py' 2022-12-12T21:05:40,989 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2022-12-12T21:05:40,991 adding 'deepspeed/autotuning/tuner/cost_model.py' 2022-12-12T21:05:40,994 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2022-12-12T21:05:40,997 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2022-12-12T21:05:40,999 adding 'deepspeed/autotuning/tuner/utils.py' 2022-12-12T21:05:41,003 adding 'deepspeed/checkpoint/__init__.py' 2022-12-12T21:05:41,005 adding 'deepspeed/checkpoint/constants.py' 2022-12-12T21:05:41,009 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2022-12-12T21:05:41,012 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2022-12-12T21:05:41,016 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2022-12-12T21:05:41,018 adding 'deepspeed/checkpoint/reshape_utils.py' 2022-12-12T21:05:41,021 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2022-12-12T21:05:41,024 adding 'deepspeed/checkpoint/utils.py' 2022-12-12T21:05:41,027 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2022-12-12T21:05:41,030 adding 'deepspeed/comm/__init__.py' 2022-12-12T21:05:41,033 adding 'deepspeed/comm/backend.py' 2022-12-12T21:05:41,040 adding 'deepspeed/comm/comm.py' 2022-12-12T21:05:41,042 adding 'deepspeed/comm/config.py' 2022-12-12T21:05:41,045 adding 'deepspeed/comm/constants.py' 2022-12-12T21:05:41,048 adding 'deepspeed/comm/torch.py' 2022-12-12T21:05:41,051 adding 'deepspeed/comm/utils.py' 2022-12-12T21:05:41,055 adding 'deepspeed/compression/__init__.py' 2022-12-12T21:05:41,062 adding 'deepspeed/compression/basic_layer.py' 2022-12-12T21:05:41,067 adding 'deepspeed/compression/compress.py' 2022-12-12T21:05:41,071 adding 'deepspeed/compression/config.py' 2022-12-12T21:05:41,074 adding 'deepspeed/compression/constants.py' 2022-12-12T21:05:41,078 adding 'deepspeed/compression/helper.py' 2022-12-12T21:05:41,081 adding 'deepspeed/compression/scheduler.py' 2022-12-12T21:05:41,085 adding 'deepspeed/compression/utils.py' 2022-12-12T21:05:41,088 adding 'deepspeed/elasticity/__init__.py' 2022-12-12T21:05:41,091 adding 'deepspeed/elasticity/config.py' 2022-12-12T21:05:41,094 adding 'deepspeed/elasticity/constants.py' 2022-12-12T21:05:41,097 adding 'deepspeed/elasticity/elastic_agent.py' 2022-12-12T21:05:41,102 adding 'deepspeed/elasticity/elasticity.py' 2022-12-12T21:05:41,105 adding 'deepspeed/elasticity/utils.py' 2022-12-12T21:05:41,108 adding 'deepspeed/inference/__init__.py' 2022-12-12T21:05:41,112 adding 'deepspeed/inference/config.py' 2022-12-12T21:05:41,118 adding 'deepspeed/inference/engine.py' 2022-12-12T21:05:41,122 adding 'deepspeed/launcher/__init__.py' 2022-12-12T21:05:41,124 adding 'deepspeed/launcher/constants.py' 2022-12-12T21:05:41,129 adding 'deepspeed/launcher/launch.py' 2022-12-12T21:05:41,132 adding 'deepspeed/launcher/multinode_runner.py' 2022-12-12T21:05:41,138 adding 'deepspeed/launcher/runner.py' 2022-12-12T21:05:41,142 adding 'deepspeed/model_implementations/__init__.py' 2022-12-12T21:05:41,145 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2022-12-12T21:05:41,147 adding 'deepspeed/model_implementations/diffusers/unet.py' 2022-12-12T21:05:41,150 adding 'deepspeed/model_implementations/diffusers/vae.py' 2022-12-12T21:05:41,154 adding 'deepspeed/model_implementations/transformers/__init__.py' 2022-12-12T21:05:41,156 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2022-12-12T21:05:41,159 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2022-12-12T21:05:41,163 adding 'deepspeed/module_inject/__init__.py' 2022-12-12T21:05:41,166 adding 'deepspeed/module_inject/inject.py' 2022-12-12T21:05:41,168 adding 'deepspeed/module_inject/layers.py' 2022-12-12T21:05:41,173 adding 'deepspeed/module_inject/load_checkpoint.py' 2022-12-12T21:05:41,176 adding 'deepspeed/module_inject/module_quantize.py' 2022-12-12T21:05:41,188 adding 'deepspeed/module_inject/replace_module.py' 2022-12-12T21:05:41,195 adding 'deepspeed/module_inject/replace_policy.py' 2022-12-12T21:05:41,199 adding 'deepspeed/moe/__init__.py' 2022-12-12T21:05:41,201 adding 'deepspeed/moe/experts.py' 2022-12-12T21:05:41,204 adding 'deepspeed/moe/layer.py' 2022-12-12T21:05:41,207 adding 'deepspeed/moe/mappings.py' 2022-12-12T21:05:41,213 adding 'deepspeed/moe/sharded_moe.py' 2022-12-12T21:05:41,216 adding 'deepspeed/moe/utils.py' 2022-12-12T21:05:41,220 adding 'deepspeed/monitor/__init__.py' 2022-12-12T21:05:41,222 adding 'deepspeed/monitor/config.py' 2022-12-12T21:05:41,224 adding 'deepspeed/monitor/constants.py' 2022-12-12T21:05:41,227 adding 'deepspeed/monitor/csv_monitor.py' 2022-12-12T21:05:41,229 adding 'deepspeed/monitor/monitor.py' 2022-12-12T21:05:41,232 adding 'deepspeed/monitor/tensorboard.py' 2022-12-12T21:05:41,234 adding 'deepspeed/monitor/utils.py' 2022-12-12T21:05:41,236 adding 'deepspeed/monitor/wandb.py' 2022-12-12T21:05:41,239 adding 'deepspeed/nebula/__init__.py' 2022-12-12T21:05:41,242 adding 'deepspeed/nebula/config.py' 2022-12-12T21:05:41,244 adding 'deepspeed/nebula/constants.py' 2022-12-12T21:05:41,248 adding 'deepspeed/ops/__init__.py' 2022-12-12T21:05:41,251 adding 'deepspeed/ops/adagrad/__init__.py' 2022-12-12T21:05:41,254 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2022-12-12T21:05:41,257 adding 'deepspeed/ops/adam/__init__.py' 2022-12-12T21:05:41,260 adding 'deepspeed/ops/adam/cpu_adam.py' 2022-12-12T21:05:41,264 adding 'deepspeed/ops/adam/fused_adam.py' 2022-12-12T21:05:41,266 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2022-12-12T21:05:41,269 adding 'deepspeed/ops/aio/__init__.py' 2022-12-12T21:05:41,275 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2022-12-12T21:05:41,280 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2022-12-12T21:05:41,282 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2022-12-12T21:05:41,285 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2022-12-12T21:05:41,288 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2022-12-12T21:05:41,294 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2022-12-12T21:05:41,297 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2022-12-12T21:05:41,299 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2022-12-12T21:05:41,301 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2022-12-12T21:05:41,304 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2022-12-12T21:05:41,307 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2022-12-12T21:05:41,310 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2022-12-12T21:05:41,313 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2022-12-12T21:05:41,316 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2022-12-12T21:05:41,318 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2022-12-12T21:05:41,321 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2022-12-12T21:05:41,324 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2022-12-12T21:05:41,326 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2022-12-12T21:05:41,329 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2022-12-12T21:05:41,331 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2022-12-12T21:05:41,334 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2022-12-12T21:05:41,337 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2022-12-12T21:05:41,342 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2022-12-12T21:05:41,344 adding 'deepspeed/ops/csrc/includes/Timer.h' 2022-12-12T21:05:41,346 adding 'deepspeed/ops/csrc/includes/compat.h' 2022-12-12T21:05:41,349 adding 'deepspeed/ops/csrc/includes/context.h' 2022-12-12T21:05:41,353 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2022-12-12T21:05:41,356 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2022-12-12T21:05:41,359 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2022-12-12T21:05:41,362 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2022-12-12T21:05:41,365 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2022-12-12T21:05:41,368 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2022-12-12T21:05:41,371 adding 'deepspeed/ops/csrc/includes/dropout.h' 2022-12-12T21:05:41,373 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2022-12-12T21:05:41,376 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2022-12-12T21:05:41,378 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2022-12-12T21:05:41,381 adding 'deepspeed/ops/csrc/includes/gelu.h' 2022-12-12T21:05:41,384 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2022-12-12T21:05:41,386 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2022-12-12T21:05:41,391 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2022-12-12T21:05:41,394 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2022-12-12T21:05:41,397 adding 'deepspeed/ops/csrc/includes/quantization.h' 2022-12-12T21:05:41,401 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2022-12-12T21:05:41,404 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2022-12-12T21:05:41,409 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2022-12-12T21:05:41,411 adding 'deepspeed/ops/csrc/includes/simd.h' 2022-12-12T21:05:41,414 adding 'deepspeed/ops/csrc/includes/softmax.h' 2022-12-12T21:05:41,417 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2022-12-12T21:05:41,419 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2022-12-12T21:05:41,423 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2022-12-12T21:05:41,428 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2022-12-12T21:05:41,431 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2022-12-12T21:05:41,437 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2022-12-12T21:05:41,441 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2022-12-12T21:05:41,445 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2022-12-12T21:05:41,449 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2022-12-12T21:05:41,453 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2022-12-12T21:05:41,456 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2022-12-12T21:05:41,459 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2022-12-12T21:05:41,464 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2022-12-12T21:05:41,470 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2022-12-12T21:05:41,479 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2022-12-12T21:05:41,483 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2022-12-12T21:05:41,487 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2022-12-12T21:05:41,497 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2022-12-12T21:05:41,504 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2022-12-12T21:05:41,509 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2022-12-12T21:05:41,515 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2022-12-12T21:05:41,522 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2022-12-12T21:05:41,528 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2022-12-12T21:05:41,533 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2022-12-12T21:05:41,545 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2022-12-12T21:05:41,549 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2022-12-12T21:05:41,553 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2022-12-12T21:05:41,559 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2022-12-12T21:05:41,565 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2022-12-12T21:05:41,568 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2022-12-12T21:05:41,571 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2022-12-12T21:05:41,575 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2022-12-12T21:05:41,578 adding 'deepspeed/ops/lamb/__init__.py' 2022-12-12T21:05:41,581 adding 'deepspeed/ops/lamb/fused_lamb.py' 2022-12-12T21:05:41,585 adding 'deepspeed/ops/op_builder/__init__.py' 2022-12-12T21:05:41,587 adding 'deepspeed/ops/op_builder/all_ops.py' 2022-12-12T21:05:41,590 adding 'deepspeed/ops/op_builder/async_io.py' 2022-12-12T21:05:41,597 adding 'deepspeed/ops/op_builder/builder.py' 2022-12-12T21:05:41,600 adding 'deepspeed/ops/op_builder/builder_names.py' 2022-12-12T21:05:41,602 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2022-12-12T21:05:41,604 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2022-12-12T21:05:41,607 adding 'deepspeed/ops/op_builder/fused_adam.py' 2022-12-12T21:05:41,609 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2022-12-12T21:05:41,611 adding 'deepspeed/ops/op_builder/quantizer.py' 2022-12-12T21:05:41,614 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2022-12-12T21:05:41,616 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2022-12-12T21:05:41,619 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2022-12-12T21:05:41,621 adding 'deepspeed/ops/op_builder/transformer.py' 2022-12-12T21:05:41,624 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2022-12-12T21:05:41,626 adding 'deepspeed/ops/op_builder/utils.py' 2022-12-12T21:05:41,629 adding 'deepspeed/ops/quantizer/__init__.py' 2022-12-12T21:05:41,631 adding 'deepspeed/ops/quantizer/quantizer.py' 2022-12-12T21:05:41,634 adding 'deepspeed/ops/sparse_attention/__init__.py' 2022-12-12T21:05:41,637 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2022-12-12T21:05:41,646 adding 'deepspeed/ops/sparse_attention/matmul.py' 2022-12-12T21:05:41,651 adding 'deepspeed/ops/sparse_attention/softmax.py' 2022-12-12T21:05:41,655 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2022-12-12T21:05:41,659 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2022-12-12T21:05:41,666 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2022-12-12T21:05:41,670 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2022-12-12T21:05:41,673 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2022-12-12T21:05:41,676 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2022-12-12T21:05:41,679 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2022-12-12T21:05:41,682 adding 'deepspeed/ops/transformer/__init__.py' 2022-12-12T21:05:41,688 adding 'deepspeed/ops/transformer/transformer.py' 2022-12-12T21:05:41,692 adding 'deepspeed/ops/transformer/inference/__init__.py' 2022-12-12T21:05:41,694 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2022-12-12T21:05:41,697 adding 'deepspeed/ops/transformer/inference/config.py' 2022-12-12T21:05:41,699 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2022-12-12T21:05:41,703 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2022-12-12T21:05:41,706 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2022-12-12T21:05:41,711 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2022-12-12T21:05:41,714 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2022-12-12T21:05:41,720 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2022-12-12T21:05:41,723 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2022-12-12T21:05:41,726 adding 'deepspeed/pipe/__init__.py' 2022-12-12T21:05:41,730 adding 'deepspeed/profiling/__init__.py' 2022-12-12T21:05:41,733 adding 'deepspeed/profiling/config.py' 2022-12-12T21:05:41,736 adding 'deepspeed/profiling/constants.py' 2022-12-12T21:05:41,739 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2022-12-12T21:05:41,750 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2022-12-12T21:05:41,755 adding 'deepspeed/runtime/__init__.py' 2022-12-12T21:05:41,761 adding 'deepspeed/runtime/bf16_optimizer.py' 2022-12-12T21:05:41,770 adding 'deepspeed/runtime/config.py' 2022-12-12T21:05:41,775 adding 'deepspeed/runtime/config_utils.py' 2022-12-12T21:05:41,779 adding 'deepspeed/runtime/constants.py' 2022-12-12T21:05:41,782 adding 'deepspeed/runtime/dataloader.py' 2022-12-12T21:05:41,785 adding 'deepspeed/runtime/eigenvalue.py' 2022-12-12T21:05:41,824 adding 'deepspeed/runtime/engine.py' 2022-12-12T21:05:41,835 adding 'deepspeed/runtime/lr_schedules.py' 2022-12-12T21:05:41,838 adding 'deepspeed/runtime/progressive_layer_drop.py' 2022-12-12T21:05:41,842 adding 'deepspeed/runtime/quantize.py' 2022-12-12T21:05:41,844 adding 'deepspeed/runtime/sparse_tensor.py' 2022-12-12T21:05:41,849 adding 'deepspeed/runtime/state_dict_factory.py' 2022-12-12T21:05:41,859 adding 'deepspeed/runtime/utils.py' 2022-12-12T21:05:41,863 adding 'deepspeed/runtime/weight_quantizer.py' 2022-12-12T21:05:41,866 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2022-12-12T21:05:41,875 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2022-12-12T21:05:41,878 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2022-12-12T21:05:41,882 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2022-12-12T21:05:41,884 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2022-12-12T21:05:41,887 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2022-12-12T21:05:41,889 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2022-12-12T21:05:41,893 adding 'deepspeed/runtime/comm/__init__.py' 2022-12-12T21:05:41,895 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2022-12-12T21:05:41,899 adding 'deepspeed/runtime/comm/mpi.py' 2022-12-12T21:05:41,902 adding 'deepspeed/runtime/comm/nccl.py' 2022-12-12T21:05:41,906 adding 'deepspeed/runtime/compression/__init__.py' 2022-12-12T21:05:41,908 adding 'deepspeed/runtime/compression/cupy.py' 2022-12-12T21:05:41,911 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2022-12-12T21:05:41,914 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2022-12-12T21:05:41,917 adding 'deepspeed/runtime/fp16/__init__.py' 2022-12-12T21:05:41,923 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2022-12-12T21:05:41,927 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2022-12-12T21:05:41,932 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2022-12-12T21:05:41,936 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2022-12-12T21:05:41,941 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2022-12-12T21:05:41,947 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2022-12-12T21:05:41,953 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2022-12-12T21:05:41,956 adding 'deepspeed/runtime/pipe/__init__.py' 2022-12-12T21:05:41,971 adding 'deepspeed/runtime/pipe/engine.py' 2022-12-12T21:05:41,980 adding 'deepspeed/runtime/pipe/module.py' 2022-12-12T21:05:41,984 adding 'deepspeed/runtime/pipe/p2p.py' 2022-12-12T21:05:41,988 adding 'deepspeed/runtime/pipe/schedule.py' 2022-12-12T21:05:41,994 adding 'deepspeed/runtime/pipe/topology.py' 2022-12-12T21:05:41,998 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2022-12-12T21:05:42,000 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2022-12-12T21:05:42,003 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2022-12-12T21:05:42,005 adding 'deepspeed/runtime/swap_tensor/constants.py' 2022-12-12T21:05:42,010 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2022-12-12T21:05:42,015 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2022-12-12T21:05:42,020 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2022-12-12T21:05:42,024 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2022-12-12T21:05:42,028 adding 'deepspeed/runtime/swap_tensor/utils.py' 2022-12-12T21:05:42,031 adding 'deepspeed/runtime/zero/__init__.py' 2022-12-12T21:05:42,035 adding 'deepspeed/runtime/zero/config.py' 2022-12-12T21:05:42,039 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2022-12-12T21:05:42,043 adding 'deepspeed/runtime/zero/linear.py' 2022-12-12T21:05:42,046 adding 'deepspeed/runtime/zero/offload_config.py' 2022-12-12T21:05:42,051 adding 'deepspeed/runtime/zero/parameter_offload.py' 2022-12-12T21:05:42,070 adding 'deepspeed/runtime/zero/partition_parameters.py' 2022-12-12T21:05:42,078 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2022-12-12T21:05:42,109 adding 'deepspeed/runtime/zero/stage3.py' 2022-12-12T21:05:42,141 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2022-12-12T21:05:42,145 adding 'deepspeed/runtime/zero/test.py' 2022-12-12T21:05:42,150 adding 'deepspeed/runtime/zero/tiling.py' 2022-12-12T21:05:42,152 adding 'deepspeed/runtime/zero/utils.py' 2022-12-12T21:05:42,156 adding 'deepspeed/utils/__init__.py' 2022-12-12T21:05:42,159 adding 'deepspeed/utils/comms_logging.py' 2022-12-12T21:05:42,162 adding 'deepspeed/utils/debug.py' 2022-12-12T21:05:42,164 adding 'deepspeed/utils/exceptions.py' 2022-12-12T21:05:42,168 adding 'deepspeed/utils/groups.py' 2022-12-12T21:05:42,171 adding 'deepspeed/utils/init_on_device.py' 2022-12-12T21:05:42,174 adding 'deepspeed/utils/logging.py' 2022-12-12T21:05:42,176 adding 'deepspeed/utils/mixed_precision_linkage.py' 2022-12-12T21:05:42,178 adding 'deepspeed/utils/nvtx.py' 2022-12-12T21:05:42,181 adding 'deepspeed/utils/tensor_fragment.py' 2022-12-12T21:05:42,185 adding 'deepspeed/utils/timer.py' 2022-12-12T21:05:42,187 adding 'deepspeed/utils/types.py' 2022-12-12T21:05:42,192 adding 'deepspeed/utils/zero_to_fp32.py' 2022-12-12T21:05:42,197 adding 'deepspeed-0.7.7.data/scripts/deepspeed' 2022-12-12T21:05:42,199 adding 'deepspeed-0.7.7.data/scripts/deepspeed.pt' 2022-12-12T21:05:42,201 adding 'deepspeed-0.7.7.data/scripts/ds' 2022-12-12T21:05:42,203 adding 'deepspeed-0.7.7.data/scripts/ds_bench' 2022-12-12T21:05:42,205 adding 'deepspeed-0.7.7.data/scripts/ds_elastic' 2022-12-12T21:05:42,207 adding 'deepspeed-0.7.7.data/scripts/ds_report' 2022-12-12T21:05:42,209 adding 'deepspeed-0.7.7.data/scripts/ds_ssh' 2022-12-12T21:05:42,211 adding 'deepspeed-0.7.7.data/scripts/dsr' 2022-12-12T21:05:42,216 adding 'deepspeed-0.7.7.dist-info/LICENSE' 2022-12-12T21:05:42,223 adding 'deepspeed-0.7.7.dist-info/METADATA' 2022-12-12T21:05:42,225 adding 'deepspeed-0.7.7.dist-info/WHEEL' 2022-12-12T21:05:42,227 adding 'deepspeed-0.7.7.dist-info/entry_points.txt' 2022-12-12T21:05:42,228 adding 'deepspeed-0.7.7.dist-info/top_level.txt' 2022-12-12T21:05:42,242 adding 'deepspeed-0.7.7.dist-info/RECORD' 2022-12-12T21:05:42,282 removing build/bdist.linux-armv7l/wheel 2022-12-12T21:05:42,487 deepspeed build time = 10.604783058166504 secs 2022-12-12T21:05:42,751 Building wheel for deepspeed (setup.py): finished with status 'done' 2022-12-12T21:05:42,779 Created wheel for deepspeed: filename=deepspeed-0.7.7-py3-none-any.whl size=716791 sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 2022-12-12T21:05:42,781 Stored in directory: /tmp/pip-ephem-wheel-cache-3787lbc9/wheels/6b/73/98/47303f492bbd1a4d0b3620bc1c293f044711fa6402430d68ba 2022-12-12T21:05:42,842 Successfully built deepspeed 2022-12-12T21:05:42,916 Removed build tracker: '/tmp/pip-build-tracker-wn2n73p0'