2023-04-13T15:47:44,093 Created temporary directory: /tmp/pip-ephem-wheel-cache-0_skfva0 2023-04-13T15:47:44,098 Created temporary directory: /tmp/pip-build-tracker-ierd7iwv 2023-04-13T15:47:44,099 Initialized build tracking at /tmp/pip-build-tracker-ierd7iwv 2023-04-13T15:47:44,099 Created build tracker: /tmp/pip-build-tracker-ierd7iwv 2023-04-13T15:47:44,100 Entered build tracker: /tmp/pip-build-tracker-ierd7iwv 2023-04-13T15:47:44,101 Created temporary directory: /tmp/pip-wheel-m8uxjxri 2023-04-13T15:47:44,110 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-04-13T15:47:44,117 Created temporary directory: /tmp/pip-ephem-wheel-cache-mcb44v4c 2023-04-13T15:47:44,169 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-04-13T15:47:44,176 2 location(s) to search for versions of deepspeed: 2023-04-13T15:47:44,176 * https://pypi.org/simple/deepspeed/ 2023-04-13T15:47:44,176 * https://www.piwheels.org/simple/deepspeed/ 2023-04-13T15:47:44,177 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-04-13T15:47:44,178 Getting page https://pypi.org/simple/deepspeed/ 2023-04-13T15:47:44,181 Found index url https://pypi.org/simple 2023-04-13T15:47:44,371 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-04-13T15:47:44,403 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-04-13T15:47:44,404 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-04-13T15:47:44,405 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-04-13T15:47:44,405 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-04-13T15:47:44,406 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-04-13T15:47:44,407 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-04-13T15:47:44,407 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-04-13T15:47:44,408 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-04-13T15:47:44,409 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-04-13T15:47:44,409 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-04-13T15:47:44,410 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-04-13T15:47:44,411 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-04-13T15:47:44,411 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-04-13T15:47:44,412 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-04-13T15:47:44,413 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-04-13T15:47:44,414 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-04-13T15:47:44,414 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-04-13T15:47:44,415 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-04-13T15:47:44,416 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-04-13T15:47:44,416 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-04-13T15:47:44,417 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-04-13T15:47:44,418 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-04-13T15:47:44,418 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-04-13T15:47:44,420 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-04-13T15:47:44,420 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-04-13T15:47:44,421 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-04-13T15:47:44,422 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-04-13T15:47:44,422 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-04-13T15:47:44,423 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-04-13T15:47:44,424 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-04-13T15:47:44,424 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-04-13T15:47:44,425 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-04-13T15:47:44,426 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-04-13T15:47:44,427 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-04-13T15:47:44,427 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-04-13T15:47:44,428 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-04-13T15:47:44,429 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-04-13T15:47:44,430 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-04-13T15:47:44,430 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-04-13T15:47:44,431 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-04-13T15:47:44,432 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-04-13T15:47:44,432 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-04-13T15:47:44,433 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-04-13T15:47:44,434 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-04-13T15:47:44,434 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-04-13T15:47:44,435 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-04-13T15:47:44,436 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-04-13T15:47:44,436 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-04-13T15:47:44,437 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-04-13T15:47:44,438 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-04-13T15:47:44,439 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-04-13T15:47:44,439 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-04-13T15:47:44,440 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-04-13T15:47:44,441 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-04-13T15:47:44,441 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-04-13T15:47:44,442 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-04-13T15:47:44,443 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-04-13T15:47:44,443 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-04-13T15:47:44,444 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-04-13T15:47:44,445 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-04-13T15:47:44,445 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-04-13T15:47:44,446 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-04-13T15:47:44,447 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-04-13T15:47:44,447 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-04-13T15:47:44,448 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-04-13T15:47:44,449 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-04-13T15:47:44,450 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-04-13T15:47:44,450 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-04-13T15:47:44,453 Found index url https://www.piwheels.org/simple 2023-04-13T15:47:44,681 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-04-13T15:47:44,708 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,708 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,709 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,709 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,710 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,710 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,711 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,712 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,712 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,713 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,713 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,714 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,714 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,715 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,715 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,716 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,716 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,717 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,717 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,718 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,719 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,719 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,720 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,720 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,721 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,721 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,722 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,722 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,723 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,723 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,724 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,724 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,725 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,725 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,726 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,726 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-04-13T15:47:44,727 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-04-13T15:47:44,727 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-04-13T15:47:44,781 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-04-13T15:47:44,811 Collecting deepspeed==0.9.0 2023-04-13T15:47:44,816 Created temporary directory: /tmp/pip-unpack-w7lf9lgh 2023-04-13T15:47:45,004 Downloading deepspeed-0.9.0.tar.gz (764 kB) 2023-04-13T15:47:47,703 Added deepspeed==0.9.0 from https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz to build tracker '/tmp/pip-build-tracker-ierd7iwv' 2023-04-13T15:47:47,705 Running setup.py (path:/tmp/pip-wheel-m8uxjxri/deepspeed_12703798a69f42bbba9a68b59c92d255/setup.py) egg_info for package deepspeed 2023-04-13T15:47:47,707 Created temporary directory: /tmp/pip-pip-egg-info-h882el1y 2023-04-13T15:47:47,707 Preparing metadata (setup.py): started 2023-04-13T15:47:47,709 Running command python setup.py egg_info 2023-04-13T15:47:49,646 fatal: not a git repository (or any of the parent directories): .git 2023-04-13T15:47:50,466 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-04-13T15:47:50,466  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-04-13T15:47:50,467 DS_BUILD_OPS=0 2023-04-13T15:47:50,467  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-04-13T15:47:50,468  [WARNING]  async_io: please install the libaio-dev package with apt 2023-04-13T15:47:50,468  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-04-13T15:47:50,468  [WARNING]  unable to import torch, please install it first 2023-04-13T15:47:50,469  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-04-13T15:47:50,469  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-04-13T15:47:50,469 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-04-13T15:47:50,470 version=0.9.0, git_hash=unknown, git_branch=unknown 2023-04-13T15:47:50,470 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2023-04-13T15:47:50,470 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-04-13T15:47:50,471 ext_modules=[] 2023-04-13T15:47:50,471 running egg_info 2023-04-13T15:47:50,472 creating /tmp/pip-pip-egg-info-h882el1y/deepspeed.egg-info 2023-04-13T15:47:50,568 writing /tmp/pip-pip-egg-info-h882el1y/deepspeed.egg-info/PKG-INFO 2023-04-13T15:47:50,574 writing dependency_links to /tmp/pip-pip-egg-info-h882el1y/deepspeed.egg-info/dependency_links.txt 2023-04-13T15:47:50,579 writing entry points to /tmp/pip-pip-egg-info-h882el1y/deepspeed.egg-info/entry_points.txt 2023-04-13T15:47:50,584 writing requirements to /tmp/pip-pip-egg-info-h882el1y/deepspeed.egg-info/requires.txt 2023-04-13T15:47:50,586 writing top-level names to /tmp/pip-pip-egg-info-h882el1y/deepspeed.egg-info/top_level.txt 2023-04-13T15:47:50,589 writing manifest file '/tmp/pip-pip-egg-info-h882el1y/deepspeed.egg-info/SOURCES.txt' 2023-04-13T15:47:51,104 reading manifest file '/tmp/pip-pip-egg-info-h882el1y/deepspeed.egg-info/SOURCES.txt' 2023-04-13T15:47:51,107 reading manifest template 'MANIFEST.in' 2023-04-13T15:47:52,463 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-04-13T15:47:53,459 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-04-13T15:47:54,108 warning: no files found matching '*.tr' under directory 'csrc' 2023-04-13T15:47:54,261 warning: no files found matching '*.cc' under directory 'csrc' 2023-04-13T15:47:54,288 warning: no files found matching '*.py' under directory 'benchmarks' 2023-04-13T15:47:54,297 adding license file 'LICENSE' 2023-04-13T15:47:54,353 writing manifest file '/tmp/pip-pip-egg-info-h882el1y/deepspeed.egg-info/SOURCES.txt' 2023-04-13T15:47:54,356 deepspeed build time = 4.7006988525390625 secs 2023-04-13T15:47:54,485 Preparing metadata (setup.py): finished with status 'done' 2023-04-13T15:47:54,505 Source in /tmp/pip-wheel-m8uxjxri/deepspeed_12703798a69f42bbba9a68b59c92d255 has version 0.9.0, which satisfies requirement deepspeed==0.9.0 from https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz 2023-04-13T15:47:54,507 Removed deepspeed==0.9.0 from https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz from build tracker '/tmp/pip-build-tracker-ierd7iwv' 2023-04-13T15:47:54,524 Created temporary directory: /tmp/pip-unpack-0y_1otfn 2023-04-13T15:47:54,525 Building wheels for collected packages: deepspeed 2023-04-13T15:47:54,535 Created temporary directory: /tmp/pip-wheel-srvgkdj9 2023-04-13T15:47:54,536 Building wheel for deepspeed (setup.py): started 2023-04-13T15:47:54,538 Destination directory: /tmp/pip-wheel-srvgkdj9 2023-04-13T15:47:54,538 Running command python setup.py bdist_wheel 2023-04-13T15:47:55,644 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-04-13T15:47:55,669  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-04-13T15:47:55,753 DS_BUILD_OPS=0 2023-04-13T15:47:56,049  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-04-13T15:47:56,212  [WARNING]  async_io: please install the libaio-dev package with apt 2023-04-13T15:47:56,213  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-04-13T15:47:56,216  [WARNING]  unable to import torch, please install it first 2023-04-13T15:47:56,217  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-04-13T15:47:56,218  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-04-13T15:47:56,219 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-04-13T15:47:56,259 fatal: not a git repository (or any of the parent directories): .git 2023-04-13T15:47:56,264 version=0.9.0, git_hash=unknown, git_branch=unknown 2023-04-13T15:47:56,266 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2023-04-13T15:47:56,266 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-04-13T15:47:56,267 ext_modules=[] 2023-04-13T15:47:57,849 running bdist_wheel 2023-04-13T15:47:58,728 running build 2023-04-13T15:47:58,728 running build_py 2023-04-13T15:47:58,834 creating build 2023-04-13T15:47:58,835 creating build/lib 2023-04-13T15:47:58,836 creating build/lib/deepspeed 2023-04-13T15:47:58,839 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-04-13T15:47:58,842 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-04-13T15:47:58,847 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-04-13T15:47:58,851 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-04-13T15:47:58,854 copying deepspeed/constants.py -> build/lib/deepspeed 2023-04-13T15:47:58,859 creating build/lib/deepspeed/ops 2023-04-13T15:47:58,861 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-04-13T15:47:58,867 creating build/lib/deepspeed/compression 2023-04-13T15:47:58,868 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-04-13T15:47:58,873 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-04-13T15:47:58,879 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-04-13T15:47:58,882 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-04-13T15:47:58,887 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-04-13T15:47:58,891 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-04-13T15:47:58,896 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-04-13T15:47:58,901 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-04-13T15:47:58,906 creating build/lib/deepspeed/moe 2023-04-13T15:47:58,908 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-04-13T15:47:58,912 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-04-13T15:47:58,915 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-04-13T15:47:58,919 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-04-13T15:47:58,923 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-04-13T15:47:58,928 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-04-13T15:47:58,934 creating build/lib/deepspeed/monitor 2023-04-13T15:47:58,936 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-04-13T15:47:58,939 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-04-13T15:47:58,943 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-04-13T15:47:58,946 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-04-13T15:47:58,949 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-04-13T15:47:58,953 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-04-13T15:47:58,956 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-04-13T15:47:58,962 creating build/lib/deepspeed/utils 2023-04-13T15:47:58,964 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-04-13T15:47:58,969 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-04-13T15:47:58,973 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-04-13T15:47:58,976 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-04-13T15:47:58,980 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-04-13T15:47:58,984 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-04-13T15:47:58,989 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-04-13T15:47:58,994 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-04-13T15:47:58,999 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-04-13T15:47:59,002 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-04-13T15:47:59,006 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-04-13T15:47:59,010 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-04-13T15:47:59,014 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-04-13T15:47:59,020 creating build/lib/deepspeed/checkpoint 2023-04-13T15:47:59,022 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-04-13T15:47:59,027 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-04-13T15:47:59,030 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-04-13T15:47:59,034 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-04-13T15:47:59,037 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-04-13T15:47:59,041 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-04-13T15:47:59,045 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-04-13T15:47:59,049 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-04-13T15:47:59,052 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-04-13T15:47:59,058 creating build/lib/deepspeed/inference 2023-04-13T15:47:59,060 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-04-13T15:47:59,066 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-04-13T15:47:59,069 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-04-13T15:47:59,075 creating build/lib/deepspeed/elasticity 2023-04-13T15:47:59,077 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-04-13T15:47:59,081 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-04-13T15:47:59,084 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-04-13T15:47:59,088 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-04-13T15:47:59,093 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-04-13T15:47:59,098 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-04-13T15:47:59,105 creating build/lib/deepspeed/runtime 2023-04-13T15:47:59,108 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,121 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,126 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,130 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,135 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,142 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,148 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,152 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,156 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,160 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,164 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,169 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,173 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,180 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,184 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,190 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-04-13T15:47:59,195 creating build/lib/deepspeed/model_implementations 2023-04-13T15:47:59,197 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-04-13T15:47:59,202 creating build/lib/deepspeed/comm 2023-04-13T15:47:59,204 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-04-13T15:47:59,209 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-04-13T15:47:59,212 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-04-13T15:47:59,215 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-04-13T15:47:59,219 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-04-13T15:47:59,222 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-04-13T15:47:59,228 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-04-13T15:47:59,233 creating build/lib/deepspeed/autotuning 2023-04-13T15:47:59,234 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-04-13T15:47:59,239 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-04-13T15:47:59,243 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-04-13T15:47:59,247 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-04-13T15:47:59,252 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-04-13T15:47:59,259 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-04-13T15:47:59,265 creating build/lib/deepspeed/profiling 2023-04-13T15:47:59,268 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-04-13T15:47:59,272 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-04-13T15:47:59,276 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-04-13T15:47:59,282 creating build/lib/deepspeed/accelerator 2023-04-13T15:47:59,284 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-04-13T15:47:59,288 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-04-13T15:47:59,293 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-04-13T15:47:59,297 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-04-13T15:47:59,303 creating build/lib/deepspeed/pipe 2023-04-13T15:47:59,305 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-04-13T15:47:59,311 creating build/lib/deepspeed/launcher 2023-04-13T15:47:59,313 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-04-13T15:47:59,319 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-04-13T15:47:59,323 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-04-13T15:47:59,327 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-04-13T15:47:59,332 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-04-13T15:47:59,338 creating build/lib/deepspeed/module_inject 2023-04-13T15:47:59,341 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-04-13T15:47:59,346 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-04-13T15:47:59,351 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-04-13T15:47:59,354 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-04-13T15:47:59,359 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-04-13T15:47:59,362 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-04-13T15:47:59,366 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-04-13T15:47:59,372 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-04-13T15:47:59,375 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-04-13T15:47:59,379 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-04-13T15:47:59,384 creating build/lib/deepspeed/nebula 2023-04-13T15:47:59,386 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-04-13T15:47:59,390 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-04-13T15:47:59,393 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-04-13T15:47:59,398 creating build/lib/deepspeed/ops/aio 2023-04-13T15:47:59,399 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-04-13T15:47:59,404 creating build/lib/deepspeed/ops/adagrad 2023-04-13T15:47:59,405 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-04-13T15:47:59,409 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-04-13T15:47:59,415 creating build/lib/deepspeed/ops/sparse_attention 2023-04-13T15:47:59,417 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-13T15:47:59,421 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-13T15:47:59,424 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-13T15:47:59,429 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-13T15:47:59,435 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-13T15:47:59,440 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-13T15:47:59,446 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-04-13T15:47:59,452 creating build/lib/deepspeed/ops/transformer 2023-04-13T15:47:59,455 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-04-13T15:47:59,461 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-04-13T15:47:59,466 creating build/lib/deepspeed/ops/lamb 2023-04-13T15:47:59,469 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-04-13T15:47:59,473 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-04-13T15:47:59,481 creating build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,483 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,488 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,492 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,496 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,500 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,504 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,510 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,515 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,519 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,523 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,527 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,531 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,535 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,540 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,544 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,548 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-04-13T15:47:59,553 creating build/lib/deepspeed/ops/quantizer 2023-04-13T15:47:59,556 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-04-13T15:47:59,560 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-04-13T15:47:59,565 creating build/lib/deepspeed/ops/random_ltd 2023-04-13T15:47:59,567 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-04-13T15:47:59,571 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-04-13T15:47:59,577 creating build/lib/deepspeed/ops/adam 2023-04-13T15:47:59,578 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-04-13T15:47:59,582 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-04-13T15:47:59,585 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-04-13T15:47:59,589 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-04-13T15:47:59,594 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-04-13T15:47:59,596 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-04-13T15:47:59,602 creating build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,604 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,608 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,612 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,615 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,619 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,623 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,627 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,631 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,635 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,640 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-04-13T15:47:59,646 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,648 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,652 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,655 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,659 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,662 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,666 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,670 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,673 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,677 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,680 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:47:59,685 creating build/lib/deepspeed/runtime/compression 2023-04-13T15:47:59,686 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-04-13T15:47:59,690 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-04-13T15:47:59,696 creating build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,698 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,702 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,712 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,715 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,722 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,726 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,730 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,733 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,738 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,743 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,748 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,752 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,756 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-04-13T15:47:59,767 creating build/lib/deepspeed/runtime/fp16 2023-04-13T15:47:59,769 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-04-13T15:47:59,774 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-04-13T15:47:59,779 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-04-13T15:47:59,782 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-04-13T15:47:59,788 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-04-13T15:47:59,790 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-04-13T15:47:59,795 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-04-13T15:47:59,798 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-04-13T15:47:59,801 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-04-13T15:47:59,806 creating build/lib/deepspeed/runtime/data_pipeline 2023-04-13T15:47:59,808 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-04-13T15:47:59,813 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-04-13T15:47:59,816 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-04-13T15:47:59,820 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-04-13T15:47:59,826 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-04-13T15:47:59,827 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-04-13T15:47:59,834 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-04-13T15:47:59,838 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-04-13T15:47:59,843 creating build/lib/deepspeed/runtime/comm 2023-04-13T15:47:59,844 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-04-13T15:47:59,848 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-04-13T15:47:59,853 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-04-13T15:47:59,857 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-04-13T15:47:59,863 creating build/lib/deepspeed/runtime/swap_tensor 2023-04-13T15:47:59,865 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-13T15:47:59,871 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-13T15:47:59,874 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-13T15:47:59,879 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-13T15:47:59,883 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-13T15:47:59,887 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-13T15:47:59,891 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-13T15:47:59,896 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-13T15:47:59,902 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-04-13T15:47:59,907 creating build/lib/deepspeed/runtime/pipe 2023-04-13T15:47:59,909 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-04-13T15:47:59,917 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-04-13T15:47:59,920 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-04-13T15:47:59,926 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-04-13T15:47:59,931 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-04-13T15:47:59,937 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-04-13T15:47:59,943 creating build/lib/deepspeed/runtime/fp16/onebit 2023-04-13T15:47:59,944 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-04-13T15:47:59,948 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-04-13T15:47:59,954 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-04-13T15:47:59,959 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-04-13T15:47:59,966 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:47:59,968 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:47:59,973 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:47:59,977 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:47:59,980 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:47:59,984 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:47:59,989 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:47:59,991 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:47:59,995 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:47:59,998 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:48:00,003 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:48:00,009 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:48:00,016 creating build/lib/deepspeed/model_implementations/transformers 2023-04-13T15:48:00,018 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-13T15:48:00,022 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-13T15:48:00,025 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-13T15:48:00,030 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-13T15:48:00,033 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-13T15:48:00,037 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-13T15:48:00,040 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-13T15:48:00,044 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-13T15:48:00,047 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-04-13T15:48:00,052 creating build/lib/deepspeed/model_implementations/diffusers 2023-04-13T15:48:00,053 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-04-13T15:48:00,058 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-04-13T15:48:00,062 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-04-13T15:48:00,066 creating build/lib/deepspeed/model_implementations/features 2023-04-13T15:48:00,068 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-04-13T15:48:00,072 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-04-13T15:48:00,077 creating build/lib/deepspeed/autotuning/tuner 2023-04-13T15:48:00,079 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-04-13T15:48:00,083 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-04-13T15:48:00,086 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-04-13T15:48:00,090 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-04-13T15:48:00,094 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-04-13T15:48:00,098 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-04-13T15:48:00,103 creating build/lib/deepspeed/profiling/flops_profiler 2023-04-13T15:48:00,105 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-04-13T15:48:00,108 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-04-13T15:48:00,117 creating build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,119 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,123 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,127 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,131 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,135 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,138 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,142 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,146 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,149 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,153 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,157 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,161 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,165 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,170 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,175 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,178 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-04-13T15:48:00,183 creating build/lib/deepspeed/module_inject/containers/features 2023-04-13T15:48:00,185 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-04-13T15:48:00,189 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-04-13T15:48:00,192 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-04-13T15:48:00,197 running egg_info 2023-04-13T15:48:00,389 writing deepspeed.egg-info/PKG-INFO 2023-04-13T15:48:00,395 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-04-13T15:48:00,400 writing entry points to deepspeed.egg-info/entry_points.txt 2023-04-13T15:48:00,404 writing requirements to deepspeed.egg-info/requires.txt 2023-04-13T15:48:00,407 writing top-level names to deepspeed.egg-info/top_level.txt 2023-04-13T15:48:00,594 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-04-13T15:48:00,682 reading manifest template 'MANIFEST.in' 2023-04-13T15:48:01,951 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-04-13T15:48:02,885 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-04-13T15:48:03,484 warning: no files found matching '*.tr' under directory 'csrc' 2023-04-13T15:48:03,626 warning: no files found matching '*.cc' under directory 'csrc' 2023-04-13T15:48:03,651 warning: no files found matching '*.py' under directory 'benchmarks' 2023-04-13T15:48:03,659 adding license file 'LICENSE' 2023-04-13T15:48:03,729 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-04-13T15:48:03,746 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.autotuning.config_templates' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,747 !! 2023-04-13T15:48:03,747 ############################ 2023-04-13T15:48:03,748 # Package would be ignored # 2023-04-13T15:48:03,748 ############################ 2023-04-13T15:48:03,748 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, 2023-04-13T15:48:03,749 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,749 'deepspeed.autotuning.config_templates' has been automatically added to the distribution only 2023-04-13T15:48:03,750 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,750 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,750 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2023-04-13T15:48:03,751 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,751 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,751 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,752 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,752 documentation page. 2023-04-13T15:48:03,753 !! 2023-04-13T15:48:03,754 check.warn(importable) 2023-04-13T15:48:03,754 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adagrad' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,755 !! 2023-04-13T15:48:03,755 ############################ 2023-04-13T15:48:03,756 # Package would be ignored # 2023-04-13T15:48:03,756 ############################ 2023-04-13T15:48:03,756 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, 2023-04-13T15:48:03,757 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,757 'deepspeed.ops.csrc.adagrad' has been automatically added to the distribution only 2023-04-13T15:48:03,758 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,758 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,759 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2023-04-13T15:48:03,759 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,759 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,759 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,760 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,760 documentation page. 2023-04-13T15:48:03,761 !! 2023-04-13T15:48:03,762 check.warn(importable) 2023-04-13T15:48:03,762 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adam' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,762 !! 2023-04-13T15:48:03,763 ############################ 2023-04-13T15:48:03,764 # Package would be ignored # 2023-04-13T15:48:03,764 ############################ 2023-04-13T15:48:03,764 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, 2023-04-13T15:48:03,764 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,765 'deepspeed.ops.csrc.adam' has been automatically added to the distribution only 2023-04-13T15:48:03,765 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,766 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,766 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2023-04-13T15:48:03,767 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,767 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,767 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,768 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,768 documentation page. 2023-04-13T15:48:03,769 !! 2023-04-13T15:48:03,770 check.warn(importable) 2023-04-13T15:48:03,770 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.common' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,770 !! 2023-04-13T15:48:03,771 ############################ 2023-04-13T15:48:03,772 # Package would be ignored # 2023-04-13T15:48:03,772 ############################ 2023-04-13T15:48:03,772 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, 2023-04-13T15:48:03,772 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,773 'deepspeed.ops.csrc.aio.common' has been automatically added to the distribution only 2023-04-13T15:48:03,773 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,774 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,774 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2023-04-13T15:48:03,774 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,775 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,775 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,776 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,776 documentation page. 2023-04-13T15:48:03,777 !! 2023-04-13T15:48:03,778 check.warn(importable) 2023-04-13T15:48:03,778 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_lib' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,778 !! 2023-04-13T15:48:03,779 ############################ 2023-04-13T15:48:03,779 # Package would be ignored # 2023-04-13T15:48:03,780 ############################ 2023-04-13T15:48:03,780 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, 2023-04-13T15:48:03,780 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,781 'deepspeed.ops.csrc.aio.py_lib' has been automatically added to the distribution only 2023-04-13T15:48:03,781 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,781 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,782 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2023-04-13T15:48:03,782 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,782 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,783 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,783 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,784 documentation page. 2023-04-13T15:48:03,785 !! 2023-04-13T15:48:03,785 check.warn(importable) 2023-04-13T15:48:03,785 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_test' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,786 !! 2023-04-13T15:48:03,787 ############################ 2023-04-13T15:48:03,787 # Package would be ignored # 2023-04-13T15:48:03,787 ############################ 2023-04-13T15:48:03,788 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, 2023-04-13T15:48:03,788 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,788 'deepspeed.ops.csrc.aio.py_test' has been automatically added to the distribution only 2023-04-13T15:48:03,789 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,789 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,790 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2023-04-13T15:48:03,790 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,790 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,790 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,791 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,791 documentation page. 2023-04-13T15:48:03,792 !! 2023-04-13T15:48:03,793 check.warn(importable) 2023-04-13T15:48:03,793 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.common' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,793 !! 2023-04-13T15:48:03,794 ############################ 2023-04-13T15:48:03,794 # Package would be ignored # 2023-04-13T15:48:03,795 ############################ 2023-04-13T15:48:03,795 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, 2023-04-13T15:48:03,795 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,796 'deepspeed.ops.csrc.common' has been automatically added to the distribution only 2023-04-13T15:48:03,796 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,797 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,797 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2023-04-13T15:48:03,798 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,798 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,798 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,799 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,799 documentation page. 2023-04-13T15:48:03,800 !! 2023-04-13T15:48:03,800 check.warn(importable) 2023-04-13T15:48:03,801 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.includes' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,801 !! 2023-04-13T15:48:03,802 ############################ 2023-04-13T15:48:03,802 # Package would be ignored # 2023-04-13T15:48:03,802 ############################ 2023-04-13T15:48:03,803 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, 2023-04-13T15:48:03,803 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,804 'deepspeed.ops.csrc.includes' has been automatically added to the distribution only 2023-04-13T15:48:03,804 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,804 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,805 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2023-04-13T15:48:03,805 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,805 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,806 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,806 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,807 documentation page. 2023-04-13T15:48:03,807 !! 2023-04-13T15:48:03,808 check.warn(importable) 2023-04-13T15:48:03,808 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.lamb' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,809 !! 2023-04-13T15:48:03,809 ############################ 2023-04-13T15:48:03,810 # Package would be ignored # 2023-04-13T15:48:03,810 ############################ 2023-04-13T15:48:03,810 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, 2023-04-13T15:48:03,811 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,811 'deepspeed.ops.csrc.lamb' has been automatically added to the distribution only 2023-04-13T15:48:03,811 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,812 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,812 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2023-04-13T15:48:03,813 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,813 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,813 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,814 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,814 documentation page. 2023-04-13T15:48:03,815 !! 2023-04-13T15:48:03,816 check.warn(importable) 2023-04-13T15:48:03,816 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.quantization' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,817 !! 2023-04-13T15:48:03,818 ############################ 2023-04-13T15:48:03,818 # Package would be ignored # 2023-04-13T15:48:03,818 ############################ 2023-04-13T15:48:03,819 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, 2023-04-13T15:48:03,819 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,820 'deepspeed.ops.csrc.quantization' has been automatically added to the distribution only 2023-04-13T15:48:03,820 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,820 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,821 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2023-04-13T15:48:03,821 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,822 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,822 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,822 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,823 documentation page. 2023-04-13T15:48:03,824 !! 2023-04-13T15:48:03,824 check.warn(importable) 2023-04-13T15:48:03,825 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.random_ltd' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,825 !! 2023-04-13T15:48:03,826 ############################ 2023-04-13T15:48:03,827 # Package would be ignored # 2023-04-13T15:48:03,827 ############################ 2023-04-13T15:48:03,827 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package, 2023-04-13T15:48:03,828 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,828 'deepspeed.ops.csrc.random_ltd' has been automatically added to the distribution only 2023-04-13T15:48:03,829 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,829 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,830 Please make sure that 'deepspeed.ops.csrc.random_ltd' is included as a package by using 2023-04-13T15:48:03,830 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,830 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,831 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,831 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,832 documentation page. 2023-04-13T15:48:03,833 !! 2023-04-13T15:48:03,833 check.warn(importable) 2023-04-13T15:48:03,834 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.sparse_attention' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,834 !! 2023-04-13T15:48:03,835 ############################ 2023-04-13T15:48:03,835 # Package would be ignored # 2023-04-13T15:48:03,836 ############################ 2023-04-13T15:48:03,836 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, 2023-04-13T15:48:03,836 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,837 'deepspeed.ops.csrc.sparse_attention' has been automatically added to the distribution only 2023-04-13T15:48:03,838 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,838 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,838 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2023-04-13T15:48:03,839 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,839 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,839 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,840 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,840 documentation page. 2023-04-13T15:48:03,841 !! 2023-04-13T15:48:03,842 check.warn(importable) 2023-04-13T15:48:03,842 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.csrc' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,843 !! 2023-04-13T15:48:03,844 ############################ 2023-04-13T15:48:03,844 # Package would be ignored # 2023-04-13T15:48:03,844 ############################ 2023-04-13T15:48:03,845 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package, 2023-04-13T15:48:03,845 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,846 'deepspeed.ops.csrc.spatial.csrc' has been automatically added to the distribution only 2023-04-13T15:48:03,846 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,846 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,847 Please make sure that 'deepspeed.ops.csrc.spatial.csrc' is included as a package by using 2023-04-13T15:48:03,847 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,848 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,848 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,849 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,849 documentation page. 2023-04-13T15:48:03,850 !! 2023-04-13T15:48:03,851 check.warn(importable) 2023-04-13T15:48:03,851 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.includes' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,851 !! 2023-04-13T15:48:03,852 ############################ 2023-04-13T15:48:03,853 # Package would be ignored # 2023-04-13T15:48:03,853 ############################ 2023-04-13T15:48:03,853 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package, 2023-04-13T15:48:03,854 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,854 'deepspeed.ops.csrc.spatial.includes' has been automatically added to the distribution only 2023-04-13T15:48:03,855 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,855 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,856 Please make sure that 'deepspeed.ops.csrc.spatial.includes' is included as a package by using 2023-04-13T15:48:03,856 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,856 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,857 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,857 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,858 documentation page. 2023-04-13T15:48:03,859 !! 2023-04-13T15:48:03,859 check.warn(importable) 2023-04-13T15:48:03,860 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,860 !! 2023-04-13T15:48:03,861 ############################ 2023-04-13T15:48:03,861 # Package would be ignored # 2023-04-13T15:48:03,861 ############################ 2023-04-13T15:48:03,862 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, 2023-04-13T15:48:03,862 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,863 'deepspeed.ops.csrc.transformer' has been automatically added to the distribution only 2023-04-13T15:48:03,863 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,863 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,864 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2023-04-13T15:48:03,864 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,865 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,865 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,866 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,866 documentation page. 2023-04-13T15:48:03,867 !! 2023-04-13T15:48:03,868 check.warn(importable) 2023-04-13T15:48:03,868 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.csrc' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,868 !! 2023-04-13T15:48:03,869 ############################ 2023-04-13T15:48:03,870 # Package would be ignored # 2023-04-13T15:48:03,870 ############################ 2023-04-13T15:48:03,870 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, 2023-04-13T15:48:03,871 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,871 'deepspeed.ops.csrc.transformer.inference.csrc' has been automatically added to the distribution only 2023-04-13T15:48:03,872 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,872 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,873 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2023-04-13T15:48:03,873 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,873 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,874 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,874 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,875 documentation page. 2023-04-13T15:48:03,876 !! 2023-04-13T15:48:03,876 check.warn(importable) 2023-04-13T15:48:03,877 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.includes' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,877 !! 2023-04-13T15:48:03,878 ############################ 2023-04-13T15:48:03,878 # Package would be ignored # 2023-04-13T15:48:03,878 ############################ 2023-04-13T15:48:03,879 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, 2023-04-13T15:48:03,879 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,880 'deepspeed.ops.csrc.transformer.inference.includes' has been automatically added to the distribution only 2023-04-13T15:48:03,880 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,880 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,881 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2023-04-13T15:48:03,881 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,882 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,882 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,883 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,883 documentation page. 2023-04-13T15:48:03,884 !! 2023-04-13T15:48:03,885 check.warn(importable) 2023-04-13T15:48:03,885 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.utils' as data is deprecated, please list it in `packages`. 2023-04-13T15:48:03,885 !! 2023-04-13T15:48:03,887 ############################ 2023-04-13T15:48:03,887 # Package would be ignored # 2023-04-13T15:48:03,887 ############################ 2023-04-13T15:48:03,887 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, 2023-04-13T15:48:03,888 but it is not listed in the `packages` configuration of setuptools. 2023-04-13T15:48:03,888 'deepspeed.ops.csrc.utils' has been automatically added to the distribution only 2023-04-13T15:48:03,889 because it may contain data files, but this behavior is likely to change 2023-04-13T15:48:03,889 in future versions of setuptools (and therefore is considered deprecated). 2023-04-13T15:48:03,890 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2023-04-13T15:48:03,890 the `packages` configuration field or the proper discovery methods 2023-04-13T15:48:03,890 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-04-13T15:48:03,891 instead of `find_packages(...)`/`find:`). 2023-04-13T15:48:03,891 You can read more about "package discovery" and "data files" on setuptools 2023-04-13T15:48:03,892 documentation page. 2023-04-13T15:48:03,893 !! 2023-04-13T15:48:03,893 check.warn(importable) 2023-04-13T15:48:03,894 creating build/lib/deepspeed/ops/csrc 2023-04-13T15:48:03,894 creating build/lib/deepspeed/ops/csrc/adagrad 2023-04-13T15:48:03,894 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-04-13T15:48:03,895 creating build/lib/deepspeed/ops/csrc/adam 2023-04-13T15:48:03,895 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-04-13T15:48:03,895 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-04-13T15:48:03,896 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-04-13T15:48:03,896 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-04-13T15:48:03,896 creating build/lib/deepspeed/ops/csrc/aio 2023-04-13T15:48:03,897 creating build/lib/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:03,897 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:03,897 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:03,898 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:03,898 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:03,898 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:03,899 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:03,899 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,899 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,900 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,900 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,900 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,901 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,903 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,908 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,913 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,917 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,921 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,925 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:03,929 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-04-13T15:48:03,931 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-04-13T15:48:03,935 creating build/lib/deepspeed/ops/csrc/common 2023-04-13T15:48:03,938 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-04-13T15:48:03,942 creating build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,944 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,948 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,952 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,956 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,961 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,966 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,971 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,977 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,981 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,986 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,991 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,995 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:03,999 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,005 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,009 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,013 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,018 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,022 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,029 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,034 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,038 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,044 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,048 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,053 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,058 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,062 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,067 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-04-13T15:48:04,071 creating build/lib/deepspeed/ops/csrc/lamb 2023-04-13T15:48:04,073 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-04-13T15:48:04,077 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-04-13T15:48:04,083 creating build/lib/deepspeed/ops/csrc/quantization 2023-04-13T15:48:04,084 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-04-13T15:48:04,089 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-04-13T15:48:04,097 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-04-13T15:48:04,101 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-04-13T15:48:04,107 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-04-13T15:48:04,108 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-04-13T15:48:04,114 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-04-13T15:48:04,119 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-04-13T15:48:04,123 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-04-13T15:48:04,128 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-04-13T15:48:04,130 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-04-13T15:48:04,135 creating build/lib/deepspeed/ops/csrc/spatial 2023-04-13T15:48:04,136 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-04-13T15:48:04,139 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-04-13T15:48:04,145 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-04-13T15:48:04,150 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-04-13T15:48:04,152 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-04-13T15:48:04,156 creating build/lib/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,158 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,164 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,171 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,179 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,185 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,191 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,201 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,208 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,214 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-04-13T15:48:04,215 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,218 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,224 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,230 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,239 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,246 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,256 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,260 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,266 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,272 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-04-13T15:48:04,274 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-04-13T15:48:04,280 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-04-13T15:48:04,285 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-04-13T15:48:04,290 creating build/lib/deepspeed/ops/csrc/utils 2023-04-13T15:48:04,292 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-04-13T15:48:04,296 creating build/lib/deepspeed/autotuning/config_templates 2023-04-13T15:48:04,298 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-04-13T15:48:04,302 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-04-13T15:48:04,306 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-04-13T15:48:04,310 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-04-13T15:48:04,313 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-04-13T15:48:04,318 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-04-13T15:48:04,322 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-04-13T15:48:04,399 running build_scripts 2023-04-13T15:48:04,400 creating build/scripts-3.7 2023-04-13T15:48:04,402 copying and adjusting bin/deepspeed -> build/scripts-3.7 2023-04-13T15:48:04,405 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2023-04-13T15:48:04,408 copying and adjusting bin/ds -> build/scripts-3.7 2023-04-13T15:48:04,411 copying bin/ds_ssh -> build/scripts-3.7 2023-04-13T15:48:04,415 copying and adjusting bin/ds_report -> build/scripts-3.7 2023-04-13T15:48:04,417 copying and adjusting bin/ds_bench -> build/scripts-3.7 2023-04-13T15:48:04,420 copying and adjusting bin/dsr -> build/scripts-3.7 2023-04-13T15:48:04,423 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2023-04-13T15:48:04,425 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2023-04-13T15:48:04,426 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2023-04-13T15:48:04,426 changing mode of build/scripts-3.7/ds from 644 to 755 2023-04-13T15:48:04,427 changing mode of build/scripts-3.7/ds_report from 644 to 755 2023-04-13T15:48:04,428 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2023-04-13T15:48:04,428 changing mode of build/scripts-3.7/dsr from 644 to 755 2023-04-13T15:48:04,429 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2023-04-13T15:48:04,532 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2023-04-13T15:48:04,533 setuptools.SetuptoolsDeprecationWarning, 2023-04-13T15:48:04,632 installing to build/bdist.linux-armv7l/wheel 2023-04-13T15:48:04,632 running install 2023-04-13T15:48:04,693 running install_lib 2023-04-13T15:48:04,794 creating build/bdist.linux-armv7l 2023-04-13T15:48:04,795 creating build/bdist.linux-armv7l/wheel 2023-04-13T15:48:04,799 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-04-13T15:48:04,802 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-04-13T15:48:04,805 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-04-13T15:48:04,807 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-04-13T15:48:04,812 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-04-13T15:48:04,815 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-04-13T15:48:04,818 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-04-13T15:48:04,820 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-04-13T15:48:04,825 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,827 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,831 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,834 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,838 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,841 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,846 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,850 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,854 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,858 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,862 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,865 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-04-13T15:48:04,870 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:04,872 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:04,876 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:04,880 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:04,883 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:04,888 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:04,892 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-04-13T15:48:04,897 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-04-13T15:48:04,899 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-04-13T15:48:04,905 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-04-13T15:48:04,906 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-04-13T15:48:04,911 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-04-13T15:48:04,913 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-04-13T15:48:04,919 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,920 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,925 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-13T15:48:04,932 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-04-13T15:48:04,935 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,937 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,943 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,949 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,955 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,959 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,965 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,969 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,974 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-04-13T15:48:04,983 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-04-13T15:48:04,985 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-04-13T15:48:04,990 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-04-13T15:48:04,995 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-04-13T15:48:05,000 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-13T15:48:05,005 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-13T15:48:05,010 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-13T15:48:05,017 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-13T15:48:05,023 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-13T15:48:05,031 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-04-13T15:48:05,038 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-04-13T15:48:05,040 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-04-13T15:48:05,045 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-04-13T15:48:05,050 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-04-13T15:48:05,052 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-04-13T15:48:05,056 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-04-13T15:48:05,060 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-04-13T15:48:05,064 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-04-13T15:48:05,071 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-04-13T15:48:05,072 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-04-13T15:48:05,077 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-04-13T15:48:05,080 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-04-13T15:48:05,082 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-04-13T15:48:05,087 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-04-13T15:48:05,091 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-04-13T15:48:05,093 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-04-13T15:48:05,098 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-04-13T15:48:05,100 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-04-13T15:48:05,104 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-04-13T15:48:05,109 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-04-13T15:48:05,114 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-04-13T15:48:05,120 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,122 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,127 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,132 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,136 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,140 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,144 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,149 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,153 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,157 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,160 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,166 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,170 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,174 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,178 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,182 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,185 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,189 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,193 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,197 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,201 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,206 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,209 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,213 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,218 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,221 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,226 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,230 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-04-13T15:48:05,236 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-04-13T15:48:05,237 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-04-13T15:48:05,241 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-04-13T15:48:05,245 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-04-13T15:48:05,250 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-04-13T15:48:05,256 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-04-13T15:48:05,257 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-04-13T15:48:05,261 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-04-13T15:48:05,266 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-13T15:48:05,268 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-13T15:48:05,272 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-13T15:48:05,276 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-13T15:48:05,280 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-13T15:48:05,285 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-13T15:48:05,290 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-13T15:48:05,298 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-04-13T15:48:05,299 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-04-13T15:48:05,303 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-04-13T15:48:05,307 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-04-13T15:48:05,311 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-04-13T15:48:05,315 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-04-13T15:48:05,321 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-04-13T15:48:05,323 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-04-13T15:48:05,328 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-04-13T15:48:05,333 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,335 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,340 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,346 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,348 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,352 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,355 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,359 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,362 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,366 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,370 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,374 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,378 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,381 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-04-13T15:48:05,385 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,389 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,393 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,397 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,401 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,405 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,410 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,415 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-04-13T15:48:05,421 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-04-13T15:48:05,423 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-04-13T15:48:05,427 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-04-13T15:48:05,433 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,434 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,438 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,442 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,445 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,449 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,453 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,459 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,463 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,466 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,470 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,474 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,477 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,481 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,484 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,488 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,492 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-04-13T15:48:05,495 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-04-13T15:48:05,500 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-04-13T15:48:05,502 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-04-13T15:48:05,506 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-04-13T15:48:05,510 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-04-13T15:48:05,512 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-04-13T15:48:05,516 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-04-13T15:48:05,521 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-04-13T15:48:05,523 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-04-13T15:48:05,527 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-04-13T15:48:05,531 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-04-13T15:48:05,535 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-04-13T15:48:05,540 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-04-13T15:48:05,544 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-13T15:48:05,546 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-13T15:48:05,551 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-13T15:48:05,556 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-13T15:48:05,560 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-13T15:48:05,564 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-13T15:48:05,569 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-13T15:48:05,574 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-13T15:48:05,578 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-04-13T15:48:05,584 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-13T15:48:05,585 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-13T15:48:05,589 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-13T15:48:05,593 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-13T15:48:05,597 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-13T15:48:05,601 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-13T15:48:05,606 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-04-13T15:48:05,611 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-13T15:48:05,613 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-13T15:48:05,617 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-13T15:48:05,620 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-13T15:48:05,624 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-13T15:48:05,628 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-13T15:48:05,632 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-13T15:48:05,635 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-04-13T15:48:05,641 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,642 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,646 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,651 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,654 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,658 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,663 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,668 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,673 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,677 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,681 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,684 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,688 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,693 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-04-13T15:48:05,699 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-13T15:48:05,701 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-13T15:48:05,705 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-13T15:48:05,710 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-13T15:48:05,714 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-13T15:48:05,718 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-13T15:48:05,722 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-13T15:48:05,726 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-13T15:48:05,730 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-13T15:48:05,733 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-04-13T15:48:05,738 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-04-13T15:48:05,742 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-04-13T15:48:05,747 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-04-13T15:48:05,749 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-04-13T15:48:05,755 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-04-13T15:48:05,759 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-04-13T15:48:05,765 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-13T15:48:05,766 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-13T15:48:05,770 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-13T15:48:05,774 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-13T15:48:05,778 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-13T15:48:05,783 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-13T15:48:05,787 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-04-13T15:48:05,793 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:05,795 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:05,808 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-04-13T15:48:05,809 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-04-13T15:48:05,813 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-04-13T15:48:05,817 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:05,822 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,824 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,829 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,841 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,844 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,853 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,857 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,861 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,864 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,869 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,875 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,880 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,884 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,889 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-04-13T15:48:05,902 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-04-13T15:48:05,903 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-04-13T15:48:05,909 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-04-13T15:48:05,914 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-04-13T15:48:05,918 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-04-13T15:48:05,920 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-04-13T15:48:05,924 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-04-13T15:48:05,929 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-04-13T15:48:05,934 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-04-13T15:48:05,939 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-04-13T15:48:05,945 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-04-13T15:48:05,947 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-04-13T15:48:05,951 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-04-13T15:48:05,955 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-04-13T15:48:05,958 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-04-13T15:48:05,962 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:05,965 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:05,970 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:05,976 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:05,982 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:05,986 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:05,992 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-04-13T15:48:05,994 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-04-13T15:48:05,999 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-04-13T15:48:06,004 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:48:06,005 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:48:06,010 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:48:06,014 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:48:06,018 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:48:06,021 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-04-13T15:48:06,025 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-04-13T15:48:06,029 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-04-13T15:48:06,035 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:48:06,036 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:48:06,040 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:48:06,044 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:48:06,049 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:48:06,054 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-04-13T15:48:06,060 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:06,065 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-04-13T15:48:06,067 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-04-13T15:48:06,072 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-04-13T15:48:06,076 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-04-13T15:48:06,079 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:06,083 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:06,089 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-04-13T15:48:06,091 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-04-13T15:48:06,095 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-04-13T15:48:06,099 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-04-13T15:48:06,103 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-04-13T15:48:06,108 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-13T15:48:06,110 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-13T15:48:06,115 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-13T15:48:06,119 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-13T15:48:06,124 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-13T15:48:06,127 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-13T15:48:06,132 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-13T15:48:06,136 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-13T15:48:06,141 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-13T15:48:06,146 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-04-13T15:48:06,150 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:06,155 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:06,162 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-13T15:48:06,163 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-13T15:48:06,171 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-13T15:48:06,174 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-13T15:48:06,179 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-13T15:48:06,184 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-13T15:48:06,189 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-04-13T15:48:06,193 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:06,197 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:06,202 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-04-13T15:48:06,208 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-04-13T15:48:06,209 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-04-13T15:48:06,214 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-13T15:48:06,216 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-13T15:48:06,219 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-13T15:48:06,223 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-13T15:48:06,227 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-13T15:48:06,230 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-13T15:48:06,233 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-13T15:48:06,237 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-13T15:48:06,240 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-13T15:48:06,243 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-04-13T15:48:06,248 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-04-13T15:48:06,249 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-04-13T15:48:06,253 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-04-13T15:48:06,257 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-04-13T15:48:06,262 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-04-13T15:48:06,263 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-04-13T15:48:06,267 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-04-13T15:48:06,271 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-13T15:48:06,273 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-13T15:48:06,278 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-13T15:48:06,281 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-13T15:48:06,285 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-13T15:48:06,288 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-13T15:48:06,292 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-13T15:48:06,297 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-04-13T15:48:06,302 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-13T15:48:06,303 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-13T15:48:06,308 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-13T15:48:06,311 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-13T15:48:06,317 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-04-13T15:48:06,319 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-04-13T15:48:06,322 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-04-13T15:48:06,325 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-04-13T15:48:06,329 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-04-13T15:48:06,332 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-13T15:48:06,336 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-13T15:48:06,343 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-04-13T15:48:06,348 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-13T15:48:06,350 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-13T15:48:06,354 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-13T15:48:06,357 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-13T15:48:06,361 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-13T15:48:06,364 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-13T15:48:06,367 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-04-13T15:48:06,372 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-04-13T15:48:06,374 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-04-13T15:48:06,379 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-04-13T15:48:06,380 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-04-13T15:48:06,384 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-04-13T15:48:06,390 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-04-13T15:48:06,394 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-04-13T15:48:06,398 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-04-13T15:48:06,400 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-04-13T15:48:06,403 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-04-13T15:48:06,408 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-04-13T15:48:06,411 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-04-13T15:48:06,415 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-04-13T15:48:06,419 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-04-13T15:48:06,421 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-04-13T15:48:06,425 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-13T15:48:06,427 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-13T15:48:06,432 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-13T15:48:06,435 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-13T15:48:06,440 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-13T15:48:06,445 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-04-13T15:48:06,450 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,451 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,455 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,460 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,463 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,468 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,471 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,475 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,481 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,484 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,488 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-04-13T15:48:06,493 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,495 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,498 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,502 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,506 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,510 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,513 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,517 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,521 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,524 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,528 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,532 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,536 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,542 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-04-13T15:48:06,543 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-04-13T15:48:06,547 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-04-13T15:48:06,551 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-04-13T15:48:06,554 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,559 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,564 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,568 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-04-13T15:48:06,571 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-04-13T15:48:06,576 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-04-13T15:48:06,577 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-04-13T15:48:06,581 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-04-13T15:48:06,585 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-04-13T15:48:06,588 running install_egg_info 2023-04-13T15:48:06,699 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.9.0-py3.7.egg-info 2023-04-13T15:48:06,727 running install_scripts 2023-04-13T15:48:06,729 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data 2023-04-13T15:48:06,730 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts 2023-04-13T15:48:06,732 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts 2023-04-13T15:48:06,736 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts 2023-04-13T15:48:06,739 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts 2023-04-13T15:48:06,743 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts 2023-04-13T15:48:06,747 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts 2023-04-13T15:48:06,750 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts 2023-04-13T15:48:06,753 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts 2023-04-13T15:48:06,757 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts 2023-04-13T15:48:06,760 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts/ds_ssh to 755 2023-04-13T15:48:06,761 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts/ds to 755 2023-04-13T15:48:06,761 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts/deepspeed.pt to 755 2023-04-13T15:48:06,762 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts/ds_elastic to 755 2023-04-13T15:48:06,763 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts/deepspeed to 755 2023-04-13T15:48:06,763 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts/dsr to 755 2023-04-13T15:48:06,764 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts/ds_bench to 755 2023-04-13T15:48:06,765 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.data/scripts/ds_report to 755 2023-04-13T15:48:06,886 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.0.dist-info/WHEEL 2023-04-13T15:48:06,891 creating '/tmp/pip-wheel-srvgkdj9/deepspeed-0.9.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-04-13T15:48:06,899 adding 'deepspeed/__init__.py' 2023-04-13T15:48:06,902 adding 'deepspeed/constants.py' 2023-04-13T15:48:06,905 adding 'deepspeed/env_report.py' 2023-04-13T15:48:06,907 adding 'deepspeed/git_version_info.py' 2023-04-13T15:48:06,910 adding 'deepspeed/git_version_info_installed.py' 2023-04-13T15:48:06,913 adding 'deepspeed/accelerator/__init__.py' 2023-04-13T15:48:06,916 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-04-13T15:48:06,920 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-04-13T15:48:06,923 adding 'deepspeed/accelerator/real_accelerator.py' 2023-04-13T15:48:06,926 adding 'deepspeed/autotuning/__init__.py' 2023-04-13T15:48:06,939 adding 'deepspeed/autotuning/autotuner.py' 2023-04-13T15:48:06,943 adding 'deepspeed/autotuning/config.py' 2023-04-13T15:48:06,946 adding 'deepspeed/autotuning/constants.py' 2023-04-13T15:48:06,952 adding 'deepspeed/autotuning/scheduler.py' 2023-04-13T15:48:06,957 adding 'deepspeed/autotuning/utils.py' 2023-04-13T15:48:06,961 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-04-13T15:48:06,963 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-04-13T15:48:06,965 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-04-13T15:48:06,968 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-04-13T15:48:06,972 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-04-13T15:48:06,977 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-04-13T15:48:06,979 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-04-13T15:48:06,982 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-04-13T15:48:06,985 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-04-13T15:48:06,988 adding 'deepspeed/autotuning/tuner/utils.py' 2023-04-13T15:48:06,992 adding 'deepspeed/checkpoint/__init__.py' 2023-04-13T15:48:06,995 adding 'deepspeed/checkpoint/constants.py' 2023-04-13T15:48:06,999 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-04-13T15:48:07,002 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-04-13T15:48:07,006 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-04-13T15:48:07,009 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-04-13T15:48:07,012 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-04-13T15:48:07,015 adding 'deepspeed/checkpoint/utils.py' 2023-04-13T15:48:07,018 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-04-13T15:48:07,022 adding 'deepspeed/comm/__init__.py' 2023-04-13T15:48:07,025 adding 'deepspeed/comm/backend.py' 2023-04-13T15:48:07,032 adding 'deepspeed/comm/comm.py' 2023-04-13T15:48:07,035 adding 'deepspeed/comm/config.py' 2023-04-13T15:48:07,038 adding 'deepspeed/comm/constants.py' 2023-04-13T15:48:07,041 adding 'deepspeed/comm/torch.py' 2023-04-13T15:48:07,045 adding 'deepspeed/comm/utils.py' 2023-04-13T15:48:07,048 adding 'deepspeed/compression/__init__.py' 2023-04-13T15:48:07,056 adding 'deepspeed/compression/basic_layer.py' 2023-04-13T15:48:07,061 adding 'deepspeed/compression/compress.py' 2023-04-13T15:48:07,065 adding 'deepspeed/compression/config.py' 2023-04-13T15:48:07,069 adding 'deepspeed/compression/constants.py' 2023-04-13T15:48:07,072 adding 'deepspeed/compression/helper.py' 2023-04-13T15:48:07,076 adding 'deepspeed/compression/scheduler.py' 2023-04-13T15:48:07,079 adding 'deepspeed/compression/utils.py' 2023-04-13T15:48:07,083 adding 'deepspeed/elasticity/__init__.py' 2023-04-13T15:48:07,086 adding 'deepspeed/elasticity/config.py' 2023-04-13T15:48:07,089 adding 'deepspeed/elasticity/constants.py' 2023-04-13T15:48:07,092 adding 'deepspeed/elasticity/elastic_agent.py' 2023-04-13T15:48:07,098 adding 'deepspeed/elasticity/elasticity.py' 2023-04-13T15:48:07,101 adding 'deepspeed/elasticity/utils.py' 2023-04-13T15:48:07,104 adding 'deepspeed/inference/__init__.py' 2023-04-13T15:48:07,108 adding 'deepspeed/inference/config.py' 2023-04-13T15:48:07,117 adding 'deepspeed/inference/engine.py' 2023-04-13T15:48:07,121 adding 'deepspeed/launcher/__init__.py' 2023-04-13T15:48:07,123 adding 'deepspeed/launcher/constants.py' 2023-04-13T15:48:07,129 adding 'deepspeed/launcher/launch.py' 2023-04-13T15:48:07,133 adding 'deepspeed/launcher/multinode_runner.py' 2023-04-13T15:48:07,140 adding 'deepspeed/launcher/runner.py' 2023-04-13T15:48:07,144 adding 'deepspeed/model_implementations/__init__.py' 2023-04-13T15:48:07,147 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-04-13T15:48:07,150 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-04-13T15:48:07,153 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-04-13T15:48:07,156 adding 'deepspeed/model_implementations/features/__init__.py' 2023-04-13T15:48:07,158 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-04-13T15:48:07,162 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-04-13T15:48:07,165 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-04-13T15:48:07,167 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-04-13T15:48:07,170 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-04-13T15:48:07,172 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-04-13T15:48:07,174 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-04-13T15:48:07,177 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-04-13T15:48:07,179 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-04-13T15:48:07,183 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-04-13T15:48:07,186 adding 'deepspeed/module_inject/__init__.py' 2023-04-13T15:48:07,189 adding 'deepspeed/module_inject/auto_tp.py' 2023-04-13T15:48:07,192 adding 'deepspeed/module_inject/inject.py' 2023-04-13T15:48:07,195 adding 'deepspeed/module_inject/layers.py' 2023-04-13T15:48:07,199 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-04-13T15:48:07,202 adding 'deepspeed/module_inject/module_quantize.py' 2023-04-13T15:48:07,206 adding 'deepspeed/module_inject/policy.py' 2023-04-13T15:48:07,215 adding 'deepspeed/module_inject/replace_module.py' 2023-04-13T15:48:07,218 adding 'deepspeed/module_inject/replace_policy.py' 2023-04-13T15:48:07,221 adding 'deepspeed/module_inject/utils.py' 2023-04-13T15:48:07,225 adding 'deepspeed/module_inject/containers/__init__.py' 2023-04-13T15:48:07,230 adding 'deepspeed/module_inject/containers/base.py' 2023-04-13T15:48:07,234 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-04-13T15:48:07,237 adding 'deepspeed/module_inject/containers/bert.py' 2023-04-13T15:48:07,240 adding 'deepspeed/module_inject/containers/bloom.py' 2023-04-13T15:48:07,242 adding 'deepspeed/module_inject/containers/clip.py' 2023-04-13T15:48:07,245 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-04-13T15:48:07,248 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-04-13T15:48:07,251 adding 'deepspeed/module_inject/containers/gptj.py' 2023-04-13T15:48:07,254 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-04-13T15:48:07,257 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-04-13T15:48:07,260 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-04-13T15:48:07,262 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-04-13T15:48:07,265 adding 'deepspeed/module_inject/containers/opt.py' 2023-04-13T15:48:07,268 adding 'deepspeed/module_inject/containers/unet.py' 2023-04-13T15:48:07,271 adding 'deepspeed/module_inject/containers/vae.py' 2023-04-13T15:48:07,274 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-04-13T15:48:07,277 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-04-13T15:48:07,279 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-04-13T15:48:07,283 adding 'deepspeed/moe/__init__.py' 2023-04-13T15:48:07,285 adding 'deepspeed/moe/experts.py' 2023-04-13T15:48:07,289 adding 'deepspeed/moe/layer.py' 2023-04-13T15:48:07,292 adding 'deepspeed/moe/mappings.py' 2023-04-13T15:48:07,298 adding 'deepspeed/moe/sharded_moe.py' 2023-04-13T15:48:07,301 adding 'deepspeed/moe/utils.py' 2023-04-13T15:48:07,305 adding 'deepspeed/monitor/__init__.py' 2023-04-13T15:48:07,308 adding 'deepspeed/monitor/config.py' 2023-04-13T15:48:07,310 adding 'deepspeed/monitor/csv_monitor.py' 2023-04-13T15:48:07,313 adding 'deepspeed/monitor/monitor.py' 2023-04-13T15:48:07,316 adding 'deepspeed/monitor/tensorboard.py' 2023-04-13T15:48:07,318 adding 'deepspeed/monitor/utils.py' 2023-04-13T15:48:07,321 adding 'deepspeed/monitor/wandb.py' 2023-04-13T15:48:07,324 adding 'deepspeed/nebula/__init__.py' 2023-04-13T15:48:07,327 adding 'deepspeed/nebula/config.py' 2023-04-13T15:48:07,329 adding 'deepspeed/nebula/constants.py' 2023-04-13T15:48:07,333 adding 'deepspeed/ops/__init__.py' 2023-04-13T15:48:07,336 adding 'deepspeed/ops/adagrad/__init__.py' 2023-04-13T15:48:07,339 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-04-13T15:48:07,343 adding 'deepspeed/ops/adam/__init__.py' 2023-04-13T15:48:07,347 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-04-13T15:48:07,350 adding 'deepspeed/ops/adam/fused_adam.py' 2023-04-13T15:48:07,353 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-04-13T15:48:07,356 adding 'deepspeed/ops/aio/__init__.py' 2023-04-13T15:48:07,362 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-04-13T15:48:07,367 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-04-13T15:48:07,370 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-04-13T15:48:07,373 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-04-13T15:48:07,376 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-04-13T15:48:07,383 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-04-13T15:48:07,386 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-04-13T15:48:07,388 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-04-13T15:48:07,391 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-04-13T15:48:07,394 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-04-13T15:48:07,397 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-04-13T15:48:07,401 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-04-13T15:48:07,404 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-04-13T15:48:07,406 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-04-13T15:48:07,409 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-04-13T15:48:07,412 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-04-13T15:48:07,414 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-04-13T15:48:07,418 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-04-13T15:48:07,421 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-04-13T15:48:07,424 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-04-13T15:48:07,427 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-04-13T15:48:07,433 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-04-13T15:48:07,437 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-04-13T15:48:07,440 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-04-13T15:48:07,445 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-04-13T15:48:07,448 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-04-13T15:48:07,451 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-04-13T15:48:07,454 adding 'deepspeed/ops/csrc/includes/context.h' 2023-04-13T15:48:07,458 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-04-13T15:48:07,462 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-04-13T15:48:07,465 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-04-13T15:48:07,468 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-04-13T15:48:07,472 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-04-13T15:48:07,476 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-04-13T15:48:07,479 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-04-13T15:48:07,481 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-04-13T15:48:07,484 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-04-13T15:48:07,487 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-04-13T15:48:07,490 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-04-13T15:48:07,493 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-04-13T15:48:07,496 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-04-13T15:48:07,502 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-04-13T15:48:07,505 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-04-13T15:48:07,508 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-04-13T15:48:07,513 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-04-13T15:48:07,516 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-04-13T15:48:07,521 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-04-13T15:48:07,524 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-04-13T15:48:07,527 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-04-13T15:48:07,530 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-04-13T15:48:07,534 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-04-13T15:48:07,538 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-04-13T15:48:07,542 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-04-13T15:48:07,547 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-04-13T15:48:07,553 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-04-13T15:48:07,557 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-04-13T15:48:07,561 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-04-13T15:48:07,565 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-04-13T15:48:07,569 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-04-13T15:48:07,572 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-04-13T15:48:07,576 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-04-13T15:48:07,580 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-04-13T15:48:07,585 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-04-13T15:48:07,588 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-04-13T15:48:07,592 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-04-13T15:48:07,597 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-04-13T15:48:07,603 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-04-13T15:48:07,612 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-04-13T15:48:07,617 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-04-13T15:48:07,621 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-04-13T15:48:07,632 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-04-13T15:48:07,639 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-04-13T15:48:07,645 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-04-13T15:48:07,652 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-04-13T15:48:07,655 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-04-13T15:48:07,662 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-04-13T15:48:07,667 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-04-13T15:48:07,680 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-04-13T15:48:07,684 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-04-13T15:48:07,689 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-04-13T15:48:07,696 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-04-13T15:48:07,701 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-04-13T15:48:07,705 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-04-13T15:48:07,709 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-04-13T15:48:07,713 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-04-13T15:48:07,716 adding 'deepspeed/ops/lamb/__init__.py' 2023-04-13T15:48:07,720 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-04-13T15:48:07,724 adding 'deepspeed/ops/op_builder/__init__.py' 2023-04-13T15:48:07,727 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-04-13T15:48:07,730 adding 'deepspeed/ops/op_builder/async_io.py' 2023-04-13T15:48:07,737 adding 'deepspeed/ops/op_builder/builder.py' 2023-04-13T15:48:07,741 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-04-13T15:48:07,743 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-04-13T15:48:07,746 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-04-13T15:48:07,749 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-04-13T15:48:07,751 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-04-13T15:48:07,754 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-04-13T15:48:07,757 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-04-13T15:48:07,760 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-04-13T15:48:07,762 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-04-13T15:48:07,765 adding 'deepspeed/ops/op_builder/transformer.py' 2023-04-13T15:48:07,767 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-04-13T15:48:07,770 adding 'deepspeed/ops/op_builder/utils.py' 2023-04-13T15:48:07,773 adding 'deepspeed/ops/quantizer/__init__.py' 2023-04-13T15:48:07,776 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-04-13T15:48:07,779 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-04-13T15:48:07,782 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-04-13T15:48:07,786 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-04-13T15:48:07,789 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-04-13T15:48:07,798 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-04-13T15:48:07,803 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-04-13T15:48:07,808 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-04-13T15:48:07,812 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-04-13T15:48:07,819 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-04-13T15:48:07,824 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-04-13T15:48:07,827 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-04-13T15:48:07,830 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-04-13T15:48:07,833 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-04-13T15:48:07,837 adding 'deepspeed/ops/transformer/__init__.py' 2023-04-13T15:48:07,843 adding 'deepspeed/ops/transformer/transformer.py' 2023-04-13T15:48:07,847 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-04-13T15:48:07,849 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-04-13T15:48:07,853 adding 'deepspeed/ops/transformer/inference/config.py' 2023-04-13T15:48:07,855 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-04-13T15:48:07,859 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-04-13T15:48:07,862 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-04-13T15:48:07,867 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-04-13T15:48:07,870 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-04-13T15:48:07,875 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-04-13T15:48:07,879 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-04-13T15:48:07,883 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-04-13T15:48:07,885 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-04-13T15:48:07,888 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-04-13T15:48:07,891 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-04-13T15:48:07,893 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-04-13T15:48:07,896 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-04-13T15:48:07,899 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-04-13T15:48:07,901 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-04-13T15:48:07,904 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-04-13T15:48:07,906 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-04-13T15:48:07,910 adding 'deepspeed/pipe/__init__.py' 2023-04-13T15:48:07,913 adding 'deepspeed/profiling/__init__.py' 2023-04-13T15:48:07,916 adding 'deepspeed/profiling/config.py' 2023-04-13T15:48:07,918 adding 'deepspeed/profiling/constants.py' 2023-04-13T15:48:07,922 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-04-13T15:48:07,934 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-04-13T15:48:07,939 adding 'deepspeed/runtime/__init__.py' 2023-04-13T15:48:07,944 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-04-13T15:48:07,954 adding 'deepspeed/runtime/config.py' 2023-04-13T15:48:07,958 adding 'deepspeed/runtime/config_utils.py' 2023-04-13T15:48:07,963 adding 'deepspeed/runtime/constants.py' 2023-04-13T15:48:07,966 adding 'deepspeed/runtime/dataloader.py' 2023-04-13T15:48:07,969 adding 'deepspeed/runtime/eigenvalue.py' 2023-04-13T15:48:08,009 adding 'deepspeed/runtime/engine.py' 2023-04-13T15:48:08,017 adding 'deepspeed/runtime/hybrid_engine.py' 2023-04-13T15:48:08,025 adding 'deepspeed/runtime/lr_schedules.py' 2023-04-13T15:48:08,029 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-04-13T15:48:08,032 adding 'deepspeed/runtime/quantize.py' 2023-04-13T15:48:08,035 adding 'deepspeed/runtime/sparse_tensor.py' 2023-04-13T15:48:08,040 adding 'deepspeed/runtime/state_dict_factory.py' 2023-04-13T15:48:08,050 adding 'deepspeed/runtime/utils.py' 2023-04-13T15:48:08,054 adding 'deepspeed/runtime/weight_quantizer.py' 2023-04-13T15:48:08,058 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-04-13T15:48:08,067 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-04-13T15:48:08,070 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-04-13T15:48:08,074 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-04-13T15:48:08,076 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-04-13T15:48:08,079 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-04-13T15:48:08,082 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-04-13T15:48:08,085 adding 'deepspeed/runtime/comm/__init__.py' 2023-04-13T15:48:08,088 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-04-13T15:48:08,092 adding 'deepspeed/runtime/comm/mpi.py' 2023-04-13T15:48:08,095 adding 'deepspeed/runtime/comm/nccl.py' 2023-04-13T15:48:08,099 adding 'deepspeed/runtime/compression/__init__.py' 2023-04-13T15:48:08,101 adding 'deepspeed/runtime/compression/cupy.py' 2023-04-13T15:48:08,105 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-04-13T15:48:08,108 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-04-13T15:48:08,111 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-04-13T15:48:08,114 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-04-13T15:48:08,118 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-04-13T15:48:08,121 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-04-13T15:48:08,124 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-04-13T15:48:08,127 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-04-13T15:48:08,129 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-04-13T15:48:08,133 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-04-13T15:48:08,139 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-04-13T15:48:08,144 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-04-13T15:48:08,151 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-04-13T15:48:08,154 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-04-13T15:48:08,157 adding 'deepspeed/runtime/fp16/__init__.py' 2023-04-13T15:48:08,163 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-04-13T15:48:08,168 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-04-13T15:48:08,173 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-04-13T15:48:08,177 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-04-13T15:48:08,182 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-04-13T15:48:08,188 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-04-13T15:48:08,194 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-04-13T15:48:08,198 adding 'deepspeed/runtime/pipe/__init__.py' 2023-04-13T15:48:08,212 adding 'deepspeed/runtime/pipe/engine.py' 2023-04-13T15:48:08,222 adding 'deepspeed/runtime/pipe/module.py' 2023-04-13T15:48:08,226 adding 'deepspeed/runtime/pipe/p2p.py' 2023-04-13T15:48:08,230 adding 'deepspeed/runtime/pipe/schedule.py' 2023-04-13T15:48:08,236 adding 'deepspeed/runtime/pipe/topology.py' 2023-04-13T15:48:08,240 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-04-13T15:48:08,242 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-04-13T15:48:08,246 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-04-13T15:48:08,248 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-04-13T15:48:08,254 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-04-13T15:48:08,258 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-04-13T15:48:08,263 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-04-13T15:48:08,268 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-04-13T15:48:08,271 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-04-13T15:48:08,275 adding 'deepspeed/runtime/zero/__init__.py' 2023-04-13T15:48:08,280 adding 'deepspeed/runtime/zero/config.py' 2023-04-13T15:48:08,284 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-04-13T15:48:08,288 adding 'deepspeed/runtime/zero/linear.py' 2023-04-13T15:48:08,291 adding 'deepspeed/runtime/zero/offload_config.py' 2023-04-13T15:48:08,297 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-04-13T15:48:08,317 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-04-13T15:48:08,325 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-04-13T15:48:08,356 adding 'deepspeed/runtime/zero/stage3.py' 2023-04-13T15:48:08,388 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-04-13T15:48:08,393 adding 'deepspeed/runtime/zero/test.py' 2023-04-13T15:48:08,398 adding 'deepspeed/runtime/zero/tiling.py' 2023-04-13T15:48:08,401 adding 'deepspeed/runtime/zero/utils.py' 2023-04-13T15:48:08,405 adding 'deepspeed/utils/__init__.py' 2023-04-13T15:48:08,408 adding 'deepspeed/utils/comms_logging.py' 2023-04-13T15:48:08,411 adding 'deepspeed/utils/debug.py' 2023-04-13T15:48:08,414 adding 'deepspeed/utils/exceptions.py' 2023-04-13T15:48:08,419 adding 'deepspeed/utils/groups.py' 2023-04-13T15:48:08,422 adding 'deepspeed/utils/init_on_device.py' 2023-04-13T15:48:08,425 adding 'deepspeed/utils/logging.py' 2023-04-13T15:48:08,428 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-04-13T15:48:08,430 adding 'deepspeed/utils/nvtx.py' 2023-04-13T15:48:08,434 adding 'deepspeed/utils/tensor_fragment.py' 2023-04-13T15:48:08,438 adding 'deepspeed/utils/timer.py' 2023-04-13T15:48:08,440 adding 'deepspeed/utils/types.py' 2023-04-13T15:48:08,446 adding 'deepspeed/utils/zero_to_fp32.py' 2023-04-13T15:48:08,451 adding 'deepspeed-0.9.0.data/scripts/deepspeed' 2023-04-13T15:48:08,453 adding 'deepspeed-0.9.0.data/scripts/deepspeed.pt' 2023-04-13T15:48:08,456 adding 'deepspeed-0.9.0.data/scripts/ds' 2023-04-13T15:48:08,458 adding 'deepspeed-0.9.0.data/scripts/ds_bench' 2023-04-13T15:48:08,461 adding 'deepspeed-0.9.0.data/scripts/ds_elastic' 2023-04-13T15:48:08,463 adding 'deepspeed-0.9.0.data/scripts/ds_report' 2023-04-13T15:48:08,465 adding 'deepspeed-0.9.0.data/scripts/ds_ssh' 2023-04-13T15:48:08,468 adding 'deepspeed-0.9.0.data/scripts/dsr' 2023-04-13T15:48:08,475 adding 'deepspeed-0.9.0.dist-info/LICENSE' 2023-04-13T15:48:08,483 adding 'deepspeed-0.9.0.dist-info/METADATA' 2023-04-13T15:48:08,486 adding 'deepspeed-0.9.0.dist-info/WHEEL' 2023-04-13T15:48:08,488 adding 'deepspeed-0.9.0.dist-info/entry_points.txt' 2023-04-13T15:48:08,490 adding 'deepspeed-0.9.0.dist-info/top_level.txt' 2023-04-13T15:48:08,506 adding 'deepspeed-0.9.0.dist-info/RECORD' 2023-04-13T15:48:08,546 removing build/bdist.linux-armv7l/wheel 2023-04-13T15:48:08,763 deepspeed build time = 12.495161533355713 secs 2023-04-13T15:48:08,947 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-04-13T15:48:08,978 Created wheel for deepspeed: filename=deepspeed-0.9.0-py3-none-any.whl size=797672 sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 2023-04-13T15:48:08,980 Stored in directory: /tmp/pip-ephem-wheel-cache-mcb44v4c/wheels/fd/82/54/4663e7d4303ad2bafb8e5316424a208b8ba74ba9b754b9df66 2023-04-13T15:48:09,053 Successfully built deepspeed 2023-04-13T15:48:09,111 Removed build tracker: '/tmp/pip-build-tracker-ierd7iwv'