2023-01-17T18:59:37,506 Created temporary directory: /tmp/pip-ephem-wheel-cache-b97b95a1 2023-01-17T18:59:37,511 Created temporary directory: /tmp/pip-build-tracker-rjcn4ffv 2023-01-17T18:59:37,512 Initialized build tracking at /tmp/pip-build-tracker-rjcn4ffv 2023-01-17T18:59:37,512 Created build tracker: /tmp/pip-build-tracker-rjcn4ffv 2023-01-17T18:59:37,513 Entered build tracker: /tmp/pip-build-tracker-rjcn4ffv 2023-01-17T18:59:37,514 Created temporary directory: /tmp/pip-wheel-o2wjand_ 2023-01-17T18:59:37,522 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2023-01-17T18:59:37,527 Created temporary directory: /tmp/pip-ephem-wheel-cache-mo8httwo 2023-01-17T18:59:37,584 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-01-17T18:59:37,592 2 location(s) to search for versions of deepspeed: 2023-01-17T18:59:37,592 * https://pypi.org/simple/deepspeed/ 2023-01-17T18:59:37,592 * https://www.piwheels.org/simple/deepspeed/ 2023-01-17T18:59:37,593 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-01-17T18:59:37,594 Getting page https://pypi.org/simple/deepspeed/ 2023-01-17T18:59:37,597 Found index url https://pypi.org/simple 2023-01-17T18:59:38,254 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-01-17T18:59:38,289 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-01-17T18:59:38,289 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-01-17T18:59:38,290 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-01-17T18:59:38,291 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-01-17T18:59:38,292 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-01-17T18:59:38,292 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-01-17T18:59:38,293 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-01-17T18:59:38,294 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-01-17T18:59:38,294 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-01-17T18:59:38,295 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-01-17T18:59:38,296 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-01-17T18:59:38,296 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-01-17T18:59:38,297 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-01-17T18:59:38,298 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-01-17T18:59:38,298 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-01-17T18:59:38,299 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-01-17T18:59:38,300 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-01-17T18:59:38,301 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-01-17T18:59:38,302 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-01-17T18:59:38,303 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-01-17T18:59:38,304 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-01-17T18:59:38,304 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-01-17T18:59:38,305 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-01-17T18:59:38,306 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-01-17T18:59:38,307 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-01-17T18:59:38,308 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-01-17T18:59:38,309 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-01-17T18:59:38,311 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-01-17T18:59:38,312 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-01-17T18:59:38,313 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-01-17T18:59:38,314 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-01-17T18:59:38,315 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-01-17T18:59:38,316 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-01-17T18:59:38,316 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-01-17T18:59:38,317 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-01-17T18:59:38,318 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-01-17T18:59:38,318 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-01-17T18:59:38,319 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-01-17T18:59:38,320 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-01-17T18:59:38,321 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-01-17T18:59:38,321 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-01-17T18:59:38,322 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-01-17T18:59:38,323 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-01-17T18:59:38,323 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-01-17T18:59:38,324 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-01-17T18:59:38,325 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-01-17T18:59:38,326 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-01-17T18:59:38,326 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-01-17T18:59:38,331 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-01-17T18:59:38,332 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-01-17T18:59:38,332 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-01-17T18:59:38,333 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-01-17T18:59:38,334 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-01-17T18:59:38,335 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-01-17T18:59:38,335 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-01-17T18:59:38,336 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-01-17T18:59:38,337 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-01-17T18:59:38,338 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-01-17T18:59:38,338 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-01-17T18:59:38,339 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-01-17T18:59:38,340 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-01-17T18:59:38,340 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-01-17T18:59:38,341 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-01-17T18:59:38,342 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-01-17T18:59:38,344 Found index url https://www.piwheels.org/simple 2023-01-17T18:59:38,595 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-01-17T18:59:38,619 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,619 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,620 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,620 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,621 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,622 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,622 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,623 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,623 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,624 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,624 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,625 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,625 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,626 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,626 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,627 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,627 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,628 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,629 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,629 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,630 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,630 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,631 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,631 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,632 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,632 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,633 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,633 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,634 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,634 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,635 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,635 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-01-17T18:59:38,636 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-01-17T18:59:38,637 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-01-17T18:59:38,689 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-01-17T18:59:38,720 Collecting deepspeed==0.8.0 2023-01-17T18:59:38,724 Created temporary directory: /tmp/pip-unpack-edssqlji 2023-01-17T18:59:38,987 Downloading deepspeed-0.8.0.tar.gz (749 kB) 2023-01-17T18:59:41,585 Added deepspeed==0.8.0 from https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz to build tracker '/tmp/pip-build-tracker-rjcn4ffv' 2023-01-17T18:59:41,588 Running setup.py (path:/tmp/pip-wheel-o2wjand_/deepspeed_a6c4c397888844b9886eef1403a53e1c/setup.py) egg_info for package deepspeed 2023-01-17T18:59:41,589 Created temporary directory: /tmp/pip-pip-egg-info-nzar44u8 2023-01-17T18:59:41,590 Preparing metadata (setup.py): started 2023-01-17T18:59:41,592 Running command python setup.py egg_info 2023-01-17T18:59:44,485 fatal: not a git repository (or any of the parent directories): .git 2023-01-17T18:59:45,642 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-01-17T18:59:45,643  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-01-17T18:59:45,643 DS_BUILD_OPS=0 2023-01-17T18:59:45,643  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-01-17T18:59:45,644  [WARNING]  async_io: please install the libaio-dev package with apt 2023-01-17T18:59:45,644  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-01-17T18:59:45,644  [WARNING]  unable to import torch, please install it first 2023-01-17T18:59:45,645  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-01-17T18:59:45,645  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-01-17T18:59:45,645 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-01-17T18:59:45,646 version=0.8.0, git_hash=unknown, git_branch=unknown 2023-01-17T18:59:45,646 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2023-01-17T18:59:45,646 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-01-17T18:59:45,647 ext_modules=[] 2023-01-17T18:59:45,647 running egg_info 2023-01-17T18:59:45,648 creating /tmp/pip-pip-egg-info-nzar44u8/deepspeed.egg-info 2023-01-17T18:59:45,708 writing /tmp/pip-pip-egg-info-nzar44u8/deepspeed.egg-info/PKG-INFO 2023-01-17T18:59:45,715 writing dependency_links to /tmp/pip-pip-egg-info-nzar44u8/deepspeed.egg-info/dependency_links.txt 2023-01-17T18:59:45,719 writing entry points to /tmp/pip-pip-egg-info-nzar44u8/deepspeed.egg-info/entry_points.txt 2023-01-17T18:59:45,723 writing requirements to /tmp/pip-pip-egg-info-nzar44u8/deepspeed.egg-info/requires.txt 2023-01-17T18:59:45,725 writing top-level names to /tmp/pip-pip-egg-info-nzar44u8/deepspeed.egg-info/top_level.txt 2023-01-17T18:59:45,728 writing manifest file '/tmp/pip-pip-egg-info-nzar44u8/deepspeed.egg-info/SOURCES.txt' 2023-01-17T18:59:46,077 reading manifest file '/tmp/pip-pip-egg-info-nzar44u8/deepspeed.egg-info/SOURCES.txt' 2023-01-17T18:59:46,080 reading manifest template 'MANIFEST.in' 2023-01-17T18:59:47,355 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-01-17T18:59:48,542 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-01-17T18:59:49,392 warning: no files found matching '*.tr' under directory 'csrc' 2023-01-17T18:59:49,536 warning: no files found matching '*.cc' under directory 'csrc' 2023-01-17T18:59:49,584 adding license file 'LICENSE' 2023-01-17T18:59:49,638 writing manifest file '/tmp/pip-pip-egg-info-nzar44u8/deepspeed.egg-info/SOURCES.txt' 2023-01-17T18:59:49,642 deepspeed build time = 5.148511171340942 secs 2023-01-17T18:59:49,857 Preparing metadata (setup.py): finished with status 'done' 2023-01-17T18:59:49,876 Source in /tmp/pip-wheel-o2wjand_/deepspeed_a6c4c397888844b9886eef1403a53e1c has version 0.8.0, which satisfies requirement deepspeed==0.8.0 from https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz 2023-01-17T18:59:49,878 Removed deepspeed==0.8.0 from https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz from build tracker '/tmp/pip-build-tracker-rjcn4ffv' 2023-01-17T18:59:49,894 Created temporary directory: /tmp/pip-unpack-45eusbjx 2023-01-17T18:59:49,896 Building wheels for collected packages: deepspeed 2023-01-17T18:59:49,905 Created temporary directory: /tmp/pip-wheel-t6a0g90b 2023-01-17T18:59:49,906 Building wheel for deepspeed (setup.py): started 2023-01-17T18:59:49,908 Destination directory: /tmp/pip-wheel-t6a0g90b 2023-01-17T18:59:49,908 Running command python setup.py bdist_wheel 2023-01-17T18:59:51,959 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-01-17T18:59:51,984  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-01-17T18:59:52,056 DS_BUILD_OPS=0 2023-01-17T18:59:52,352  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-01-17T18:59:52,517  [WARNING]  async_io: please install the libaio-dev package with apt 2023-01-17T18:59:52,519  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-01-17T18:59:52,523  [WARNING]  unable to import torch, please install it first 2023-01-17T18:59:52,525  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-01-17T18:59:52,527  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-01-17T18:59:52,528 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-01-17T18:59:52,569 fatal: not a git repository (or any of the parent directories): .git 2023-01-17T18:59:52,575 version=0.8.0, git_hash=unknown, git_branch=unknown 2023-01-17T18:59:52,577 install_requires=['hjson', 'ninja', 'numpy', 'packaging', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm'] 2023-01-17T18:59:52,578 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-01-17T18:59:52,579 ext_modules=[] 2023-01-17T18:59:53,715 running bdist_wheel 2023-01-17T18:59:54,479 running build 2023-01-17T18:59:54,479 running build_py 2023-01-17T18:59:54,549 creating build 2023-01-17T18:59:54,550 creating build/lib 2023-01-17T18:59:54,552 creating build/lib/deepspeed 2023-01-17T18:59:54,555 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-01-17T18:59:54,560 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-01-17T18:59:54,563 copying deepspeed/constants.py -> build/lib/deepspeed 2023-01-17T18:59:54,567 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-01-17T18:59:54,571 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-01-17T18:59:54,577 creating build/lib/benchmarks 2023-01-17T18:59:54,578 creating build/lib/benchmarks/communication 2023-01-17T18:59:54,580 copying benchmarks/communication/all_to_all.py -> build/lib/benchmarks/communication 2023-01-17T18:59:54,585 copying benchmarks/communication/all_reduce.py -> build/lib/benchmarks/communication 2023-01-17T18:59:54,589 copying benchmarks/communication/__init__.py -> build/lib/benchmarks/communication 2023-01-17T18:59:54,592 copying benchmarks/communication/pt2pt.py -> build/lib/benchmarks/communication 2023-01-17T18:59:54,596 copying benchmarks/communication/utils.py -> build/lib/benchmarks/communication 2023-01-17T18:59:54,600 copying benchmarks/communication/all_gather.py -> build/lib/benchmarks/communication 2023-01-17T18:59:54,605 copying benchmarks/communication/run_all.py -> build/lib/benchmarks/communication 2023-01-17T18:59:54,609 copying benchmarks/communication/constants.py -> build/lib/benchmarks/communication 2023-01-17T18:59:54,614 copying benchmarks/communication/broadcast.py -> build/lib/benchmarks/communication 2023-01-17T18:59:54,620 creating build/lib/deepspeed/moe 2023-01-17T18:59:54,622 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-01-17T18:59:54,626 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-01-17T18:59:54,630 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-01-17T18:59:54,634 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-01-17T18:59:54,638 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-01-17T18:59:54,644 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-01-17T18:59:54,649 creating build/lib/deepspeed/compression 2023-01-17T18:59:54,651 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-01-17T18:59:54,657 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-01-17T18:59:54,661 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-01-17T18:59:54,664 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-01-17T18:59:54,669 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-01-17T18:59:54,673 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-01-17T18:59:54,677 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-01-17T18:59:54,681 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-01-17T18:59:54,686 creating build/lib/deepspeed/accelerator 2023-01-17T18:59:54,688 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-01-17T18:59:54,691 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-01-17T18:59:54,694 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-01-17T18:59:54,698 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-01-17T18:59:54,704 creating build/lib/deepspeed/module_inject 2023-01-17T18:59:54,705 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-01-17T18:59:54,709 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-01-17T18:59:54,712 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-01-17T18:59:54,716 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-01-17T18:59:54,721 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-01-17T18:59:54,728 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-01-17T18:59:54,731 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-01-17T18:59:54,737 creating build/lib/deepspeed/checkpoint 2023-01-17T18:59:54,738 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-01-17T18:59:54,742 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-01-17T18:59:54,746 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-01-17T18:59:54,749 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-01-17T18:59:54,754 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-01-17T18:59:54,758 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-01-17T18:59:54,761 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-01-17T18:59:54,764 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-01-17T18:59:54,768 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-01-17T18:59:54,773 creating build/lib/deepspeed/inference 2023-01-17T18:59:54,775 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-01-17T18:59:54,779 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-01-17T18:59:54,783 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-01-17T18:59:54,789 creating build/lib/deepspeed/autotuning 2023-01-17T18:59:54,791 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-01-17T18:59:54,794 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-01-17T18:59:54,798 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-01-17T18:59:54,802 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-01-17T18:59:54,807 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-01-17T18:59:54,811 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-01-17T18:59:54,821 creating build/lib/deepspeed/profiling 2023-01-17T18:59:54,822 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-01-17T18:59:54,825 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-01-17T18:59:54,828 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-01-17T18:59:54,833 creating build/lib/deepspeed/nebula 2023-01-17T18:59:54,834 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-01-17T18:59:54,837 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-01-17T18:59:54,841 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-01-17T18:59:54,846 creating build/lib/deepspeed/comm 2023-01-17T18:59:54,847 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-01-17T18:59:54,851 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-01-17T18:59:54,854 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-01-17T18:59:54,860 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-01-17T18:59:54,863 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-01-17T18:59:54,867 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-01-17T18:59:54,871 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-01-17T18:59:54,875 creating build/lib/deepspeed/model_implementations 2023-01-17T18:59:54,876 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-01-17T18:59:54,881 creating build/lib/deepspeed/launcher 2023-01-17T18:59:54,883 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-01-17T18:59:54,888 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-01-17T18:59:54,890 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-01-17T18:59:54,895 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-01-17T18:59:54,900 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-01-17T18:59:54,904 creating build/lib/deepspeed/ops 2023-01-17T18:59:54,906 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-01-17T18:59:54,912 creating build/lib/deepspeed/utils 2023-01-17T18:59:54,913 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,917 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,924 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,928 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,932 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,936 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,939 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,944 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,948 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,951 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,955 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,960 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,964 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-01-17T18:59:54,969 creating build/lib/deepspeed/pipe 2023-01-17T18:59:54,971 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-01-17T18:59:54,977 creating build/lib/deepspeed/runtime 2023-01-17T18:59:54,979 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:54,983 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:54,987 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:54,993 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:54,997 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,000 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,003 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,009 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,015 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,019 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,024 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,028 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,032 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,037 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,050 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-01-17T18:59:55,057 creating build/lib/deepspeed/elasticity 2023-01-17T18:59:55,058 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-01-17T18:59:55,062 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-01-17T18:59:55,066 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-01-17T18:59:55,070 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-01-17T18:59:55,074 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-01-17T18:59:55,079 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-01-17T18:59:55,084 creating build/lib/deepspeed/monitor 2023-01-17T18:59:55,086 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-01-17T18:59:55,090 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-01-17T18:59:55,093 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-01-17T18:59:55,096 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-01-17T18:59:55,099 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-01-17T18:59:55,103 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-01-17T18:59:55,106 copying deepspeed/monitor/constants.py -> build/lib/deepspeed/monitor 2023-01-17T18:59:55,111 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-01-17T18:59:55,116 creating build/lib/deepspeed/autotuning/tuner 2023-01-17T18:59:55,117 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-01-17T18:59:55,121 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-01-17T18:59:55,125 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-01-17T18:59:55,128 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-01-17T18:59:55,132 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-01-17T18:59:55,135 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-01-17T18:59:55,141 creating build/lib/deepspeed/profiling/flops_profiler 2023-01-17T18:59:55,142 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-01-17T18:59:55,149 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-01-17T18:59:55,154 creating build/lib/deepspeed/model_implementations/diffusers 2023-01-17T18:59:55,155 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-01-17T18:59:55,158 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-01-17T18:59:55,163 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-01-17T18:59:55,167 creating build/lib/deepspeed/model_implementations/transformers 2023-01-17T18:59:55,169 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-01-17T18:59:55,174 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-01-17T18:59:55,177 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-01-17T18:59:55,183 creating build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,185 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,189 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,192 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,195 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,199 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,204 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,208 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,211 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,216 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,219 copying deepspeed/ops/op_builder/builder_names.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,223 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,229 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,233 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,236 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,242 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,246 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,250 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-01-17T18:59:55,256 creating build/lib/deepspeed/ops/transformer 2023-01-17T18:59:55,258 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-01-17T18:59:55,264 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-01-17T18:59:55,277 creating build/lib/deepspeed/ops/lamb 2023-01-17T18:59:55,280 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-01-17T18:59:55,286 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-01-17T18:59:55,292 creating build/lib/deepspeed/ops/adam 2023-01-17T18:59:55,293 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-01-17T18:59:55,297 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-01-17T18:59:55,301 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-01-17T18:59:55,304 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-01-17T18:59:55,310 creating build/lib/deepspeed/ops/random_ltd 2023-01-17T18:59:55,311 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-01-17T18:59:55,315 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-01-17T18:59:55,320 creating build/lib/deepspeed/ops/aio 2023-01-17T18:59:55,321 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-01-17T18:59:55,326 creating build/lib/deepspeed/ops/adagrad 2023-01-17T18:59:55,327 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-01-17T18:59:55,331 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-01-17T18:59:55,336 creating build/lib/deepspeed/ops/quantizer 2023-01-17T18:59:55,337 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-01-17T18:59:55,341 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-01-17T18:59:55,346 creating build/lib/deepspeed/ops/sparse_attention 2023-01-17T18:59:55,347 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-01-17T18:59:55,352 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-01-17T18:59:55,355 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-01-17T18:59:55,361 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-01-17T18:59:55,365 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-01-17T18:59:55,372 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-01-17T18:59:55,375 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-01-17T18:59:55,382 creating build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,383 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,387 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,391 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,395 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,399 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,403 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,407 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,412 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,417 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,420 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-01-17T18:59:55,426 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,428 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,432 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,435 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,438 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,442 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,445 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,449 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,452 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,456 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,459 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-01-17T18:59:55,463 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-01-17T18:59:55,465 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-01-17T18:59:55,469 creating build/lib/deepspeed/runtime/compression 2023-01-17T18:59:55,471 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-01-17T18:59:55,474 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-01-17T18:59:55,478 creating build/lib/deepspeed/runtime/fp16 2023-01-17T18:59:55,480 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-01-17T18:59:55,483 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-01-17T18:59:55,488 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-01-17T18:59:55,493 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-01-17T18:59:55,499 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-01-17T18:59:55,501 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-01-17T18:59:55,504 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-01-17T18:59:55,507 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-01-17T18:59:55,511 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-01-17T18:59:55,516 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-01-17T18:59:55,517 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-01-17T18:59:55,523 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-01-17T18:59:55,526 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-01-17T18:59:55,531 creating build/lib/deepspeed/runtime/comm 2023-01-17T18:59:55,532 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-01-17T18:59:55,537 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-01-17T18:59:55,541 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-01-17T18:59:55,543 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-01-17T18:59:55,548 creating build/lib/deepspeed/runtime/data_pipeline 2023-01-17T18:59:55,550 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-01-17T18:59:55,554 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-01-17T18:59:55,556 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-01-17T18:59:55,560 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-01-17T18:59:55,566 creating build/lib/deepspeed/runtime/swap_tensor 2023-01-17T18:59:55,568 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-01-17T18:59:55,573 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-01-17T18:59:55,577 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-01-17T18:59:55,580 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-01-17T18:59:55,584 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-01-17T18:59:55,589 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-01-17T18:59:55,592 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-01-17T18:59:55,596 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-01-17T18:59:55,600 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-01-17T18:59:55,606 creating build/lib/deepspeed/runtime/pipe 2023-01-17T18:59:55,608 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-01-17T18:59:55,613 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-01-17T18:59:55,619 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-01-17T18:59:55,622 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-01-17T18:59:55,625 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-01-17T18:59:55,630 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-01-17T18:59:55,639 creating build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,641 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,648 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,653 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,656 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,660 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,664 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,667 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,676 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,680 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,689 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,694 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,698 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,703 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-01-17T18:59:55,710 creating build/lib/deepspeed/runtime/fp16/onebit 2023-01-17T18:59:55,712 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-01-17T18:59:55,716 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-01-17T18:59:55,721 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-01-17T18:59:55,726 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-01-17T18:59:55,732 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T18:59:55,734 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T18:59:55,739 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T18:59:55,741 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T18:59:55,746 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T18:59:55,749 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T18:59:55,756 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T18:59:55,757 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T18:59:55,761 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T18:59:55,764 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T18:59:55,767 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T18:59:55,770 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T18:59:55,774 running egg_info 2023-01-17T18:59:55,900 writing deepspeed.egg-info/PKG-INFO 2023-01-17T18:59:55,905 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-01-17T18:59:55,909 writing entry points to deepspeed.egg-info/entry_points.txt 2023-01-17T18:59:55,913 writing requirements to deepspeed.egg-info/requires.txt 2023-01-17T18:59:55,915 writing top-level names to deepspeed.egg-info/top_level.txt 2023-01-17T18:59:56,058 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-01-17T18:59:56,143 reading manifest template 'MANIFEST.in' 2023-01-17T18:59:57,321 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-01-17T18:59:58,198 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-01-17T18:59:58,782 warning: no files found matching '*.tr' under directory 'csrc' 2023-01-17T18:59:58,920 warning: no files found matching '*.cc' under directory 'csrc' 2023-01-17T18:59:58,964 adding license file 'LICENSE' 2023-01-17T18:59:59,032 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-01-17T18:59:59,050 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.autotuning.config_templates' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,050 !! 2023-01-17T18:59:59,051 ############################ 2023-01-17T18:59:59,052 # Package would be ignored # 2023-01-17T18:59:59,052 ############################ 2023-01-17T18:59:59,052 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package, 2023-01-17T18:59:59,053 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,053 'deepspeed.autotuning.config_templates' has been automatically added to the distribution only 2023-01-17T18:59:59,053 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,054 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,054 Please make sure that 'deepspeed.autotuning.config_templates' is included as a package by using 2023-01-17T18:59:59,055 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,055 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,055 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,056 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,056 documentation page. 2023-01-17T18:59:59,057 !! 2023-01-17T18:59:59,058 check.warn(importable) 2023-01-17T18:59:59,063 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adagrad' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,064 !! 2023-01-17T18:59:59,065 ############################ 2023-01-17T18:59:59,065 # Package would be ignored # 2023-01-17T18:59:59,065 ############################ 2023-01-17T18:59:59,066 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package, 2023-01-17T18:59:59,066 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,067 'deepspeed.ops.csrc.adagrad' has been automatically added to the distribution only 2023-01-17T18:59:59,067 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,067 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,068 Please make sure that 'deepspeed.ops.csrc.adagrad' is included as a package by using 2023-01-17T18:59:59,068 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,068 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,069 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,069 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,070 documentation page. 2023-01-17T18:59:59,071 !! 2023-01-17T18:59:59,071 check.warn(importable) 2023-01-17T18:59:59,072 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.adam' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,072 !! 2023-01-17T18:59:59,073 ############################ 2023-01-17T18:59:59,073 # Package would be ignored # 2023-01-17T18:59:59,073 ############################ 2023-01-17T18:59:59,074 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package, 2023-01-17T18:59:59,074 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,075 'deepspeed.ops.csrc.adam' has been automatically added to the distribution only 2023-01-17T18:59:59,075 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,075 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,076 Please make sure that 'deepspeed.ops.csrc.adam' is included as a package by using 2023-01-17T18:59:59,076 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,077 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,077 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,078 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,078 documentation page. 2023-01-17T18:59:59,079 !! 2023-01-17T18:59:59,079 check.warn(importable) 2023-01-17T18:59:59,080 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.common' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,080 !! 2023-01-17T18:59:59,081 ############################ 2023-01-17T18:59:59,081 # Package would be ignored # 2023-01-17T18:59:59,082 ############################ 2023-01-17T18:59:59,082 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package, 2023-01-17T18:59:59,082 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,083 'deepspeed.ops.csrc.aio.common' has been automatically added to the distribution only 2023-01-17T18:59:59,083 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,083 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,084 Please make sure that 'deepspeed.ops.csrc.aio.common' is included as a package by using 2023-01-17T18:59:59,084 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,085 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,085 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,085 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,086 documentation page. 2023-01-17T18:59:59,087 !! 2023-01-17T18:59:59,087 check.warn(importable) 2023-01-17T18:59:59,088 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_lib' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,088 !! 2023-01-17T18:59:59,089 ############################ 2023-01-17T18:59:59,089 # Package would be ignored # 2023-01-17T18:59:59,090 ############################ 2023-01-17T18:59:59,090 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package, 2023-01-17T18:59:59,090 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,091 'deepspeed.ops.csrc.aio.py_lib' has been automatically added to the distribution only 2023-01-17T18:59:59,091 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,091 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,092 Please make sure that 'deepspeed.ops.csrc.aio.py_lib' is included as a package by using 2023-01-17T18:59:59,092 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,093 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,093 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,093 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,094 documentation page. 2023-01-17T18:59:59,095 !! 2023-01-17T18:59:59,095 check.warn(importable) 2023-01-17T18:59:59,095 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.aio.py_test' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,096 !! 2023-01-17T18:59:59,097 ############################ 2023-01-17T18:59:59,097 # Package would be ignored # 2023-01-17T18:59:59,097 ############################ 2023-01-17T18:59:59,097 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package, 2023-01-17T18:59:59,098 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,098 'deepspeed.ops.csrc.aio.py_test' has been automatically added to the distribution only 2023-01-17T18:59:59,099 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,099 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,100 Please make sure that 'deepspeed.ops.csrc.aio.py_test' is included as a package by using 2023-01-17T18:59:59,100 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,100 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,100 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,101 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,101 documentation page. 2023-01-17T18:59:59,102 !! 2023-01-17T18:59:59,103 check.warn(importable) 2023-01-17T18:59:59,103 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.common' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,103 !! 2023-01-17T18:59:59,104 ############################ 2023-01-17T18:59:59,104 # Package would be ignored # 2023-01-17T18:59:59,105 ############################ 2023-01-17T18:59:59,105 Python recognizes 'deepspeed.ops.csrc.common' as an importable package, 2023-01-17T18:59:59,105 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,106 'deepspeed.ops.csrc.common' has been automatically added to the distribution only 2023-01-17T18:59:59,106 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,106 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,107 Please make sure that 'deepspeed.ops.csrc.common' is included as a package by using 2023-01-17T18:59:59,107 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,108 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,108 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,108 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,109 documentation page. 2023-01-17T18:59:59,110 !! 2023-01-17T18:59:59,110 check.warn(importable) 2023-01-17T18:59:59,110 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.includes' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,111 !! 2023-01-17T18:59:59,112 ############################ 2023-01-17T18:59:59,112 # Package would be ignored # 2023-01-17T18:59:59,112 ############################ 2023-01-17T18:59:59,112 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package, 2023-01-17T18:59:59,113 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,113 'deepspeed.ops.csrc.includes' has been automatically added to the distribution only 2023-01-17T18:59:59,114 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,114 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,114 Please make sure that 'deepspeed.ops.csrc.includes' is included as a package by using 2023-01-17T18:59:59,115 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,115 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,115 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,116 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,116 documentation page. 2023-01-17T18:59:59,117 !! 2023-01-17T18:59:59,118 check.warn(importable) 2023-01-17T18:59:59,118 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.lamb' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,118 !! 2023-01-17T18:59:59,119 ############################ 2023-01-17T18:59:59,119 # Package would be ignored # 2023-01-17T18:59:59,120 ############################ 2023-01-17T18:59:59,120 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package, 2023-01-17T18:59:59,120 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,121 'deepspeed.ops.csrc.lamb' has been automatically added to the distribution only 2023-01-17T18:59:59,121 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,121 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,122 Please make sure that 'deepspeed.ops.csrc.lamb' is included as a package by using 2023-01-17T18:59:59,122 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,122 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,123 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,123 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,124 documentation page. 2023-01-17T18:59:59,125 !! 2023-01-17T18:59:59,125 check.warn(importable) 2023-01-17T18:59:59,125 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.quantization' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,126 !! 2023-01-17T18:59:59,127 ############################ 2023-01-17T18:59:59,127 # Package would be ignored # 2023-01-17T18:59:59,128 ############################ 2023-01-17T18:59:59,128 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package, 2023-01-17T18:59:59,128 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,129 'deepspeed.ops.csrc.quantization' has been automatically added to the distribution only 2023-01-17T18:59:59,129 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,130 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,130 Please make sure that 'deepspeed.ops.csrc.quantization' is included as a package by using 2023-01-17T18:59:59,131 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,131 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,131 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,132 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,132 documentation page. 2023-01-17T18:59:59,133 !! 2023-01-17T18:59:59,134 check.warn(importable) 2023-01-17T18:59:59,134 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.random_ltd' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,134 !! 2023-01-17T18:59:59,135 ############################ 2023-01-17T18:59:59,136 # Package would be ignored # 2023-01-17T18:59:59,136 ############################ 2023-01-17T18:59:59,136 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package, 2023-01-17T18:59:59,137 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,137 'deepspeed.ops.csrc.random_ltd' has been automatically added to the distribution only 2023-01-17T18:59:59,138 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,138 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,139 Please make sure that 'deepspeed.ops.csrc.random_ltd' is included as a package by using 2023-01-17T18:59:59,139 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,140 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,140 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,140 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,141 documentation page. 2023-01-17T18:59:59,142 !! 2023-01-17T18:59:59,142 check.warn(importable) 2023-01-17T18:59:59,143 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.sparse_attention' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,143 !! 2023-01-17T18:59:59,144 ############################ 2023-01-17T18:59:59,144 # Package would be ignored # 2023-01-17T18:59:59,145 ############################ 2023-01-17T18:59:59,145 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package, 2023-01-17T18:59:59,146 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,146 'deepspeed.ops.csrc.sparse_attention' has been automatically added to the distribution only 2023-01-17T18:59:59,146 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,147 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,147 Please make sure that 'deepspeed.ops.csrc.sparse_attention' is included as a package by using 2023-01-17T18:59:59,148 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,148 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,148 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,149 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,149 documentation page. 2023-01-17T18:59:59,150 !! 2023-01-17T18:59:59,151 check.warn(importable) 2023-01-17T18:59:59,151 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.csrc' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,152 !! 2023-01-17T18:59:59,153 ############################ 2023-01-17T18:59:59,153 # Package would be ignored # 2023-01-17T18:59:59,153 ############################ 2023-01-17T18:59:59,154 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package, 2023-01-17T18:59:59,154 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,155 'deepspeed.ops.csrc.spatial.csrc' has been automatically added to the distribution only 2023-01-17T18:59:59,155 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,155 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,156 Please make sure that 'deepspeed.ops.csrc.spatial.csrc' is included as a package by using 2023-01-17T18:59:59,156 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,157 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,157 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,157 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,158 documentation page. 2023-01-17T18:59:59,159 !! 2023-01-17T18:59:59,160 check.warn(importable) 2023-01-17T18:59:59,160 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.spatial.includes' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,160 !! 2023-01-17T18:59:59,161 ############################ 2023-01-17T18:59:59,161 # Package would be ignored # 2023-01-17T18:59:59,162 ############################ 2023-01-17T18:59:59,162 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package, 2023-01-17T18:59:59,162 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,163 'deepspeed.ops.csrc.spatial.includes' has been automatically added to the distribution only 2023-01-17T18:59:59,163 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,164 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,164 Please make sure that 'deepspeed.ops.csrc.spatial.includes' is included as a package by using 2023-01-17T18:59:59,165 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,165 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,165 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,166 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,166 documentation page. 2023-01-17T18:59:59,167 !! 2023-01-17T18:59:59,168 check.warn(importable) 2023-01-17T18:59:59,168 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,169 !! 2023-01-17T18:59:59,170 ############################ 2023-01-17T18:59:59,170 # Package would be ignored # 2023-01-17T18:59:59,170 ############################ 2023-01-17T18:59:59,171 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package, 2023-01-17T18:59:59,171 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,171 'deepspeed.ops.csrc.transformer' has been automatically added to the distribution only 2023-01-17T18:59:59,172 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,172 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,173 Please make sure that 'deepspeed.ops.csrc.transformer' is included as a package by using 2023-01-17T18:59:59,173 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,174 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,174 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,174 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,175 documentation page. 2023-01-17T18:59:59,176 !! 2023-01-17T18:59:59,177 check.warn(importable) 2023-01-17T18:59:59,177 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.csrc' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,177 !! 2023-01-17T18:59:59,178 ############################ 2023-01-17T18:59:59,179 # Package would be ignored # 2023-01-17T18:59:59,179 ############################ 2023-01-17T18:59:59,179 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package, 2023-01-17T18:59:59,180 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,180 'deepspeed.ops.csrc.transformer.inference.csrc' has been automatically added to the distribution only 2023-01-17T18:59:59,181 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,181 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,182 Please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is included as a package by using 2023-01-17T18:59:59,182 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,182 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,182 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,183 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,183 documentation page. 2023-01-17T18:59:59,184 !! 2023-01-17T18:59:59,185 check.warn(importable) 2023-01-17T18:59:59,185 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.transformer.inference.includes' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,186 !! 2023-01-17T18:59:59,187 ############################ 2023-01-17T18:59:59,187 # Package would be ignored # 2023-01-17T18:59:59,187 ############################ 2023-01-17T18:59:59,188 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package, 2023-01-17T18:59:59,188 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,189 'deepspeed.ops.csrc.transformer.inference.includes' has been automatically added to the distribution only 2023-01-17T18:59:59,189 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,189 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,190 Please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is included as a package by using 2023-01-17T18:59:59,190 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,191 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,191 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,192 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,192 documentation page. 2023-01-17T18:59:59,193 !! 2023-01-17T18:59:59,193 check.warn(importable) 2023-01-17T18:59:59,194 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:202: SetuptoolsDeprecationWarning: Installing 'deepspeed.ops.csrc.utils' as data is deprecated, please list it in `packages`. 2023-01-17T18:59:59,194 !! 2023-01-17T18:59:59,195 ############################ 2023-01-17T18:59:59,195 # Package would be ignored # 2023-01-17T18:59:59,196 ############################ 2023-01-17T18:59:59,196 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package, 2023-01-17T18:59:59,196 but it is not listed in the `packages` configuration of setuptools. 2023-01-17T18:59:59,197 'deepspeed.ops.csrc.utils' has been automatically added to the distribution only 2023-01-17T18:59:59,197 because it may contain data files, but this behavior is likely to change 2023-01-17T18:59:59,198 in future versions of setuptools (and therefore is considered deprecated). 2023-01-17T18:59:59,198 Please make sure that 'deepspeed.ops.csrc.utils' is included as a package by using 2023-01-17T18:59:59,199 the `packages` configuration field or the proper discovery methods 2023-01-17T18:59:59,199 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-01-17T18:59:59,199 instead of `find_packages(...)`/`find:`). 2023-01-17T18:59:59,200 You can read more about "package discovery" and "data files" on setuptools 2023-01-17T18:59:59,200 documentation page. 2023-01-17T18:59:59,201 !! 2023-01-17T18:59:59,202 check.warn(importable) 2023-01-17T18:59:59,202 creating build/lib/deepspeed/autotuning/config_templates 2023-01-17T18:59:59,203 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-01-17T18:59:59,203 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-01-17T18:59:59,203 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-01-17T18:59:59,204 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-01-17T18:59:59,204 creating build/lib/deepspeed/ops/csrc 2023-01-17T18:59:59,204 creating build/lib/deepspeed/ops/csrc/adagrad 2023-01-17T18:59:59,205 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-01-17T18:59:59,205 creating build/lib/deepspeed/ops/csrc/adam 2023-01-17T18:59:59,205 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-01-17T18:59:59,206 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-01-17T18:59:59,206 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-01-17T18:59:59,206 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-01-17T18:59:59,207 creating build/lib/deepspeed/ops/csrc/aio 2023-01-17T18:59:59,207 creating build/lib/deepspeed/ops/csrc/aio/common 2023-01-17T18:59:59,207 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-01-17T18:59:59,208 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-01-17T18:59:59,208 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-01-17T18:59:59,208 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-01-17T18:59:59,209 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-01-17T18:59:59,209 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-01-17T18:59:59,209 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-01-17T18:59:59,210 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-01-17T18:59:59,212 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-01-17T18:59:59,216 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-01-17T18:59:59,221 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-01-17T18:59:59,224 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-01-17T18:59:59,229 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-01-17T18:59:59,233 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-01-17T18:59:59,237 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-01-17T18:59:59,241 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-01-17T18:59:59,244 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-01-17T18:59:59,245 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-01-17T18:59:59,249 creating build/lib/deepspeed/ops/csrc/common 2023-01-17T18:59:59,251 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-01-17T18:59:59,255 creating build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,256 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,260 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,263 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,267 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,271 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,276 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,280 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,285 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,289 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,294 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,298 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,301 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,305 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,309 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,313 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,316 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,321 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,324 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,330 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,335 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,338 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,343 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,347 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,351 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,355 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,359 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,363 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-01-17T18:59:59,368 creating build/lib/deepspeed/ops/csrc/lamb 2023-01-17T18:59:59,370 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-01-17T18:59:59,374 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-01-17T18:59:59,378 creating build/lib/deepspeed/ops/csrc/quantization 2023-01-17T18:59:59,380 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-01-17T18:59:59,384 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-01-17T18:59:59,389 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-01-17T18:59:59,394 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-01-17T18:59:59,398 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-01-17T18:59:59,399 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-01-17T18:59:59,404 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-01-17T18:59:59,409 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-01-17T18:59:59,413 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-01-17T18:59:59,417 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-01-17T18:59:59,419 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-01-17T18:59:59,423 creating build/lib/deepspeed/ops/csrc/spatial 2023-01-17T18:59:59,424 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-01-17T18:59:59,426 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-01-17T18:59:59,430 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-01-17T18:59:59,434 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-01-17T18:59:59,435 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-01-17T18:59:59,439 creating build/lib/deepspeed/ops/csrc/transformer 2023-01-17T18:59:59,441 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-01-17T18:59:59,445 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-01-17T18:59:59,451 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-01-17T18:59:59,458 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-01-17T18:59:59,462 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-01-17T18:59:59,467 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-01-17T18:59:59,475 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-01-17T18:59:59,480 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-01-17T18:59:59,485 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-01-17T18:59:59,486 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T18:59:59,487 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T18:59:59,493 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T18:59:59,498 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T18:59:59,503 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T18:59:59,508 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T18:59:59,516 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T18:59:59,520 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T18:59:59,525 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T18:59:59,531 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-01-17T18:59:59,532 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-01-17T18:59:59,537 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-01-17T18:59:59,542 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-01-17T18:59:59,546 creating build/lib/deepspeed/ops/csrc/utils 2023-01-17T18:59:59,548 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-01-17T18:59:59,552 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-01-17T18:59:59,556 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-01-17T18:59:59,560 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-01-17T18:59:59,632 running build_scripts 2023-01-17T18:59:59,632 creating build/scripts-3.7 2023-01-17T18:59:59,634 copying and adjusting bin/deepspeed -> build/scripts-3.7 2023-01-17T18:59:59,637 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2023-01-17T18:59:59,639 copying and adjusting bin/ds -> build/scripts-3.7 2023-01-17T18:59:59,642 copying bin/ds_ssh -> build/scripts-3.7 2023-01-17T18:59:59,646 copying and adjusting bin/ds_report -> build/scripts-3.7 2023-01-17T18:59:59,648 copying and adjusting bin/ds_bench -> build/scripts-3.7 2023-01-17T18:59:59,651 copying and adjusting bin/dsr -> build/scripts-3.7 2023-01-17T18:59:59,653 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2023-01-17T18:59:59,655 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2023-01-17T18:59:59,656 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2023-01-17T18:59:59,656 changing mode of build/scripts-3.7/ds from 644 to 755 2023-01-17T18:59:59,657 changing mode of build/scripts-3.7/ds_report from 644 to 755 2023-01-17T18:59:59,657 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2023-01-17T18:59:59,657 changing mode of build/scripts-3.7/dsr from 644 to 755 2023-01-17T18:59:59,658 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2023-01-17T18:59:59,729 /usr/local/lib/python3.7/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools. 2023-01-17T18:59:59,730 setuptools.SetuptoolsDeprecationWarning, 2023-01-17T18:59:59,793 installing to build/bdist.linux-armv7l/wheel 2023-01-17T18:59:59,794 running install 2023-01-17T18:59:59,860 running install_lib 2023-01-17T18:59:59,936 creating build/bdist.linux-armv7l 2023-01-17T18:59:59,937 creating build/bdist.linux-armv7l/wheel 2023-01-17T18:59:59,940 creating build/bdist.linux-armv7l/wheel/benchmarks 2023-01-17T18:59:59,943 creating build/bdist.linux-armv7l/wheel/benchmarks/communication 2023-01-17T18:59:59,945 copying build/lib/benchmarks/communication/all_to_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2023-01-17T18:59:59,951 copying build/lib/benchmarks/communication/all_reduce.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2023-01-17T18:59:59,955 copying build/lib/benchmarks/communication/__init__.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2023-01-17T18:59:59,960 copying build/lib/benchmarks/communication/pt2pt.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2023-01-17T18:59:59,964 copying build/lib/benchmarks/communication/utils.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2023-01-17T18:59:59,969 copying build/lib/benchmarks/communication/all_gather.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2023-01-17T18:59:59,973 copying build/lib/benchmarks/communication/run_all.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2023-01-17T18:59:59,976 copying build/lib/benchmarks/communication/constants.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2023-01-17T18:59:59,980 copying build/lib/benchmarks/communication/broadcast.py -> build/bdist.linux-armv7l/wheel/benchmarks/communication 2023-01-17T18:59:59,985 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-01-17T18:59:59,988 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-01-17T18:59:59,990 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-01-17T18:59:59,994 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-01-17T18:59:59,997 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-01-17T19:00:00,001 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-01-17T19:00:00,004 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-01-17T19:00:00,009 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-01-17T19:00:00,015 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-01-17T19:00:00,017 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-01-17T19:00:00,023 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-01-17T19:00:00,028 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-01-17T19:00:00,032 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-01-17T19:00:00,037 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-01-17T19:00:00,042 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-01-17T19:00:00,046 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-01-17T19:00:00,051 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-01-17T19:00:00,057 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-01-17T19:00:00,059 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-01-17T19:00:00,063 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-01-17T19:00:00,066 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-01-17T19:00:00,070 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-01-17T19:00:00,075 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-01-17T19:00:00,076 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-01-17T19:00:00,079 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-01-17T19:00:00,082 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-01-17T19:00:00,086 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-01-17T19:00:00,092 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-01-17T19:00:00,098 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-01-17T19:00:00,101 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-01-17T19:00:00,105 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-01-17T19:00:00,110 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-01-17T19:00:00,111 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-01-17T19:00:00,115 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-01-17T19:00:00,119 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-01-17T19:00:00,122 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-01-17T19:00:00,125 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-01-17T19:00:00,129 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-01-17T19:00:00,132 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-01-17T19:00:00,135 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-01-17T19:00:00,139 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-01-17T19:00:00,143 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-01-17T19:00:00,145 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-01-17T19:00:00,148 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-01-17T19:00:00,152 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-01-17T19:00:00,158 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-01-17T19:00:00,159 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-01-17T19:00:00,163 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-01-17T19:00:00,166 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-01-17T19:00:00,171 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-01-17T19:00:00,176 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-01-17T19:00:00,178 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-01-17T19:00:00,181 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-01-17T19:00:00,184 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-01-17T19:00:00,187 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-01-17T19:00:00,191 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-01-17T19:00:00,194 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-01-17T19:00:00,197 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-01-17T19:00:00,202 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-01-17T19:00:00,203 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-01-17T19:00:00,207 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-01-17T19:00:00,211 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-01-17T19:00:00,214 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-01-17T19:00:00,217 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-01-17T19:00:00,224 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-01-17T19:00:00,225 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-01-17T19:00:00,228 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-01-17T19:00:00,231 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-01-17T19:00:00,235 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-01-17T19:00:00,237 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-01-17T19:00:00,244 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-01-17T19:00:00,247 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-01-17T19:00:00,249 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-01-17T19:00:00,252 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-01-17T19:00:00,255 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-01-17T19:00:00,259 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-01-17T19:00:00,260 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-01-17T19:00:00,264 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-01-17T19:00:00,267 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-01-17T19:00:00,272 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-01-17T19:00:00,276 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-01-17T19:00:00,280 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-01-17T19:00:00,283 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-01-17T19:00:00,287 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-01-17T19:00:00,289 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-01-17T19:00:00,293 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-01-17T19:00:00,294 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-01-17T19:00:00,297 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-01-17T19:00:00,301 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-01-17T19:00:00,305 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-01-17T19:00:00,306 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-01-17T19:00:00,311 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-01-17T19:00:00,314 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-01-17T19:00:00,316 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-01-17T19:00:00,321 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-01-17T19:00:00,322 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-01-17T19:00:00,326 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-01-17T19:00:00,329 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-01-17T19:00:00,333 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-01-17T19:00:00,338 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-01-17T19:00:00,342 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-01-17T19:00:00,345 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,346 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,350 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,353 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,356 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,359 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,364 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,367 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,370 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,373 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,376 copying build/lib/deepspeed/ops/op_builder/builder_names.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,379 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,383 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,386 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,389 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,392 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,395 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,399 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-01-17T19:00:00,403 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-01-17T19:00:00,404 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-01-17T19:00:00,409 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,410 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,414 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,418 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,421 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,425 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,430 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,431 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,434 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,437 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,441 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,444 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,447 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,450 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,453 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,456 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,460 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-01-17T19:00:00,463 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,466 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,471 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,474 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,479 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-01-17T19:00:00,482 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-01-17T19:00:00,486 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-01-17T19:00:00,490 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-01-17T19:00:00,492 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-01-17T19:00:00,495 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-01-17T19:00:00,500 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-01-17T19:00:00,501 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-01-17T19:00:00,505 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-01-17T19:00:00,508 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-01-17T19:00:00,511 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-01-17T19:00:00,516 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-01-17T19:00:00,517 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-01-17T19:00:00,521 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-01-17T19:00:00,525 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-01-17T19:00:00,526 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-01-17T19:00:00,531 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-01-17T19:00:00,532 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-01-17T19:00:00,535 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-01-17T19:00:00,540 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-01-17T19:00:00,541 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-01-17T19:00:00,545 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-01-17T19:00:00,549 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-01-17T19:00:00,550 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-01-17T19:00:00,554 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-01-17T19:00:00,557 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-01-17T19:00:00,563 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-01-17T19:00:00,565 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-01-17T19:00:00,570 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-01-17T19:00:00,573 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-01-17T19:00:00,577 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-01-17T19:00:00,582 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-01-17T19:00:00,586 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-01-17T19:00:00,593 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-01-17T19:00:00,596 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-01-17T19:00:00,602 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-01-17T19:00:00,606 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-01-17T19:00:00,608 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-01-17T19:00:00,613 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-01-17T19:00:00,618 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-01-17T19:00:00,623 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-01-17T19:00:00,625 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-01-17T19:00:00,627 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-01-17T19:00:00,631 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-01-17T19:00:00,635 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-01-17T19:00:00,640 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T19:00:00,641 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T19:00:00,647 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T19:00:00,650 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T19:00:00,655 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T19:00:00,659 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T19:00:00,667 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T19:00:00,672 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T19:00:00,676 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-01-17T19:00:00,680 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-01-17T19:00:00,685 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-01-17T19:00:00,692 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-01-17T19:00:00,697 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-01-17T19:00:00,702 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-01-17T19:00:00,709 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-01-17T19:00:00,712 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-01-17T19:00:00,713 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-01-17T19:00:00,718 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-01-17T19:00:00,720 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-01-17T19:00:00,723 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-01-17T19:00:00,728 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-01-17T19:00:00,730 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-01-17T19:00:00,733 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-01-17T19:00:00,739 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-01-17T19:00:00,740 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-01-17T19:00:00,745 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-01-17T19:00:00,746 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-01-17T19:00:00,751 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-01-17T19:00:00,754 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-01-17T19:00:00,758 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-01-17T19:00:00,762 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-01-17T19:00:00,764 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-01-17T19:00:00,768 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-01-17T19:00:00,772 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-01-17T19:00:00,776 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-01-17T19:00:00,782 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-01-17T19:00:00,784 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-01-17T19:00:00,786 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-01-17T19:00:00,790 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-01-17T19:00:00,793 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-01-17T19:00:00,798 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-01-17T19:00:00,802 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-01-17T19:00:00,806 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-01-17T19:00:00,809 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-01-17T19:00:00,813 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-01-17T19:00:00,817 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-01-17T19:00:00,822 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-01-17T19:00:00,824 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-01-17T19:00:00,829 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-01-17T19:00:00,833 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-01-17T19:00:00,837 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-01-17T19:00:00,841 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-01-17T19:00:00,845 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-01-17T19:00:00,850 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-01-17T19:00:00,852 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-01-17T19:00:00,858 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,860 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,864 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,868 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,873 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,877 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,880 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,883 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,887 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,890 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,893 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,898 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,901 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,904 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,908 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,912 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,916 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,920 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,924 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,928 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,932 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,936 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,939 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,943 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,946 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,950 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,953 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,957 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-01-17T19:00:00,963 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-01-17T19:00:00,964 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-01-17T19:00:00,968 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-01-17T19:00:00,972 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-01-17T19:00:00,978 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-01-17T19:00:00,982 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-01-17T19:00:00,984 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-01-17T19:00:00,988 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-01-17T19:00:00,990 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-01-17T19:00:00,995 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-01-17T19:00:00,996 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-01-17T19:00:01,000 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-01-17T19:00:01,004 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,006 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,009 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,014 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,018 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,022 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,025 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,028 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,032 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,036 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,039 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,042 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,046 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,049 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-01-17T19:00:01,053 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-01-17T19:00:01,058 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-01-17T19:00:01,059 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-01-17T19:00:01,064 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,067 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-01-17T19:00:01,069 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-01-17T19:00:01,072 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-01-17T19:00:01,075 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,080 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-01-17T19:00:01,081 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-01-17T19:00:01,085 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-01-17T19:00:01,090 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-01-17T19:00:01,091 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-01-17T19:00:01,095 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-01-17T19:00:01,099 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-01-17T19:00:01,104 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-01-17T19:00:01,109 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-01-17T19:00:01,114 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-01-17T19:00:01,119 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,122 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,127 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,131 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,135 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-01-17T19:00:01,136 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-01-17T19:00:01,139 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-01-17T19:00:01,142 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-01-17T19:00:01,146 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-01-17T19:00:01,149 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,152 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,159 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-01-17T19:00:01,160 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-01-17T19:00:01,166 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-01-17T19:00:01,169 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-01-17T19:00:01,172 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,177 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,181 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,186 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-01-17T19:00:01,187 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-01-17T19:00:01,192 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-01-17T19:00:01,195 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-01-17T19:00:01,198 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-01-17T19:00:01,202 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-01-17T19:00:01,203 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-01-17T19:00:01,208 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-01-17T19:00:01,210 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-01-17T19:00:01,214 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-01-17T19:00:01,219 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T19:00:01,221 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T19:00:01,226 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T19:00:01,229 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T19:00:01,234 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T19:00:01,237 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-01-17T19:00:01,243 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T19:00:01,244 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T19:00:01,249 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T19:00:01,252 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T19:00:01,254 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T19:00:01,257 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-01-17T19:00:01,262 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-01-17T19:00:01,264 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-01-17T19:00:01,269 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-01-17T19:00:01,273 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-01-17T19:00:01,276 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-01-17T19:00:01,280 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-01-17T19:00:01,284 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-01-17T19:00:01,288 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-01-17T19:00:01,293 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-01-17T19:00:01,296 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-01-17T19:00:01,301 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,305 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,309 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,314 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-01-17T19:00:01,315 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-01-17T19:00:01,322 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-01-17T19:00:01,327 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-01-17T19:00:01,331 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-01-17T19:00:01,334 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-01-17T19:00:01,338 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-01-17T19:00:01,346 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,361 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-01-17T19:00:01,367 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,369 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,377 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,382 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,385 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,389 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,392 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,395 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,405 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,409 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,419 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,424 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,429 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,434 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-01-17T19:00:01,439 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-01-17T19:00:01,443 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-01-17T19:00:01,445 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-01-17T19:00:01,449 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-01-17T19:00:01,453 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-01-17T19:00:01,457 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-01-17T19:00:01,462 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-01-17T19:00:01,467 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-01-17T19:00:01,472 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-01-17T19:00:01,474 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-01-17T19:00:01,478 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-01-17T19:00:01,481 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-01-17T19:00:01,484 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-01-17T19:00:01,487 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-01-17T19:00:01,490 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-01-17T19:00:01,493 copying build/lib/deepspeed/monitor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-01-17T19:00:01,496 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-01-17T19:00:01,499 running install_egg_info 2023-01-17T19:00:01,572 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.8.0-py3.7.egg-info 2023-01-17T19:00:01,597 running install_scripts 2023-01-17T19:00:01,739 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data 2023-01-17T19:00:01,740 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts 2023-01-17T19:00:01,741 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts 2023-01-17T19:00:01,745 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts 2023-01-17T19:00:01,748 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts 2023-01-17T19:00:01,751 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts 2023-01-17T19:00:01,754 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts 2023-01-17T19:00:01,757 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts 2023-01-17T19:00:01,760 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts 2023-01-17T19:00:01,763 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts 2023-01-17T19:00:01,766 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts/ds_ssh to 755 2023-01-17T19:00:01,766 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts/dsr to 755 2023-01-17T19:00:01,767 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts/ds_bench to 755 2023-01-17T19:00:01,767 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts/ds to 755 2023-01-17T19:00:01,768 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts/deepspeed to 755 2023-01-17T19:00:01,768 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts/ds_report to 755 2023-01-17T19:00:01,768 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts/deepspeed.pt to 755 2023-01-17T19:00:01,769 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.data/scripts/ds_elastic to 755 2023-01-17T19:00:02,054 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2023-01-17T19:00:02,062 creating build/bdist.linux-armv7l/wheel/deepspeed-0.8.0.dist-info/WHEEL 2023-01-17T19:00:02,067 creating '/tmp/pip-wheel-t6a0g90b/deepspeed-0.8.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-01-17T19:00:02,072 adding 'benchmarks/communication/__init__.py' 2023-01-17T19:00:02,075 adding 'benchmarks/communication/all_gather.py' 2023-01-17T19:00:02,078 adding 'benchmarks/communication/all_reduce.py' 2023-01-17T19:00:02,081 adding 'benchmarks/communication/all_to_all.py' 2023-01-17T19:00:02,084 adding 'benchmarks/communication/broadcast.py' 2023-01-17T19:00:02,086 adding 'benchmarks/communication/constants.py' 2023-01-17T19:00:02,089 adding 'benchmarks/communication/pt2pt.py' 2023-01-17T19:00:02,091 adding 'benchmarks/communication/run_all.py' 2023-01-17T19:00:02,094 adding 'benchmarks/communication/utils.py' 2023-01-17T19:00:02,100 adding 'deepspeed/__init__.py' 2023-01-17T19:00:02,102 adding 'deepspeed/constants.py' 2023-01-17T19:00:02,105 adding 'deepspeed/env_report.py' 2023-01-17T19:00:02,107 adding 'deepspeed/git_version_info.py' 2023-01-17T19:00:02,110 adding 'deepspeed/git_version_info_installed.py' 2023-01-17T19:00:02,113 adding 'deepspeed/accelerator/__init__.py' 2023-01-17T19:00:02,115 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-01-17T19:00:02,118 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-01-17T19:00:02,121 adding 'deepspeed/accelerator/real_accelerator.py' 2023-01-17T19:00:02,124 adding 'deepspeed/autotuning/__init__.py' 2023-01-17T19:00:02,137 adding 'deepspeed/autotuning/autotuner.py' 2023-01-17T19:00:02,141 adding 'deepspeed/autotuning/config.py' 2023-01-17T19:00:02,144 adding 'deepspeed/autotuning/constants.py' 2023-01-17T19:00:02,149 adding 'deepspeed/autotuning/scheduler.py' 2023-01-17T19:00:02,154 adding 'deepspeed/autotuning/utils.py' 2023-01-17T19:00:02,157 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-01-17T19:00:02,159 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-01-17T19:00:02,161 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-01-17T19:00:02,164 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-01-17T19:00:02,167 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-01-17T19:00:02,169 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-01-17T19:00:02,172 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-01-17T19:00:02,174 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-01-17T19:00:02,177 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-01-17T19:00:02,179 adding 'deepspeed/autotuning/tuner/utils.py' 2023-01-17T19:00:02,183 adding 'deepspeed/checkpoint/__init__.py' 2023-01-17T19:00:02,185 adding 'deepspeed/checkpoint/constants.py' 2023-01-17T19:00:02,189 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-01-17T19:00:02,192 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-01-17T19:00:02,195 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-01-17T19:00:02,198 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-01-17T19:00:02,201 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-01-17T19:00:02,203 adding 'deepspeed/checkpoint/utils.py' 2023-01-17T19:00:02,206 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-01-17T19:00:02,210 adding 'deepspeed/comm/__init__.py' 2023-01-17T19:00:02,212 adding 'deepspeed/comm/backend.py' 2023-01-17T19:00:02,219 adding 'deepspeed/comm/comm.py' 2023-01-17T19:00:02,222 adding 'deepspeed/comm/config.py' 2023-01-17T19:00:02,224 adding 'deepspeed/comm/constants.py' 2023-01-17T19:00:02,227 adding 'deepspeed/comm/torch.py' 2023-01-17T19:00:02,230 adding 'deepspeed/comm/utils.py' 2023-01-17T19:00:02,234 adding 'deepspeed/compression/__init__.py' 2023-01-17T19:00:02,241 adding 'deepspeed/compression/basic_layer.py' 2023-01-17T19:00:02,246 adding 'deepspeed/compression/compress.py' 2023-01-17T19:00:02,250 adding 'deepspeed/compression/config.py' 2023-01-17T19:00:02,253 adding 'deepspeed/compression/constants.py' 2023-01-17T19:00:02,256 adding 'deepspeed/compression/helper.py' 2023-01-17T19:00:02,260 adding 'deepspeed/compression/scheduler.py' 2023-01-17T19:00:02,263 adding 'deepspeed/compression/utils.py' 2023-01-17T19:00:02,266 adding 'deepspeed/elasticity/__init__.py' 2023-01-17T19:00:02,269 adding 'deepspeed/elasticity/config.py' 2023-01-17T19:00:02,272 adding 'deepspeed/elasticity/constants.py' 2023-01-17T19:00:02,275 adding 'deepspeed/elasticity/elastic_agent.py' 2023-01-17T19:00:02,280 adding 'deepspeed/elasticity/elasticity.py' 2023-01-17T19:00:02,283 adding 'deepspeed/elasticity/utils.py' 2023-01-17T19:00:02,286 adding 'deepspeed/inference/__init__.py' 2023-01-17T19:00:02,289 adding 'deepspeed/inference/config.py' 2023-01-17T19:00:02,296 adding 'deepspeed/inference/engine.py' 2023-01-17T19:00:02,299 adding 'deepspeed/launcher/__init__.py' 2023-01-17T19:00:02,301 adding 'deepspeed/launcher/constants.py' 2023-01-17T19:00:02,306 adding 'deepspeed/launcher/launch.py' 2023-01-17T19:00:02,310 adding 'deepspeed/launcher/multinode_runner.py' 2023-01-17T19:00:02,316 adding 'deepspeed/launcher/runner.py' 2023-01-17T19:00:02,319 adding 'deepspeed/model_implementations/__init__.py' 2023-01-17T19:00:02,322 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-01-17T19:00:02,325 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-01-17T19:00:02,327 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-01-17T19:00:02,330 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-01-17T19:00:02,333 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-01-17T19:00:02,336 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-01-17T19:00:02,339 adding 'deepspeed/module_inject/__init__.py' 2023-01-17T19:00:02,342 adding 'deepspeed/module_inject/inject.py' 2023-01-17T19:00:02,344 adding 'deepspeed/module_inject/layers.py' 2023-01-17T19:00:02,349 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-01-17T19:00:02,352 adding 'deepspeed/module_inject/module_quantize.py' 2023-01-17T19:00:02,363 adding 'deepspeed/module_inject/replace_module.py' 2023-01-17T19:00:02,370 adding 'deepspeed/module_inject/replace_policy.py' 2023-01-17T19:00:02,373 adding 'deepspeed/moe/__init__.py' 2023-01-17T19:00:02,376 adding 'deepspeed/moe/experts.py' 2023-01-17T19:00:02,379 adding 'deepspeed/moe/layer.py' 2023-01-17T19:00:02,382 adding 'deepspeed/moe/mappings.py' 2023-01-17T19:00:02,387 adding 'deepspeed/moe/sharded_moe.py' 2023-01-17T19:00:02,391 adding 'deepspeed/moe/utils.py' 2023-01-17T19:00:02,394 adding 'deepspeed/monitor/__init__.py' 2023-01-17T19:00:02,396 adding 'deepspeed/monitor/config.py' 2023-01-17T19:00:02,399 adding 'deepspeed/monitor/constants.py' 2023-01-17T19:00:02,401 adding 'deepspeed/monitor/csv_monitor.py' 2023-01-17T19:00:02,403 adding 'deepspeed/monitor/monitor.py' 2023-01-17T19:00:02,406 adding 'deepspeed/monitor/tensorboard.py' 2023-01-17T19:00:02,408 adding 'deepspeed/monitor/utils.py' 2023-01-17T19:00:02,410 adding 'deepspeed/monitor/wandb.py' 2023-01-17T19:00:02,413 adding 'deepspeed/nebula/__init__.py' 2023-01-17T19:00:02,415 adding 'deepspeed/nebula/config.py' 2023-01-17T19:00:02,418 adding 'deepspeed/nebula/constants.py' 2023-01-17T19:00:02,421 adding 'deepspeed/ops/__init__.py' 2023-01-17T19:00:02,424 adding 'deepspeed/ops/adagrad/__init__.py' 2023-01-17T19:00:02,427 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-01-17T19:00:02,430 adding 'deepspeed/ops/adam/__init__.py' 2023-01-17T19:00:02,434 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-01-17T19:00:02,437 adding 'deepspeed/ops/adam/fused_adam.py' 2023-01-17T19:00:02,439 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-01-17T19:00:02,442 adding 'deepspeed/ops/aio/__init__.py' 2023-01-17T19:00:02,448 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-01-17T19:00:02,452 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-01-17T19:00:02,454 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-01-17T19:00:02,457 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-01-17T19:00:02,460 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-01-17T19:00:02,466 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-01-17T19:00:02,469 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-01-17T19:00:02,471 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-01-17T19:00:02,473 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-01-17T19:00:02,476 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-01-17T19:00:02,478 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-01-17T19:00:02,482 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-01-17T19:00:02,484 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-01-17T19:00:02,487 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-01-17T19:00:02,489 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-01-17T19:00:02,492 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-01-17T19:00:02,495 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-01-17T19:00:02,497 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-01-17T19:00:02,500 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-01-17T19:00:02,502 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-01-17T19:00:02,505 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-01-17T19:00:02,508 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-01-17T19:00:02,513 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-01-17T19:00:02,515 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-01-17T19:00:02,517 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-01-17T19:00:02,520 adding 'deepspeed/ops/csrc/includes/context.h' 2023-01-17T19:00:02,523 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-01-17T19:00:02,526 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-01-17T19:00:02,530 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-01-17T19:00:02,532 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-01-17T19:00:02,536 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-01-17T19:00:02,539 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-01-17T19:00:02,542 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-01-17T19:00:02,544 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-01-17T19:00:02,546 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-01-17T19:00:02,549 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-01-17T19:00:02,551 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-01-17T19:00:02,554 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-01-17T19:00:02,557 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-01-17T19:00:02,562 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-01-17T19:00:02,566 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-01-17T19:00:02,568 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-01-17T19:00:02,573 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-01-17T19:00:02,575 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-01-17T19:00:02,580 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-01-17T19:00:02,583 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-01-17T19:00:02,585 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-01-17T19:00:02,588 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-01-17T19:00:02,591 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-01-17T19:00:02,595 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-01-17T19:00:02,599 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-01-17T19:00:02,603 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-01-17T19:00:02,609 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-01-17T19:00:02,612 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-01-17T19:00:02,616 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-01-17T19:00:02,620 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-01-17T19:00:02,623 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-01-17T19:00:02,625 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-01-17T19:00:02,629 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-01-17T19:00:02,632 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-01-17T19:00:02,637 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-01-17T19:00:02,640 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-01-17T19:00:02,643 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-01-17T19:00:02,648 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-01-17T19:00:02,653 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-01-17T19:00:02,662 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-01-17T19:00:02,667 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-01-17T19:00:02,670 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-01-17T19:00:02,680 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-01-17T19:00:02,687 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-01-17T19:00:02,693 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-01-17T19:00:02,699 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-01-17T19:00:02,702 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-01-17T19:00:02,708 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-01-17T19:00:02,713 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-01-17T19:00:02,725 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-01-17T19:00:02,729 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-01-17T19:00:02,734 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-01-17T19:00:02,740 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-01-17T19:00:02,745 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-01-17T19:00:02,749 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-01-17T19:00:02,752 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-01-17T19:00:02,755 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-01-17T19:00:02,758 adding 'deepspeed/ops/lamb/__init__.py' 2023-01-17T19:00:02,762 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-01-17T19:00:02,765 adding 'deepspeed/ops/op_builder/__init__.py' 2023-01-17T19:00:02,768 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-01-17T19:00:02,770 adding 'deepspeed/ops/op_builder/async_io.py' 2023-01-17T19:00:02,777 adding 'deepspeed/ops/op_builder/builder.py' 2023-01-17T19:00:02,780 adding 'deepspeed/ops/op_builder/builder_names.py' 2023-01-17T19:00:02,782 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-01-17T19:00:02,785 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-01-17T19:00:02,787 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-01-17T19:00:02,789 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-01-17T19:00:02,791 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-01-17T19:00:02,794 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-01-17T19:00:02,796 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-01-17T19:00:02,799 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-01-17T19:00:02,801 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-01-17T19:00:02,803 adding 'deepspeed/ops/op_builder/transformer.py' 2023-01-17T19:00:02,805 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-01-17T19:00:02,807 adding 'deepspeed/ops/op_builder/utils.py' 2023-01-17T19:00:02,811 adding 'deepspeed/ops/quantizer/__init__.py' 2023-01-17T19:00:02,813 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-01-17T19:00:02,816 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-01-17T19:00:02,819 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-01-17T19:00:02,822 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-01-17T19:00:02,825 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-01-17T19:00:02,834 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-01-17T19:00:02,838 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-01-17T19:00:02,843 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-01-17T19:00:02,846 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-01-17T19:00:02,853 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-01-17T19:00:02,857 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-01-17T19:00:02,861 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-01-17T19:00:02,863 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-01-17T19:00:02,866 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-01-17T19:00:02,869 adding 'deepspeed/ops/transformer/__init__.py' 2023-01-17T19:00:02,874 adding 'deepspeed/ops/transformer/transformer.py' 2023-01-17T19:00:02,878 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-01-17T19:00:02,880 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-01-17T19:00:02,883 adding 'deepspeed/ops/transformer/inference/config.py' 2023-01-17T19:00:02,885 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-01-17T19:00:02,889 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-01-17T19:00:02,892 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-01-17T19:00:02,896 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-01-17T19:00:02,899 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-01-17T19:00:02,904 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-01-17T19:00:02,907 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-01-17T19:00:02,911 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-01-17T19:00:02,913 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-01-17T19:00:02,915 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-01-17T19:00:02,917 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-01-17T19:00:02,920 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-01-17T19:00:02,922 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-01-17T19:00:02,924 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-01-17T19:00:02,926 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-01-17T19:00:02,928 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-01-17T19:00:02,931 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-01-17T19:00:02,934 adding 'deepspeed/pipe/__init__.py' 2023-01-17T19:00:02,936 adding 'deepspeed/profiling/__init__.py' 2023-01-17T19:00:02,939 adding 'deepspeed/profiling/config.py' 2023-01-17T19:00:02,941 adding 'deepspeed/profiling/constants.py' 2023-01-17T19:00:02,944 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-01-17T19:00:02,955 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-01-17T19:00:02,960 adding 'deepspeed/runtime/__init__.py' 2023-01-17T19:00:02,965 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-01-17T19:00:02,974 adding 'deepspeed/runtime/config.py' 2023-01-17T19:00:02,978 adding 'deepspeed/runtime/config_utils.py' 2023-01-17T19:00:02,982 adding 'deepspeed/runtime/constants.py' 2023-01-17T19:00:02,985 adding 'deepspeed/runtime/dataloader.py' 2023-01-17T19:00:02,988 adding 'deepspeed/runtime/eigenvalue.py' 2023-01-17T19:00:03,028 adding 'deepspeed/runtime/engine.py' 2023-01-17T19:00:03,039 adding 'deepspeed/runtime/lr_schedules.py' 2023-01-17T19:00:03,042 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-01-17T19:00:03,045 adding 'deepspeed/runtime/quantize.py' 2023-01-17T19:00:03,047 adding 'deepspeed/runtime/sparse_tensor.py' 2023-01-17T19:00:03,052 adding 'deepspeed/runtime/state_dict_factory.py' 2023-01-17T19:00:03,063 adding 'deepspeed/runtime/utils.py' 2023-01-17T19:00:03,067 adding 'deepspeed/runtime/weight_quantizer.py' 2023-01-17T19:00:03,070 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-01-17T19:00:03,079 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-01-17T19:00:03,082 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-01-17T19:00:03,085 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-01-17T19:00:03,087 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-01-17T19:00:03,090 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-01-17T19:00:03,092 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-01-17T19:00:03,095 adding 'deepspeed/runtime/comm/__init__.py' 2023-01-17T19:00:03,098 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-01-17T19:00:03,101 adding 'deepspeed/runtime/comm/mpi.py' 2023-01-17T19:00:03,105 adding 'deepspeed/runtime/comm/nccl.py' 2023-01-17T19:00:03,108 adding 'deepspeed/runtime/compression/__init__.py' 2023-01-17T19:00:03,110 adding 'deepspeed/runtime/compression/cupy.py' 2023-01-17T19:00:03,113 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-01-17T19:00:03,116 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-01-17T19:00:03,119 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-01-17T19:00:03,122 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-01-17T19:00:03,125 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-01-17T19:00:03,128 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-01-17T19:00:03,130 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-01-17T19:00:03,133 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-01-17T19:00:03,135 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-01-17T19:00:03,139 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-01-17T19:00:03,144 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-01-17T19:00:03,150 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-01-17T19:00:03,156 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-01-17T19:00:03,159 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-01-17T19:00:03,162 adding 'deepspeed/runtime/fp16/__init__.py' 2023-01-17T19:00:03,168 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-01-17T19:00:03,172 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-01-17T19:00:03,177 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-01-17T19:00:03,181 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-01-17T19:00:03,185 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-01-17T19:00:03,192 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-01-17T19:00:03,197 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-01-17T19:00:03,201 adding 'deepspeed/runtime/pipe/__init__.py' 2023-01-17T19:00:03,215 adding 'deepspeed/runtime/pipe/engine.py' 2023-01-17T19:00:03,224 adding 'deepspeed/runtime/pipe/module.py' 2023-01-17T19:00:03,227 adding 'deepspeed/runtime/pipe/p2p.py' 2023-01-17T19:00:03,232 adding 'deepspeed/runtime/pipe/schedule.py' 2023-01-17T19:00:03,237 adding 'deepspeed/runtime/pipe/topology.py' 2023-01-17T19:00:03,241 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-01-17T19:00:03,243 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-01-17T19:00:03,246 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-01-17T19:00:03,249 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-01-17T19:00:03,254 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-01-17T19:00:03,258 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-01-17T19:00:03,264 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-01-17T19:00:03,267 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-01-17T19:00:03,271 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-01-17T19:00:03,274 adding 'deepspeed/runtime/zero/__init__.py' 2023-01-17T19:00:03,278 adding 'deepspeed/runtime/zero/config.py' 2023-01-17T19:00:03,282 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-01-17T19:00:03,286 adding 'deepspeed/runtime/zero/linear.py' 2023-01-17T19:00:03,288 adding 'deepspeed/runtime/zero/offload_config.py' 2023-01-17T19:00:03,294 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-01-17T19:00:03,313 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-01-17T19:00:03,321 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-01-17T19:00:03,352 adding 'deepspeed/runtime/zero/stage3.py' 2023-01-17T19:00:03,384 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-01-17T19:00:03,389 adding 'deepspeed/runtime/zero/test.py' 2023-01-17T19:00:03,393 adding 'deepspeed/runtime/zero/tiling.py' 2023-01-17T19:00:03,396 adding 'deepspeed/runtime/zero/utils.py' 2023-01-17T19:00:03,399 adding 'deepspeed/utils/__init__.py' 2023-01-17T19:00:03,402 adding 'deepspeed/utils/comms_logging.py' 2023-01-17T19:00:03,405 adding 'deepspeed/utils/debug.py' 2023-01-17T19:00:03,407 adding 'deepspeed/utils/exceptions.py' 2023-01-17T19:00:03,412 adding 'deepspeed/utils/groups.py' 2023-01-17T19:00:03,414 adding 'deepspeed/utils/init_on_device.py' 2023-01-17T19:00:03,417 adding 'deepspeed/utils/logging.py' 2023-01-17T19:00:03,419 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-01-17T19:00:03,422 adding 'deepspeed/utils/nvtx.py' 2023-01-17T19:00:03,425 adding 'deepspeed/utils/tensor_fragment.py' 2023-01-17T19:00:03,428 adding 'deepspeed/utils/timer.py' 2023-01-17T19:00:03,430 adding 'deepspeed/utils/types.py' 2023-01-17T19:00:03,436 adding 'deepspeed/utils/zero_to_fp32.py' 2023-01-17T19:00:03,440 adding 'deepspeed-0.8.0.data/scripts/deepspeed' 2023-01-17T19:00:03,442 adding 'deepspeed-0.8.0.data/scripts/deepspeed.pt' 2023-01-17T19:00:03,444 adding 'deepspeed-0.8.0.data/scripts/ds' 2023-01-17T19:00:03,446 adding 'deepspeed-0.8.0.data/scripts/ds_bench' 2023-01-17T19:00:03,448 adding 'deepspeed-0.8.0.data/scripts/ds_elastic' 2023-01-17T19:00:03,450 adding 'deepspeed-0.8.0.data/scripts/ds_report' 2023-01-17T19:00:03,452 adding 'deepspeed-0.8.0.data/scripts/ds_ssh' 2023-01-17T19:00:03,454 adding 'deepspeed-0.8.0.data/scripts/dsr' 2023-01-17T19:00:03,459 adding 'deepspeed-0.8.0.dist-info/LICENSE' 2023-01-17T19:00:03,466 adding 'deepspeed-0.8.0.dist-info/METADATA' 2023-01-17T19:00:03,469 adding 'deepspeed-0.8.0.dist-info/WHEEL' 2023-01-17T19:00:03,470 adding 'deepspeed-0.8.0.dist-info/entry_points.txt' 2023-01-17T19:00:03,472 adding 'deepspeed-0.8.0.dist-info/top_level.txt' 2023-01-17T19:00:03,487 adding 'deepspeed-0.8.0.dist-info/RECORD' 2023-01-17T19:00:03,528 removing build/bdist.linux-armv7l/wheel 2023-01-17T19:00:03,731 deepspeed build time = 11.14946460723877 secs 2023-01-17T19:00:03,993 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-01-17T19:00:04,022 Created wheel for deepspeed: filename=deepspeed-0.8.0-py3-none-any.whl size=752092 sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 2023-01-17T19:00:04,024 Stored in directory: /tmp/pip-ephem-wheel-cache-mo8httwo/wheels/49/21/2e/f288ad57e8f61d145dff78af55690ed8610d4876f236947e59 2023-01-17T19:00:04,087 Successfully built deepspeed 2023-01-17T19:00:04,158 Removed build tracker: '/tmp/pip-build-tracker-rjcn4ffv'