2023-06-22T19:15:50,208 Created temporary directory: /tmp/pip-build-tracker-_34mtwcl 2023-06-22T19:15:50,211 Initialized build tracking at /tmp/pip-build-tracker-_34mtwcl 2023-06-22T19:15:50,211 Created build tracker: /tmp/pip-build-tracker-_34mtwcl 2023-06-22T19:15:50,212 Entered build tracker: /tmp/pip-build-tracker-_34mtwcl 2023-06-22T19:15:50,213 Created temporary directory: /tmp/pip-wheel-itay6csb 2023-06-22T19:15:50,222 Created temporary directory: /tmp/pip-ephem-wheel-cache-d4ii9fcr 2023-06-22T19:15:50,278 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-06-22T19:15:50,286 2 location(s) to search for versions of deepspeed: 2023-06-22T19:15:50,286 * https://pypi.org/simple/deepspeed/ 2023-06-22T19:15:50,286 * https://www.piwheels.org/simple/deepspeed/ 2023-06-22T19:15:50,287 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-06-22T19:15:50,288 Getting page https://pypi.org/simple/deepspeed/ 2023-06-22T19:15:50,293 Found index url https://pypi.org/simple/ 2023-06-22T19:15:50,521 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-06-22T19:15:50,555 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-06-22T19:15:50,556 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-06-22T19:15:50,557 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-06-22T19:15:50,557 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-06-22T19:15:50,558 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-06-22T19:15:50,558 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-06-22T19:15:50,559 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-06-22T19:15:50,560 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-06-22T19:15:50,560 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-06-22T19:15:50,561 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-06-22T19:15:50,562 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-06-22T19:15:50,562 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-06-22T19:15:50,563 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-06-22T19:15:50,564 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-06-22T19:15:50,565 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-06-22T19:15:50,565 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-06-22T19:15:50,566 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-06-22T19:15:50,567 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-06-22T19:15:50,567 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-06-22T19:15:50,568 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-06-22T19:15:50,569 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-06-22T19:15:50,569 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-06-22T19:15:50,570 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-06-22T19:15:50,571 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-06-22T19:15:50,572 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-06-22T19:15:50,572 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-06-22T19:15:50,573 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-06-22T19:15:50,574 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-06-22T19:15:50,574 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-06-22T19:15:50,575 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-06-22T19:15:50,576 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-06-22T19:15:50,576 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-06-22T19:15:50,577 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-06-22T19:15:50,578 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-06-22T19:15:50,578 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-06-22T19:15:50,579 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-06-22T19:15:50,580 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-06-22T19:15:50,581 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-06-22T19:15:50,581 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-06-22T19:15:50,582 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-06-22T19:15:50,583 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-06-22T19:15:50,584 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-06-22T19:15:50,584 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-06-22T19:15:50,585 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-06-22T19:15:50,586 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-06-22T19:15:50,586 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-06-22T19:15:50,587 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-06-22T19:15:50,588 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-06-22T19:15:50,588 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-06-22T19:15:50,589 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-06-22T19:15:50,590 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-06-22T19:15:50,590 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-06-22T19:15:50,591 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-06-22T19:15:50,592 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-06-22T19:15:50,592 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-06-22T19:15:50,593 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-06-22T19:15:50,594 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-06-22T19:15:50,594 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-06-22T19:15:50,595 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-06-22T19:15:50,596 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-06-22T19:15:50,596 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-06-22T19:15:50,597 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-06-22T19:15:50,598 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-06-22T19:15:50,598 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-06-22T19:15:50,599 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-06-22T19:15:50,600 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-06-22T19:15:50,600 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-06-22T19:15:50,601 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-06-22T19:15:50,602 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2023-06-22T19:15:50,602 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2023-06-22T19:15:50,603 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2023-06-22T19:15:50,604 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-06-22T19:15:50,605 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-06-22T19:15:50,607 Found index url https://www.piwheels.org/simple/ 2023-06-22T19:15:50,835 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-06-22T19:15:50,869 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,869 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,870 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,871 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,871 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,872 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,872 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,873 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,873 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,874 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,875 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,875 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,876 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,876 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,877 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,877 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,878 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,878 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,879 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,879 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,880 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,880 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,881 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,881 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,882 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,883 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,883 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,884 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,884 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,885 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,885 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,886 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,886 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,887 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,887 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,888 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,888 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,889 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,889 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,890 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,890 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-06-22T19:15:50,891 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-06-22T19:15:50,891 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-06-22T19:15:50,946 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-06-22T19:15:50,978 Collecting deepspeed==0.9.5 2023-06-22T19:15:50,983 Created temporary directory: /tmp/pip-unpack-w3tjspb8 2023-06-22T19:15:51,159 Downloading deepspeed-0.9.5.tar.gz (809 kB) 2023-06-22T19:15:54,009 Added deepspeed==0.9.5 from https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz to build tracker '/tmp/pip-build-tracker-_34mtwcl' 2023-06-22T19:15:54,013 Running setup.py (path:/tmp/pip-wheel-itay6csb/deepspeed_abd5c8ebe9fa4cc5b8f5d84af034af6b/setup.py) egg_info for package deepspeed 2023-06-22T19:15:54,014 Created temporary directory: /tmp/pip-pip-egg-info-jl859hvq 2023-06-22T19:15:54,014 Preparing metadata (setup.py): started 2023-06-22T19:15:54,017 Running command python setup.py egg_info 2023-06-22T19:15:55,969 fatal: not a git repository (or any of the parent directories): .git 2023-06-22T19:15:56,637 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-06-22T19:15:56,637  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-06-22T19:15:56,638 DS_BUILD_OPS=0 2023-06-22T19:15:56,638  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-06-22T19:15:56,638  [WARNING]  async_io: please install the libaio-dev package with apt 2023-06-22T19:15:56,639  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-06-22T19:15:56,639  [WARNING]  unable to import torch, please install it first 2023-06-22T19:15:56,639  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-06-22T19:15:56,640  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-06-22T19:15:56,640 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-06-22T19:15:56,640 version=0.9.5, git_hash=unknown, git_branch=unknown 2023-06-22T19:15:56,641 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-06-22T19:15:56,641 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False} 2023-06-22T19:15:56,642 ext_modules=[] 2023-06-22T19:15:56,642 running egg_info 2023-06-22T19:15:56,642 creating /tmp/pip-pip-egg-info-jl859hvq/deepspeed.egg-info 2023-06-22T19:15:56,706 writing /tmp/pip-pip-egg-info-jl859hvq/deepspeed.egg-info/PKG-INFO 2023-06-22T19:15:56,713 writing dependency_links to /tmp/pip-pip-egg-info-jl859hvq/deepspeed.egg-info/dependency_links.txt 2023-06-22T19:15:56,718 writing entry points to /tmp/pip-pip-egg-info-jl859hvq/deepspeed.egg-info/entry_points.txt 2023-06-22T19:15:56,723 writing requirements to /tmp/pip-pip-egg-info-jl859hvq/deepspeed.egg-info/requires.txt 2023-06-22T19:15:56,725 writing top-level names to /tmp/pip-pip-egg-info-jl859hvq/deepspeed.egg-info/top_level.txt 2023-06-22T19:15:56,727 writing manifest file '/tmp/pip-pip-egg-info-jl859hvq/deepspeed.egg-info/SOURCES.txt' 2023-06-22T19:15:57,091 reading manifest file '/tmp/pip-pip-egg-info-jl859hvq/deepspeed.egg-info/SOURCES.txt' 2023-06-22T19:15:57,095 reading manifest template 'MANIFEST.in' 2023-06-22T19:15:58,463 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-06-22T19:15:59,437 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-06-22T19:16:00,119 warning: no files found matching '*.tr' under directory 'csrc' 2023-06-22T19:16:00,275 warning: no files found matching '*.cc' under directory 'csrc' 2023-06-22T19:16:00,307 warning: no files found matching '*.py' under directory 'benchmarks' 2023-06-22T19:16:00,318 adding license file 'LICENSE' 2023-06-22T19:16:00,376 writing manifest file '/tmp/pip-pip-egg-info-jl859hvq/deepspeed.egg-info/SOURCES.txt' 2023-06-22T19:16:00,380 deepspeed build time = 4.401026964187622 secs 2023-06-22T19:16:00,510 Preparing metadata (setup.py): finished with status 'done' 2023-06-22T19:16:00,530 Source in /tmp/pip-wheel-itay6csb/deepspeed_abd5c8ebe9fa4cc5b8f5d84af034af6b has version 0.9.5, which satisfies requirement deepspeed==0.9.5 from https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz 2023-06-22T19:16:00,532 Removed deepspeed==0.9.5 from https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz from build tracker '/tmp/pip-build-tracker-_34mtwcl' 2023-06-22T19:16:00,550 Created temporary directory: /tmp/pip-unpack-tkeotvy0 2023-06-22T19:16:00,551 Building wheels for collected packages: deepspeed 2023-06-22T19:16:00,560 Created temporary directory: /tmp/pip-wheel-pz1cjyxo 2023-06-22T19:16:00,560 Building wheel for deepspeed (setup.py): started 2023-06-22T19:16:00,563 Destination directory: /tmp/pip-wheel-pz1cjyxo 2023-06-22T19:16:00,563 Running command python setup.py bdist_wheel 2023-06-22T19:16:01,688 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-06-22T19:16:01,716  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-06-22T19:16:01,808 DS_BUILD_OPS=0 2023-06-22T19:16:02,105  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-06-22T19:16:02,272  [WARNING]  async_io: please install the libaio-dev package with apt 2023-06-22T19:16:02,274  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-06-22T19:16:02,278  [WARNING]  unable to import torch, please install it first 2023-06-22T19:16:02,279  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-06-22T19:16:02,282  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-06-22T19:16:02,282 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-06-22T19:16:02,324 fatal: not a git repository (or any of the parent directories): .git 2023-06-22T19:16:02,328 version=0.9.5, git_hash=unknown, git_branch=unknown 2023-06-22T19:16:02,331 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-06-22T19:16:02,332 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False} 2023-06-22T19:16:02,333 ext_modules=[] 2023-06-22T19:16:03,053 running bdist_wheel 2023-06-22T19:16:03,788 running build 2023-06-22T19:16:03,789 running build_py 2023-06-22T19:16:03,863 creating build 2023-06-22T19:16:03,864 creating build/lib 2023-06-22T19:16:03,866 creating build/lib/deepspeed 2023-06-22T19:16:03,869 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-06-22T19:16:03,873 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-06-22T19:16:03,877 copying deepspeed/constants.py -> build/lib/deepspeed 2023-06-22T19:16:03,881 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-06-22T19:16:03,885 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-06-22T19:16:03,891 creating build/lib/deepspeed/pipe 2023-06-22T19:16:03,893 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-06-22T19:16:03,898 creating build/lib/deepspeed/moe 2023-06-22T19:16:03,899 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-06-22T19:16:03,903 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-06-22T19:16:03,908 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-06-22T19:16:03,912 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-06-22T19:16:03,915 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-06-22T19:16:03,919 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-06-22T19:16:03,924 creating build/lib/deepspeed/accelerator 2023-06-22T19:16:03,926 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2023-06-22T19:16:03,930 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-06-22T19:16:03,934 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2023-06-22T19:16:03,938 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-06-22T19:16:03,942 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-06-22T19:16:03,946 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-06-22T19:16:03,951 creating build/lib/deepspeed/launcher 2023-06-22T19:16:03,953 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-06-22T19:16:03,958 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-06-22T19:16:03,962 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-06-22T19:16:03,967 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-06-22T19:16:03,970 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-06-22T19:16:03,977 creating build/lib/deepspeed/ops 2023-06-22T19:16:03,978 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-06-22T19:16:03,984 creating build/lib/deepspeed/comm 2023-06-22T19:16:03,985 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-06-22T19:16:03,992 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-06-22T19:16:03,997 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2023-06-22T19:16:04,000 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-06-22T19:16:04,003 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2023-06-22T19:16:04,007 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-06-22T19:16:04,010 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-06-22T19:16:04,014 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-06-22T19:16:04,017 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-06-22T19:16:04,024 creating build/lib/deepspeed/runtime 2023-06-22T19:16:04,025 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,033 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,037 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,041 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,045 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,050 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,055 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,060 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,066 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,072 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,077 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,084 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,089 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,095 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,100 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,113 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-06-22T19:16:04,120 creating build/lib/deepspeed/nebula 2023-06-22T19:16:04,122 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-06-22T19:16:04,126 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-06-22T19:16:04,130 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-06-22T19:16:04,136 creating build/lib/deepspeed/inference 2023-06-22T19:16:04,138 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-06-22T19:16:04,143 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-06-22T19:16:04,147 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-06-22T19:16:04,156 creating build/lib/deepspeed/model_implementations 2023-06-22T19:16:04,158 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-06-22T19:16:04,164 creating build/lib/deepspeed/compression 2023-06-22T19:16:04,166 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-06-22T19:16:04,173 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-06-22T19:16:04,178 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-06-22T19:16:04,183 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-06-22T19:16:04,189 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-06-22T19:16:04,194 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-06-22T19:16:04,198 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-06-22T19:16:04,202 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-06-22T19:16:04,210 creating build/lib/deepspeed/utils 2023-06-22T19:16:04,213 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,217 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,222 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,227 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,232 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,237 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,242 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,246 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,251 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,256 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,260 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,266 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,272 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,277 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-06-22T19:16:04,284 creating build/lib/deepspeed/module_inject 2023-06-22T19:16:04,286 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-06-22T19:16:04,293 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-06-22T19:16:04,298 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-06-22T19:16:04,302 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-06-22T19:16:04,306 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-06-22T19:16:04,312 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-06-22T19:16:04,317 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-06-22T19:16:04,321 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-06-22T19:16:04,325 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-06-22T19:16:04,330 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-06-22T19:16:04,336 creating build/lib/deepspeed/elasticity 2023-06-22T19:16:04,339 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-06-22T19:16:04,344 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-06-22T19:16:04,350 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-06-22T19:16:04,355 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-06-22T19:16:04,360 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-06-22T19:16:04,364 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-06-22T19:16:04,370 creating build/lib/deepspeed/profiling 2023-06-22T19:16:04,372 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-06-22T19:16:04,377 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-06-22T19:16:04,381 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-06-22T19:16:04,386 creating build/lib/deepspeed/monitor 2023-06-22T19:16:04,388 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-06-22T19:16:04,392 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-06-22T19:16:04,396 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-06-22T19:16:04,399 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-06-22T19:16:04,403 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-06-22T19:16:04,406 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-06-22T19:16:04,409 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-06-22T19:16:04,415 creating build/lib/deepspeed/autotuning 2023-06-22T19:16:04,417 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-06-22T19:16:04,421 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-06-22T19:16:04,427 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-06-22T19:16:04,433 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-06-22T19:16:04,438 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-06-22T19:16:04,443 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-06-22T19:16:04,449 creating build/lib/deepspeed/checkpoint 2023-06-22T19:16:04,452 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-06-22T19:16:04,457 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-06-22T19:16:04,462 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-06-22T19:16:04,466 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-06-22T19:16:04,470 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-06-22T19:16:04,475 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-06-22T19:16:04,479 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-06-22T19:16:04,484 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-06-22T19:16:04,489 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-06-22T19:16:04,495 creating build/lib/deepspeed/ops/transformer 2023-06-22T19:16:04,497 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-06-22T19:16:04,503 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-06-22T19:16:04,510 creating build/lib/deepspeed/ops/sparse_attention 2023-06-22T19:16:04,513 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-22T19:16:04,518 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-22T19:16:04,524 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-22T19:16:04,530 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-22T19:16:04,535 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-22T19:16:04,539 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-22T19:16:04,544 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-06-22T19:16:04,551 creating build/lib/deepspeed/ops/quantizer 2023-06-22T19:16:04,554 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-06-22T19:16:04,558 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-06-22T19:16:04,564 creating build/lib/deepspeed/ops/adagrad 2023-06-22T19:16:04,566 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-06-22T19:16:04,570 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-06-22T19:16:04,575 creating build/lib/deepspeed/ops/aio 2023-06-22T19:16:04,577 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-06-22T19:16:04,582 creating build/lib/deepspeed/ops/lamb 2023-06-22T19:16:04,584 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-06-22T19:16:04,588 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-06-22T19:16:04,595 creating build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,597 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,600 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,604 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,608 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,612 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,615 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,619 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,622 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,626 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,630 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,633 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,637 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,641 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,646 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,649 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-06-22T19:16:04,654 creating build/lib/deepspeed/ops/adam 2023-06-22T19:16:04,656 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-06-22T19:16:04,661 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-06-22T19:16:04,664 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-06-22T19:16:04,668 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-06-22T19:16:04,673 creating build/lib/deepspeed/ops/random_ltd 2023-06-22T19:16:04,675 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-06-22T19:16:04,679 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-06-22T19:16:04,685 creating build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,687 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,692 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,696 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,699 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,704 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,709 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,713 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,716 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,720 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,724 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-06-22T19:16:04,730 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,732 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,736 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,740 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,744 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,747 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,751 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,755 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,758 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,762 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,766 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:04,770 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-06-22T19:16:04,772 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-06-22T19:16:04,777 creating build/lib/deepspeed/ops/op_builder/cpu 2023-06-22T19:16:04,779 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-06-22T19:16:04,783 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-06-22T19:16:04,786 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-06-22T19:16:04,790 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-06-22T19:16:04,795 creating build/lib/deepspeed/runtime/pipe 2023-06-22T19:16:04,797 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-06-22T19:16:04,802 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-06-22T19:16:04,806 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-06-22T19:16:04,810 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-06-22T19:16:04,815 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-06-22T19:16:04,818 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-06-22T19:16:04,827 creating build/lib/deepspeed/runtime/swap_tensor 2023-06-22T19:16:04,829 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-22T19:16:04,834 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-22T19:16:04,837 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-22T19:16:04,841 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-22T19:16:04,845 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-22T19:16:04,849 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-22T19:16:04,853 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-22T19:16:04,857 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-22T19:16:04,861 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-06-22T19:16:04,867 creating build/lib/deepspeed/runtime/comm 2023-06-22T19:16:04,869 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-06-22T19:16:04,873 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-06-22T19:16:04,877 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-06-22T19:16:04,881 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-06-22T19:16:04,886 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-06-22T19:16:04,889 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-06-22T19:16:04,893 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-06-22T19:16:04,897 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-06-22T19:16:04,905 creating build/lib/deepspeed/runtime/compression 2023-06-22T19:16:04,907 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-06-22T19:16:04,912 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-06-22T19:16:04,917 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-06-22T19:16:04,920 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-06-22T19:16:04,925 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-06-22T19:16:04,929 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-06-22T19:16:04,933 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-06-22T19:16:04,940 creating build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,942 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,947 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,952 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,964 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,969 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,974 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,978 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,983 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,988 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,992 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:04,995 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:05,005 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:05,009 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:05,015 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:05,020 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-06-22T19:16:05,032 creating build/lib/deepspeed/runtime/data_pipeline 2023-06-22T19:16:05,035 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-06-22T19:16:05,040 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-06-22T19:16:05,046 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-06-22T19:16:05,051 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-06-22T19:16:05,056 creating build/lib/deepspeed/runtime/fp16 2023-06-22T19:16:05,059 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-06-22T19:16:05,066 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-06-22T19:16:05,072 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-06-22T19:16:05,077 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-06-22T19:16:05,083 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:05,086 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:05,092 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:05,098 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:05,104 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:05,107 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:05,113 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:05,115 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:05,120 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:05,123 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:05,127 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:05,131 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:05,136 creating build/lib/deepspeed/runtime/fp16/onebit 2023-06-22T19:16:05,138 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-06-22T19:16:05,144 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-06-22T19:16:05,151 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-06-22T19:16:05,156 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-06-22T19:16:05,161 creating build/lib/deepspeed/model_implementations/features 2023-06-22T19:16:05,164 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-06-22T19:16:05,168 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-06-22T19:16:05,174 creating build/lib/deepspeed/model_implementations/diffusers 2023-06-22T19:16:05,176 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-06-22T19:16:05,180 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-06-22T19:16:05,185 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-06-22T19:16:05,191 creating build/lib/deepspeed/model_implementations/transformers 2023-06-22T19:16:05,193 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-22T19:16:05,198 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-22T19:16:05,202 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-22T19:16:05,206 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-22T19:16:05,210 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-22T19:16:05,214 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-22T19:16:05,218 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-22T19:16:05,222 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-22T19:16:05,226 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-06-22T19:16:05,234 creating build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,236 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,240 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,244 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,248 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,252 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,255 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,258 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,262 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,267 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,272 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,276 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,280 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,285 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,289 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,293 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,297 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,302 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-06-22T19:16:05,309 creating build/lib/deepspeed/module_inject/containers/features 2023-06-22T19:16:05,311 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-22T19:16:05,316 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-22T19:16:05,320 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-22T19:16:05,325 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-22T19:16:05,329 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-22T19:16:05,334 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-22T19:16:05,339 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-06-22T19:16:05,345 creating build/lib/deepspeed/profiling/flops_profiler 2023-06-22T19:16:05,348 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-06-22T19:16:05,355 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-06-22T19:16:05,360 creating build/lib/deepspeed/autotuning/tuner 2023-06-22T19:16:05,363 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-06-22T19:16:05,368 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-06-22T19:16:05,372 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-06-22T19:16:05,376 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-06-22T19:16:05,380 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-06-22T19:16:05,384 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-06-22T19:16:05,389 running egg_info 2023-06-22T19:16:05,520 writing deepspeed.egg-info/PKG-INFO 2023-06-22T19:16:05,527 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-06-22T19:16:05,532 writing entry points to deepspeed.egg-info/entry_points.txt 2023-06-22T19:16:05,537 writing requirements to deepspeed.egg-info/requires.txt 2023-06-22T19:16:05,541 writing top-level names to deepspeed.egg-info/top_level.txt 2023-06-22T19:16:05,703 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-06-22T19:16:05,765 reading manifest template 'MANIFEST.in' 2023-06-22T19:16:07,168 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-06-22T19:16:08,168 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-06-22T19:16:08,841 warning: no files found matching '*.tr' under directory 'csrc' 2023-06-22T19:16:09,007 warning: no files found matching '*.cc' under directory 'csrc' 2023-06-22T19:16:09,040 warning: no files found matching '*.py' under directory 'benchmarks' 2023-06-22T19:16:09,051 adding license file 'LICENSE' 2023-06-22T19:16:09,129 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-06-22T19:16:09,148 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-06-22T19:16:09,148 !! 2023-06-22T19:16:09,149 ******************************************************************************** 2023-06-22T19:16:09,149 ############################ 2023-06-22T19:16:09,149 # Package would be ignored # 2023-06-22T19:16:09,150 ############################ 2023-06-22T19:16:09,150 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-06-22T19:16:09,150 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,151 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,151 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-06-22T19:16:09,151 to the `packages` configuration field. 2023-06-22T19:16:09,152 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,152 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,153 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,153 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,154 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,154 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-06-22T19:16:09,155 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-06-22T19:16:09,155 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,155 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,155 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,156 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,157 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,158 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,158 even if it does not contain any `.py` files. 2023-06-22T19:16:09,158 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,159 directory, all directories are treated like packages. 2023-06-22T19:16:09,159 ******************************************************************************** 2023-06-22T19:16:09,159 !! 2023-06-22T19:16:09,160 check.warn(importable) 2023-06-22T19:16:09,160 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-06-22T19:16:09,160 !! 2023-06-22T19:16:09,161 ******************************************************************************** 2023-06-22T19:16:09,161 ############################ 2023-06-22T19:16:09,162 # Package would be ignored # 2023-06-22T19:16:09,162 ############################ 2023-06-22T19:16:09,162 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-06-22T19:16:09,163 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,163 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,163 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-06-22T19:16:09,164 to the `packages` configuration field. 2023-06-22T19:16:09,164 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,165 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,165 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,166 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,167 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,168 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-06-22T19:16:09,168 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-06-22T19:16:09,168 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,169 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,169 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,169 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,170 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,171 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,171 even if it does not contain any `.py` files. 2023-06-22T19:16:09,172 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,172 directory, all directories are treated like packages. 2023-06-22T19:16:09,172 ******************************************************************************** 2023-06-22T19:16:09,173 !! 2023-06-22T19:16:09,173 check.warn(importable) 2023-06-22T19:16:09,173 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-06-22T19:16:09,174 !! 2023-06-22T19:16:09,174 ******************************************************************************** 2023-06-22T19:16:09,175 ############################ 2023-06-22T19:16:09,175 # Package would be ignored # 2023-06-22T19:16:09,175 ############################ 2023-06-22T19:16:09,175 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-06-22T19:16:09,176 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,176 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,177 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-06-22T19:16:09,177 to the `packages` configuration field. 2023-06-22T19:16:09,177 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,178 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,178 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,179 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,179 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,180 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-06-22T19:16:09,180 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-06-22T19:16:09,180 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,181 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,181 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,182 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,182 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,183 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,183 even if it does not contain any `.py` files. 2023-06-22T19:16:09,184 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,184 directory, all directories are treated like packages. 2023-06-22T19:16:09,184 ******************************************************************************** 2023-06-22T19:16:09,185 !! 2023-06-22T19:16:09,185 check.warn(importable) 2023-06-22T19:16:09,185 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-06-22T19:16:09,186 !! 2023-06-22T19:16:09,186 ******************************************************************************** 2023-06-22T19:16:09,187 ############################ 2023-06-22T19:16:09,187 # Package would be ignored # 2023-06-22T19:16:09,187 ############################ 2023-06-22T19:16:09,187 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-06-22T19:16:09,188 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,188 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,189 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-06-22T19:16:09,189 to the `packages` configuration field. 2023-06-22T19:16:09,189 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,190 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,190 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,191 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,191 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,192 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-06-22T19:16:09,192 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-06-22T19:16:09,192 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,193 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,193 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,194 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,194 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,195 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,195 even if it does not contain any `.py` files. 2023-06-22T19:16:09,195 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,196 directory, all directories are treated like packages. 2023-06-22T19:16:09,196 ******************************************************************************** 2023-06-22T19:16:09,197 !! 2023-06-22T19:16:09,197 check.warn(importable) 2023-06-22T19:16:09,197 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-06-22T19:16:09,198 !! 2023-06-22T19:16:09,198 ******************************************************************************** 2023-06-22T19:16:09,199 ############################ 2023-06-22T19:16:09,199 # Package would be ignored # 2023-06-22T19:16:09,199 ############################ 2023-06-22T19:16:09,199 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-06-22T19:16:09,200 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,200 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,201 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-06-22T19:16:09,201 to the `packages` configuration field. 2023-06-22T19:16:09,201 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,202 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,202 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,203 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,203 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,204 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-06-22T19:16:09,204 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-06-22T19:16:09,204 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,205 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,205 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,205 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,206 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,207 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,207 even if it does not contain any `.py` files. 2023-06-22T19:16:09,207 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,208 directory, all directories are treated like packages. 2023-06-22T19:16:09,208 ******************************************************************************** 2023-06-22T19:16:09,209 !! 2023-06-22T19:16:09,209 check.warn(importable) 2023-06-22T19:16:09,209 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-06-22T19:16:09,209 !! 2023-06-22T19:16:09,210 ******************************************************************************** 2023-06-22T19:16:09,210 ############################ 2023-06-22T19:16:09,211 # Package would be ignored # 2023-06-22T19:16:09,211 ############################ 2023-06-22T19:16:09,211 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-06-22T19:16:09,212 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,212 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,212 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-06-22T19:16:09,213 to the `packages` configuration field. 2023-06-22T19:16:09,213 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,214 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,214 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,214 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,215 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,216 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-06-22T19:16:09,216 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-06-22T19:16:09,216 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,216 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,217 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,217 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,218 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,219 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,219 even if it does not contain any `.py` files. 2023-06-22T19:16:09,219 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,220 directory, all directories are treated like packages. 2023-06-22T19:16:09,220 ******************************************************************************** 2023-06-22T19:16:09,220 !! 2023-06-22T19:16:09,221 check.warn(importable) 2023-06-22T19:16:09,221 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-06-22T19:16:09,221 !! 2023-06-22T19:16:09,222 ******************************************************************************** 2023-06-22T19:16:09,222 ############################ 2023-06-22T19:16:09,223 # Package would be ignored # 2023-06-22T19:16:09,223 ############################ 2023-06-22T19:16:09,223 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-06-22T19:16:09,223 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,224 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,224 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-06-22T19:16:09,224 to the `packages` configuration field. 2023-06-22T19:16:09,225 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,225 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,226 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,226 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,227 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,228 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-06-22T19:16:09,228 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-06-22T19:16:09,229 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,229 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,230 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,230 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,231 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,233 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,233 even if it does not contain any `.py` files. 2023-06-22T19:16:09,234 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,234 directory, all directories are treated like packages. 2023-06-22T19:16:09,235 ******************************************************************************** 2023-06-22T19:16:09,235 !! 2023-06-22T19:16:09,236 check.warn(importable) 2023-06-22T19:16:09,236 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2023-06-22T19:16:09,237 !! 2023-06-22T19:16:09,238 ******************************************************************************** 2023-06-22T19:16:09,238 ############################ 2023-06-22T19:16:09,238 # Package would be ignored # 2023-06-22T19:16:09,239 ############################ 2023-06-22T19:16:09,239 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2023-06-22T19:16:09,240 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,240 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,241 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2023-06-22T19:16:09,242 to the `packages` configuration field. 2023-06-22T19:16:09,242 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,243 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,243 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,244 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,245 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,246 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2023-06-22T19:16:09,246 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2023-06-22T19:16:09,247 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,247 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,247 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,248 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,249 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,250 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,251 even if it does not contain any `.py` files. 2023-06-22T19:16:09,252 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,252 directory, all directories are treated like packages. 2023-06-22T19:16:09,253 ******************************************************************************** 2023-06-22T19:16:09,253 !! 2023-06-22T19:16:09,254 check.warn(importable) 2023-06-22T19:16:09,254 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-06-22T19:16:09,255 !! 2023-06-22T19:16:09,256 ******************************************************************************** 2023-06-22T19:16:09,256 ############################ 2023-06-22T19:16:09,257 # Package would be ignored # 2023-06-22T19:16:09,257 ############################ 2023-06-22T19:16:09,257 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-06-22T19:16:09,258 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,259 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,259 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-06-22T19:16:09,259 to the `packages` configuration field. 2023-06-22T19:16:09,260 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,261 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,261 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,262 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,263 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,264 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-06-22T19:16:09,264 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-06-22T19:16:09,265 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,265 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,266 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,266 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,267 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,268 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,269 even if it does not contain any `.py` files. 2023-06-22T19:16:09,269 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,270 directory, all directories are treated like packages. 2023-06-22T19:16:09,270 ******************************************************************************** 2023-06-22T19:16:09,271 !! 2023-06-22T19:16:09,271 check.warn(importable) 2023-06-22T19:16:09,272 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-06-22T19:16:09,272 !! 2023-06-22T19:16:09,273 ******************************************************************************** 2023-06-22T19:16:09,273 ############################ 2023-06-22T19:16:09,273 # Package would be ignored # 2023-06-22T19:16:09,274 ############################ 2023-06-22T19:16:09,274 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-06-22T19:16:09,275 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,275 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,276 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-06-22T19:16:09,276 to the `packages` configuration field. 2023-06-22T19:16:09,277 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,277 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,278 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,279 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,279 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,280 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-06-22T19:16:09,280 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-06-22T19:16:09,281 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,281 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,282 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,282 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,283 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,284 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,285 even if it does not contain any `.py` files. 2023-06-22T19:16:09,285 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,286 directory, all directories are treated like packages. 2023-06-22T19:16:09,286 ******************************************************************************** 2023-06-22T19:16:09,287 !! 2023-06-22T19:16:09,287 check.warn(importable) 2023-06-22T19:16:09,288 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-06-22T19:16:09,288 !! 2023-06-22T19:16:09,289 ******************************************************************************** 2023-06-22T19:16:09,289 ############################ 2023-06-22T19:16:09,289 # Package would be ignored # 2023-06-22T19:16:09,290 ############################ 2023-06-22T19:16:09,290 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-06-22T19:16:09,291 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,291 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,292 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-06-22T19:16:09,292 to the `packages` configuration field. 2023-06-22T19:16:09,293 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,293 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,294 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,294 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,295 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,296 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-06-22T19:16:09,297 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-06-22T19:16:09,297 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,297 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,298 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,299 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,299 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,301 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,301 even if it does not contain any `.py` files. 2023-06-22T19:16:09,301 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,302 directory, all directories are treated like packages. 2023-06-22T19:16:09,302 ******************************************************************************** 2023-06-22T19:16:09,303 !! 2023-06-22T19:16:09,303 check.warn(importable) 2023-06-22T19:16:09,304 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-06-22T19:16:09,304 !! 2023-06-22T19:16:09,305 ******************************************************************************** 2023-06-22T19:16:09,305 ############################ 2023-06-22T19:16:09,306 # Package would be ignored # 2023-06-22T19:16:09,306 ############################ 2023-06-22T19:16:09,306 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-06-22T19:16:09,307 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,308 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,308 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-06-22T19:16:09,309 to the `packages` configuration field. 2023-06-22T19:16:09,309 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,310 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,310 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,311 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,312 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,313 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-06-22T19:16:09,313 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-06-22T19:16:09,313 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,314 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,314 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,315 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,316 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,317 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,318 even if it does not contain any `.py` files. 2023-06-22T19:16:09,318 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,318 directory, all directories are treated like packages. 2023-06-22T19:16:09,319 ******************************************************************************** 2023-06-22T19:16:09,319 !! 2023-06-22T19:16:09,320 check.warn(importable) 2023-06-22T19:16:09,320 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-06-22T19:16:09,321 !! 2023-06-22T19:16:09,321 ******************************************************************************** 2023-06-22T19:16:09,322 ############################ 2023-06-22T19:16:09,322 # Package would be ignored # 2023-06-22T19:16:09,323 ############################ 2023-06-22T19:16:09,323 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-06-22T19:16:09,323 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,324 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,325 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-06-22T19:16:09,325 to the `packages` configuration field. 2023-06-22T19:16:09,326 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,326 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,327 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,327 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,328 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,329 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-06-22T19:16:09,329 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-06-22T19:16:09,330 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,330 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,331 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,331 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,332 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,333 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,334 even if it does not contain any `.py` files. 2023-06-22T19:16:09,334 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,334 directory, all directories are treated like packages. 2023-06-22T19:16:09,335 ******************************************************************************** 2023-06-22T19:16:09,335 !! 2023-06-22T19:16:09,336 check.warn(importable) 2023-06-22T19:16:09,336 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-06-22T19:16:09,337 !! 2023-06-22T19:16:09,337 ******************************************************************************** 2023-06-22T19:16:09,338 ############################ 2023-06-22T19:16:09,338 # Package would be ignored # 2023-06-22T19:16:09,338 ############################ 2023-06-22T19:16:09,339 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-06-22T19:16:09,339 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,340 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,340 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-06-22T19:16:09,341 to the `packages` configuration field. 2023-06-22T19:16:09,342 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,342 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,342 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,343 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,344 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,345 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-06-22T19:16:09,345 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-06-22T19:16:09,345 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,346 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,346 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,347 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,348 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,349 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,349 even if it does not contain any `.py` files. 2023-06-22T19:16:09,350 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,350 directory, all directories are treated like packages. 2023-06-22T19:16:09,350 ******************************************************************************** 2023-06-22T19:16:09,351 !! 2023-06-22T19:16:09,352 check.warn(importable) 2023-06-22T19:16:09,352 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-06-22T19:16:09,352 !! 2023-06-22T19:16:09,353 ******************************************************************************** 2023-06-22T19:16:09,354 ############################ 2023-06-22T19:16:09,354 # Package would be ignored # 2023-06-22T19:16:09,354 ############################ 2023-06-22T19:16:09,355 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-06-22T19:16:09,355 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,356 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,357 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-06-22T19:16:09,357 to the `packages` configuration field. 2023-06-22T19:16:09,358 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,358 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,358 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,359 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,360 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,361 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-06-22T19:16:09,361 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-06-22T19:16:09,361 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,362 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,362 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,363 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,364 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,365 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,365 even if it does not contain any `.py` files. 2023-06-22T19:16:09,365 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,366 directory, all directories are treated like packages. 2023-06-22T19:16:09,366 ******************************************************************************** 2023-06-22T19:16:09,367 !! 2023-06-22T19:16:09,368 check.warn(importable) 2023-06-22T19:16:09,368 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-06-22T19:16:09,368 !! 2023-06-22T19:16:09,369 ******************************************************************************** 2023-06-22T19:16:09,370 ############################ 2023-06-22T19:16:09,370 # Package would be ignored # 2023-06-22T19:16:09,370 ############################ 2023-06-22T19:16:09,371 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-06-22T19:16:09,371 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,372 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,372 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-06-22T19:16:09,373 to the `packages` configuration field. 2023-06-22T19:16:09,374 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,374 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,374 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,375 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,376 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,377 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-06-22T19:16:09,377 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-06-22T19:16:09,378 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,378 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,379 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,379 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,380 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,381 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,382 even if it does not contain any `.py` files. 2023-06-22T19:16:09,382 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,382 directory, all directories are treated like packages. 2023-06-22T19:16:09,383 ******************************************************************************** 2023-06-22T19:16:09,384 !! 2023-06-22T19:16:09,384 check.warn(importable) 2023-06-22T19:16:09,384 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-06-22T19:16:09,385 !! 2023-06-22T19:16:09,386 ******************************************************************************** 2023-06-22T19:16:09,386 ############################ 2023-06-22T19:16:09,386 # Package would be ignored # 2023-06-22T19:16:09,387 ############################ 2023-06-22T19:16:09,387 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-06-22T19:16:09,387 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,388 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,389 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-06-22T19:16:09,389 to the `packages` configuration field. 2023-06-22T19:16:09,390 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,390 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,391 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,392 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,392 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,393 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-06-22T19:16:09,394 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-06-22T19:16:09,394 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,394 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,395 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,395 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,396 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,398 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,398 even if it does not contain any `.py` files. 2023-06-22T19:16:09,398 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,399 directory, all directories are treated like packages. 2023-06-22T19:16:09,399 ******************************************************************************** 2023-06-22T19:16:09,400 !! 2023-06-22T19:16:09,400 check.warn(importable) 2023-06-22T19:16:09,401 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-06-22T19:16:09,401 !! 2023-06-22T19:16:09,402 ******************************************************************************** 2023-06-22T19:16:09,402 ############################ 2023-06-22T19:16:09,402 # Package would be ignored # 2023-06-22T19:16:09,403 ############################ 2023-06-22T19:16:09,403 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-06-22T19:16:09,404 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,405 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,405 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-06-22T19:16:09,405 to the `packages` configuration field. 2023-06-22T19:16:09,406 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,406 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,407 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,408 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,408 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,409 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-06-22T19:16:09,410 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-06-22T19:16:09,410 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,411 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,411 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,412 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,412 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,413 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,414 even if it does not contain any `.py` files. 2023-06-22T19:16:09,414 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,414 directory, all directories are treated like packages. 2023-06-22T19:16:09,415 ******************************************************************************** 2023-06-22T19:16:09,415 !! 2023-06-22T19:16:09,415 check.warn(importable) 2023-06-22T19:16:09,416 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-06-22T19:16:09,416 !! 2023-06-22T19:16:09,417 ******************************************************************************** 2023-06-22T19:16:09,417 ############################ 2023-06-22T19:16:09,417 # Package would be ignored # 2023-06-22T19:16:09,418 ############################ 2023-06-22T19:16:09,418 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-06-22T19:16:09,418 but it is absent from setuptools' `packages` configuration. 2023-06-22T19:16:09,419 This leads to an ambiguous overall configuration. If you want to distribute this 2023-06-22T19:16:09,420 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-06-22T19:16:09,420 to the `packages` configuration field. 2023-06-22T19:16:09,421 Alternatively, you can also rely on setuptools' discovery methods 2023-06-22T19:16:09,421 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-06-22T19:16:09,422 instead of `find_packages(...)`/`find:`). 2023-06-22T19:16:09,422 You can read more about "package discovery" on setuptools documentation page: 2023-06-22T19:16:09,423 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-06-22T19:16:09,423 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-06-22T19:16:09,424 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-06-22T19:16:09,425 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-06-22T19:16:09,425 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-06-22T19:16:09,425 combination with a more fine grained `package-data` configuration. 2023-06-22T19:16:09,426 You can read more about "package data files" on setuptools documentation page: 2023-06-22T19:16:09,427 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-06-22T19:16:09,428 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-06-22T19:16:09,428 even if it does not contain any `.py` files. 2023-06-22T19:16:09,428 On the other hand, currently there is no concept of package data 2023-06-22T19:16:09,429 directory, all directories are treated like packages. 2023-06-22T19:16:09,429 ******************************************************************************** 2023-06-22T19:16:09,430 !! 2023-06-22T19:16:09,430 check.warn(importable) 2023-06-22T19:16:09,430 creating build/lib/deepspeed/ops/csrc 2023-06-22T19:16:09,431 creating build/lib/deepspeed/ops/csrc/adagrad 2023-06-22T19:16:09,431 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-06-22T19:16:09,431 creating build/lib/deepspeed/ops/csrc/adam 2023-06-22T19:16:09,432 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-06-22T19:16:09,432 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-06-22T19:16:09,432 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-06-22T19:16:09,433 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-06-22T19:16:09,433 creating build/lib/deepspeed/ops/csrc/aio 2023-06-22T19:16:09,434 creating build/lib/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:09,434 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:09,434 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:09,435 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:09,435 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:09,435 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:09,436 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:09,436 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,436 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,437 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,437 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,437 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,438 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,439 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,439 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,439 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,440 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,440 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,440 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:09,441 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-06-22T19:16:09,441 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-06-22T19:16:09,441 creating build/lib/deepspeed/ops/csrc/common 2023-06-22T19:16:09,442 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-06-22T19:16:09,442 creating build/lib/deepspeed/ops/csrc/cpu 2023-06-22T19:16:09,442 creating build/lib/deepspeed/ops/csrc/cpu/comm 2023-06-22T19:16:09,443 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2023-06-22T19:16:09,443 creating build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,444 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,444 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,444 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,445 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,445 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,445 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,446 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,446 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,446 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,447 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,447 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,448 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,448 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,448 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,449 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,450 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,455 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,459 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,465 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,471 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,475 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,481 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,486 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,492 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,498 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,502 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,508 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-06-22T19:16:09,513 creating build/lib/deepspeed/ops/csrc/lamb 2023-06-22T19:16:09,515 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-06-22T19:16:09,520 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-06-22T19:16:09,526 creating build/lib/deepspeed/ops/csrc/quantization 2023-06-22T19:16:09,529 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-06-22T19:16:09,534 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-06-22T19:16:09,541 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-06-22T19:16:09,546 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-06-22T19:16:09,551 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-06-22T19:16:09,553 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-06-22T19:16:09,558 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-06-22T19:16:09,564 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-06-22T19:16:09,568 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-06-22T19:16:09,573 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-06-22T19:16:09,575 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-06-22T19:16:09,580 creating build/lib/deepspeed/ops/csrc/spatial 2023-06-22T19:16:09,580 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-06-22T19:16:09,583 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-06-22T19:16:09,588 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-06-22T19:16:09,592 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-06-22T19:16:09,594 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-06-22T19:16:09,598 creating build/lib/deepspeed/ops/csrc/transformer 2023-06-22T19:16:09,600 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-22T19:16:09,606 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-22T19:16:09,612 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-06-22T19:16:09,619 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-22T19:16:09,624 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-22T19:16:09,629 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-22T19:16:09,638 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-22T19:16:09,644 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-06-22T19:16:09,651 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-06-22T19:16:09,652 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,654 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,660 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,664 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,670 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,676 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,680 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,690 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,695 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,700 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,706 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:09,713 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-06-22T19:16:09,715 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-06-22T19:16:09,720 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-06-22T19:16:09,726 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-06-22T19:16:09,731 creating build/lib/deepspeed/ops/csrc/utils 2023-06-22T19:16:09,733 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-06-22T19:16:09,737 creating build/lib/deepspeed/autotuning/config_templates 2023-06-22T19:16:09,739 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-06-22T19:16:09,744 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-06-22T19:16:09,748 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-06-22T19:16:09,753 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-06-22T19:16:09,757 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-06-22T19:16:09,762 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-06-22T19:16:09,766 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-06-22T19:16:09,849 running build_scripts 2023-06-22T19:16:09,851 creating build/scripts-3.7 2023-06-22T19:16:09,853 copying and adjusting bin/deepspeed -> build/scripts-3.7 2023-06-22T19:16:09,857 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2023-06-22T19:16:09,860 copying and adjusting bin/ds -> build/scripts-3.7 2023-06-22T19:16:09,863 copying bin/ds_ssh -> build/scripts-3.7 2023-06-22T19:16:09,867 copying and adjusting bin/ds_report -> build/scripts-3.7 2023-06-22T19:16:09,870 copying and adjusting bin/ds_bench -> build/scripts-3.7 2023-06-22T19:16:09,873 copying and adjusting bin/dsr -> build/scripts-3.7 2023-06-22T19:16:09,876 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2023-06-22T19:16:09,879 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2023-06-22T19:16:09,880 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2023-06-22T19:16:09,880 changing mode of build/scripts-3.7/ds from 644 to 755 2023-06-22T19:16:09,881 changing mode of build/scripts-3.7/ds_report from 644 to 755 2023-06-22T19:16:09,882 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2023-06-22T19:16:09,883 changing mode of build/scripts-3.7/dsr from 644 to 755 2023-06-22T19:16:09,884 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2023-06-22T19:16:09,959 /home/piwheels/.local/lib/python3.7/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-06-22T19:16:09,960 !! 2023-06-22T19:16:09,961 ******************************************************************************** 2023-06-22T19:16:09,961 Please avoid running ``setup.py`` directly. 2023-06-22T19:16:09,961 Instead, use pypa/build, pypa/installer, pypa/build or 2023-06-22T19:16:09,962 other standards-based tools. 2023-06-22T19:16:09,962 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-06-22T19:16:09,963 ******************************************************************************** 2023-06-22T19:16:09,963 !! 2023-06-22T19:16:09,964 self.initialize_options() 2023-06-22T19:16:10,028 installing to build/bdist.linux-armv7l/wheel 2023-06-22T19:16:10,029 running install 2023-06-22T19:16:10,088 running install_lib 2023-06-22T19:16:10,160 creating build/bdist.linux-armv7l 2023-06-22T19:16:10,162 creating build/bdist.linux-armv7l/wheel 2023-06-22T19:16:10,166 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-06-22T19:16:10,168 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-06-22T19:16:10,174 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-06-22T19:16:10,175 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-06-22T19:16:10,181 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-22T19:16:10,183 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-22T19:16:10,187 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-22T19:16:10,192 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-22T19:16:10,196 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-22T19:16:10,200 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-22T19:16:10,204 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-06-22T19:16:10,207 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-06-22T19:16:10,212 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-22T19:16:10,213 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-22T19:16:10,218 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-22T19:16:10,222 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-22T19:16:10,226 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-22T19:16:10,230 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-22T19:16:10,234 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-06-22T19:16:10,239 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-22T19:16:10,240 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-22T19:16:10,246 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-22T19:16:10,250 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-22T19:16:10,255 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-22T19:16:10,259 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-06-22T19:16:10,265 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-06-22T19:16:10,268 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-06-22T19:16:10,272 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,276 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,278 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,283 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,287 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,291 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,295 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,300 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,304 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,308 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,313 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,317 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-06-22T19:16:10,321 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,326 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,331 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,335 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,340 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,345 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,350 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,354 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,358 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,363 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-06-22T19:16:10,368 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-06-22T19:16:10,372 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-06-22T19:16:10,379 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-22T19:16:10,381 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-22T19:16:10,386 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-22T19:16:10,392 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-22T19:16:10,397 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-22T19:16:10,402 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-22T19:16:10,407 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-22T19:16:10,411 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-06-22T19:16:10,419 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-06-22T19:16:10,420 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-06-22T19:16:10,425 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-06-22T19:16:10,429 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-06-22T19:16:10,432 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-06-22T19:16:10,437 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-06-22T19:16:10,439 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-06-22T19:16:10,443 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-06-22T19:16:10,448 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-06-22T19:16:10,451 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-06-22T19:16:10,455 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-06-22T19:16:10,460 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-06-22T19:16:10,462 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-06-22T19:16:10,467 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-06-22T19:16:10,468 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-06-22T19:16:10,472 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-06-22T19:16:10,476 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-06-22T19:16:10,481 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-06-22T19:16:10,484 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-06-22T19:16:10,486 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-06-22T19:16:10,493 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-06-22T19:16:10,496 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-06-22T19:16:10,501 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-06-22T19:16:10,506 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-22T19:16:10,508 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-22T19:16:10,512 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-22T19:16:10,519 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-22T19:16:10,526 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-06-22T19:16:10,528 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-06-22T19:16:10,530 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-06-22T19:16:10,535 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-06-22T19:16:10,540 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-06-22T19:16:10,545 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,547 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,553 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,559 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,562 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,568 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,571 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,576 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,580 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,584 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,590 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-06-22T19:16:10,599 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-22T19:16:10,604 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-22T19:16:10,613 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-22T19:16:10,618 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-22T19:16:10,623 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-06-22T19:16:10,630 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-06-22T19:16:10,631 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-06-22T19:16:10,637 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-06-22T19:16:10,639 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-06-22T19:16:10,641 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-06-22T19:16:10,646 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-06-22T19:16:10,647 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-06-22T19:16:10,652 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-06-22T19:16:10,658 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,659 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,665 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,669 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,675 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,679 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,683 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,687 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,691 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,696 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,699 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,703 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,707 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,711 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,714 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,719 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,723 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,727 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,730 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,734 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,737 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,742 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,746 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,751 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,755 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,759 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,763 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,767 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-06-22T19:16:10,772 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-06-22T19:16:10,774 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-06-22T19:16:10,779 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-06-22T19:16:10,782 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-06-22T19:16:10,784 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-06-22T19:16:10,789 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:10,791 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:10,795 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:10,798 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:10,802 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:10,805 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:10,810 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-06-22T19:16:10,816 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,817 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,821 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,825 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,829 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,832 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,836 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,840 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,844 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,847 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,852 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,856 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-06-22T19:16:10,860 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-06-22T19:16:10,862 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-06-22T19:16:10,867 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-06-22T19:16:10,872 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-06-22T19:16:10,874 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-06-22T19:16:10,878 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-06-22T19:16:10,880 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-06-22T19:16:10,885 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2023-06-22T19:16:10,887 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-06-22T19:16:10,889 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-06-22T19:16:10,895 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-06-22T19:16:10,897 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-06-22T19:16:10,902 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-06-22T19:16:10,906 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-06-22T19:16:10,910 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-06-22T19:16:10,915 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-06-22T19:16:10,917 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-06-22T19:16:10,922 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-06-22T19:16:10,926 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-06-22T19:16:10,931 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-06-22T19:16:10,937 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,938 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,943 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,946 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,950 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,954 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,957 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,961 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,965 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,969 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,973 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,976 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:10,981 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-06-22T19:16:10,982 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-06-22T19:16:10,986 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-06-22T19:16:10,990 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-06-22T19:16:10,994 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-06-22T19:16:10,997 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:11,001 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:11,006 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:11,010 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-06-22T19:16:11,015 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-06-22T19:16:11,016 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-06-22T19:16:11,021 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-06-22T19:16:11,025 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-06-22T19:16:11,029 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-06-22T19:16:11,034 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-06-22T19:16:11,036 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-06-22T19:16:11,040 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-06-22T19:16:11,045 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-22T19:16:11,047 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-22T19:16:11,053 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-22T19:16:11,057 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-22T19:16:11,060 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-22T19:16:11,064 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-22T19:16:11,067 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-22T19:16:11,071 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-22T19:16:11,074 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-22T19:16:11,078 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-06-22T19:16:11,083 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,084 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,091 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,095 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,099 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-22T19:16:11,101 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-22T19:16:11,106 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-22T19:16:11,111 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-22T19:16:11,115 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-22T19:16:11,120 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-22T19:16:11,123 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-06-22T19:16:11,130 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,133 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,137 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,144 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-22T19:16:11,146 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-22T19:16:11,151 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-22T19:16:11,154 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-22T19:16:11,158 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-22T19:16:11,162 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-22T19:16:11,166 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-22T19:16:11,173 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-22T19:16:11,178 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-22T19:16:11,182 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-06-22T19:16:11,187 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-06-22T19:16:11,189 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-06-22T19:16:11,193 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-06-22T19:16:11,197 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-06-22T19:16:11,202 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-06-22T19:16:11,205 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,210 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,215 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,221 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-06-22T19:16:11,223 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-06-22T19:16:11,226 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-06-22T19:16:11,230 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-06-22T19:16:11,237 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-06-22T19:16:11,238 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-06-22T19:16:11,242 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-06-22T19:16:11,246 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,252 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-06-22T19:16:11,253 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-06-22T19:16:11,258 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-06-22T19:16:11,261 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-06-22T19:16:11,265 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-06-22T19:16:11,270 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,272 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,276 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,280 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,290 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,295 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,299 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,304 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,309 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,313 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,317 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,320 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,328 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,332 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,337 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,341 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-06-22T19:16:11,352 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,358 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,364 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-06-22T19:16:11,365 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-06-22T19:16:11,371 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:11,373 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:11,378 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:11,383 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:11,388 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:11,392 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-06-22T19:16:11,395 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-06-22T19:16:11,401 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:11,403 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:11,407 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:11,411 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:11,415 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:11,419 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-06-22T19:16:11,423 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-06-22T19:16:11,428 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-06-22T19:16:11,432 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,438 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,442 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,454 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-06-22T19:16:11,461 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-06-22T19:16:11,462 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-06-22T19:16:11,468 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-06-22T19:16:11,475 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-06-22T19:16:11,476 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-06-22T19:16:11,482 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-06-22T19:16:11,488 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-06-22T19:16:11,493 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-06-22T19:16:11,498 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-06-22T19:16:11,503 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-06-22T19:16:11,507 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-06-22T19:16:11,513 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-06-22T19:16:11,515 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-06-22T19:16:11,520 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-06-22T19:16:11,524 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-06-22T19:16:11,529 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-06-22T19:16:11,531 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-06-22T19:16:11,537 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-06-22T19:16:11,541 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-06-22T19:16:11,548 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-06-22T19:16:11,550 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-06-22T19:16:11,553 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-06-22T19:16:11,556 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-06-22T19:16:11,561 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-06-22T19:16:11,562 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-06-22T19:16:11,566 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-06-22T19:16:11,570 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-06-22T19:16:11,574 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-06-22T19:16:11,578 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-22T19:16:11,580 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-22T19:16:11,583 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-22T19:16:11,587 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-22T19:16:11,591 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-22T19:16:11,594 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-22T19:16:11,598 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-22T19:16:11,601 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-22T19:16:11,605 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-22T19:16:11,608 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-06-22T19:16:11,614 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-22T19:16:11,616 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-22T19:16:11,622 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-22T19:16:11,626 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-22T19:16:11,630 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-22T19:16:11,636 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-22T19:16:11,640 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-22T19:16:11,645 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-22T19:16:11,648 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-06-22T19:16:11,655 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,657 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,661 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,666 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,670 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,673 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,679 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,683 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,686 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,690 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,694 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,697 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,701 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,706 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,710 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-06-22T19:16:11,714 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,716 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,724 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,725 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,729 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,734 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,737 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,740 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,744 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,748 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,752 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,756 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,760 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,764 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,767 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,773 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-22T19:16:11,775 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-22T19:16:11,778 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-22T19:16:11,782 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-22T19:16:11,786 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-22T19:16:11,790 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-22T19:16:11,794 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-22T19:16:11,797 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-06-22T19:16:11,801 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,805 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,808 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,812 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,816 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-06-22T19:16:11,819 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,823 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,827 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,830 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,835 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,839 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,843 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,847 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,851 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-06-22T19:16:11,857 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-22T19:16:11,858 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-22T19:16:11,863 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-22T19:16:11,868 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-22T19:16:11,872 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-22T19:16:11,876 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-22T19:16:11,880 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-06-22T19:16:11,884 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-06-22T19:16:11,886 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-06-22T19:16:11,891 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-06-22T19:16:11,893 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-06-22T19:16:11,901 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-06-22T19:16:11,905 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-06-22T19:16:11,909 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-06-22T19:16:11,915 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-22T19:16:11,917 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-22T19:16:11,922 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-22T19:16:11,927 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-22T19:16:11,931 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-22T19:16:11,936 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-22T19:16:11,940 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-22T19:16:11,944 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-06-22T19:16:11,949 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-06-22T19:16:11,955 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-22T19:16:11,957 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-22T19:16:11,963 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-22T19:16:11,972 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-22T19:16:11,974 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-22T19:16:11,979 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-22T19:16:11,983 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-22T19:16:11,987 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-22T19:16:11,990 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-22T19:16:11,994 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-06-22T19:16:11,998 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-22T19:16:12,003 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-22T19:16:12,007 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-22T19:16:12,012 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-06-22T19:16:12,017 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-06-22T19:16:12,019 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-06-22T19:16:12,023 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-06-22T19:16:12,026 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-06-22T19:16:12,030 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-06-22T19:16:12,034 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-06-22T19:16:12,040 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-22T19:16:12,042 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-22T19:16:12,047 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-22T19:16:12,051 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-22T19:16:12,055 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-22T19:16:12,058 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-22T19:16:12,063 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-22T19:16:12,067 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-22T19:16:12,071 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-22T19:16:12,075 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-06-22T19:16:12,079 running install_egg_info 2023-06-22T19:16:12,162 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.9.5-py3.7.egg-info 2023-06-22T19:16:12,191 running install_scripts 2023-06-22T19:16:12,194 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data 2023-06-22T19:16:12,195 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts 2023-06-22T19:16:12,198 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts 2023-06-22T19:16:12,202 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts 2023-06-22T19:16:12,206 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts 2023-06-22T19:16:12,209 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts 2023-06-22T19:16:12,213 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts 2023-06-22T19:16:12,217 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts 2023-06-22T19:16:12,221 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts 2023-06-22T19:16:12,224 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts 2023-06-22T19:16:12,227 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts/deepspeed to 755 2023-06-22T19:16:12,228 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts/ds_ssh to 755 2023-06-22T19:16:12,229 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts/ds_bench to 755 2023-06-22T19:16:12,230 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts/ds_elastic to 755 2023-06-22T19:16:12,230 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts/dsr to 755 2023-06-22T19:16:12,231 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts/deepspeed.pt to 755 2023-06-22T19:16:12,232 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts/ds_report to 755 2023-06-22T19:16:12,233 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.data/scripts/ds to 755 2023-06-22T19:16:12,354 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.5.dist-info/WHEEL 2023-06-22T19:16:12,359 creating '/tmp/pip-wheel-pz1cjyxo/deepspeed-0.9.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-06-22T19:16:12,367 adding 'deepspeed/__init__.py' 2023-06-22T19:16:12,370 adding 'deepspeed/constants.py' 2023-06-22T19:16:12,374 adding 'deepspeed/env_report.py' 2023-06-22T19:16:12,377 adding 'deepspeed/git_version_info.py' 2023-06-22T19:16:12,379 adding 'deepspeed/git_version_info_installed.py' 2023-06-22T19:16:12,383 adding 'deepspeed/accelerator/__init__.py' 2023-06-22T19:16:12,386 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-06-22T19:16:12,389 adding 'deepspeed/accelerator/cpu_accelerator.py' 2023-06-22T19:16:12,394 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-06-22T19:16:12,397 adding 'deepspeed/accelerator/npu_accelerator.py' 2023-06-22T19:16:12,401 adding 'deepspeed/accelerator/real_accelerator.py' 2023-06-22T19:16:12,405 adding 'deepspeed/autotuning/__init__.py' 2023-06-22T19:16:12,417 adding 'deepspeed/autotuning/autotuner.py' 2023-06-22T19:16:12,422 adding 'deepspeed/autotuning/config.py' 2023-06-22T19:16:12,425 adding 'deepspeed/autotuning/constants.py' 2023-06-22T19:16:12,430 adding 'deepspeed/autotuning/scheduler.py' 2023-06-22T19:16:12,436 adding 'deepspeed/autotuning/utils.py' 2023-06-22T19:16:12,440 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-06-22T19:16:12,442 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-06-22T19:16:12,445 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-06-22T19:16:12,447 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-06-22T19:16:12,451 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-06-22T19:16:12,454 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-06-22T19:16:12,457 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-06-22T19:16:12,460 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-06-22T19:16:12,463 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-06-22T19:16:12,466 adding 'deepspeed/autotuning/tuner/utils.py' 2023-06-22T19:16:12,470 adding 'deepspeed/checkpoint/__init__.py' 2023-06-22T19:16:12,473 adding 'deepspeed/checkpoint/constants.py' 2023-06-22T19:16:12,477 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-06-22T19:16:12,480 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-06-22T19:16:12,484 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-06-22T19:16:12,487 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-06-22T19:16:12,491 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-06-22T19:16:12,494 adding 'deepspeed/checkpoint/utils.py' 2023-06-22T19:16:12,497 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-06-22T19:16:12,501 adding 'deepspeed/comm/__init__.py' 2023-06-22T19:16:12,504 adding 'deepspeed/comm/backend.py' 2023-06-22T19:16:12,507 adding 'deepspeed/comm/ccl.py' 2023-06-22T19:16:12,514 adding 'deepspeed/comm/comm.py' 2023-06-22T19:16:12,517 adding 'deepspeed/comm/config.py' 2023-06-22T19:16:12,520 adding 'deepspeed/comm/constants.py' 2023-06-22T19:16:12,523 adding 'deepspeed/comm/reduce_op.py' 2023-06-22T19:16:12,527 adding 'deepspeed/comm/torch.py' 2023-06-22T19:16:12,530 adding 'deepspeed/comm/utils.py' 2023-06-22T19:16:12,534 adding 'deepspeed/compression/__init__.py' 2023-06-22T19:16:12,541 adding 'deepspeed/compression/basic_layer.py' 2023-06-22T19:16:12,546 adding 'deepspeed/compression/compress.py' 2023-06-22T19:16:12,551 adding 'deepspeed/compression/config.py' 2023-06-22T19:16:12,555 adding 'deepspeed/compression/constants.py' 2023-06-22T19:16:12,559 adding 'deepspeed/compression/helper.py' 2023-06-22T19:16:12,563 adding 'deepspeed/compression/scheduler.py' 2023-06-22T19:16:12,567 adding 'deepspeed/compression/utils.py' 2023-06-22T19:16:12,571 adding 'deepspeed/elasticity/__init__.py' 2023-06-22T19:16:12,574 adding 'deepspeed/elasticity/config.py' 2023-06-22T19:16:12,577 adding 'deepspeed/elasticity/constants.py' 2023-06-22T19:16:12,580 adding 'deepspeed/elasticity/elastic_agent.py' 2023-06-22T19:16:12,586 adding 'deepspeed/elasticity/elasticity.py' 2023-06-22T19:16:12,589 adding 'deepspeed/elasticity/utils.py' 2023-06-22T19:16:12,593 adding 'deepspeed/inference/__init__.py' 2023-06-22T19:16:12,597 adding 'deepspeed/inference/config.py' 2023-06-22T19:16:12,606 adding 'deepspeed/inference/engine.py' 2023-06-22T19:16:12,610 adding 'deepspeed/launcher/__init__.py' 2023-06-22T19:16:12,613 adding 'deepspeed/launcher/constants.py' 2023-06-22T19:16:12,617 adding 'deepspeed/launcher/launch.py' 2023-06-22T19:16:12,622 adding 'deepspeed/launcher/multinode_runner.py' 2023-06-22T19:16:12,629 adding 'deepspeed/launcher/runner.py' 2023-06-22T19:16:12,633 adding 'deepspeed/model_implementations/__init__.py' 2023-06-22T19:16:12,637 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-06-22T19:16:12,639 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-06-22T19:16:12,643 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-06-22T19:16:12,646 adding 'deepspeed/model_implementations/features/__init__.py' 2023-06-22T19:16:12,649 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-06-22T19:16:12,653 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-06-22T19:16:12,656 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-06-22T19:16:12,658 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-06-22T19:16:12,661 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-06-22T19:16:12,663 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-06-22T19:16:12,666 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-06-22T19:16:12,668 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-06-22T19:16:12,671 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-06-22T19:16:12,674 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-06-22T19:16:12,678 adding 'deepspeed/module_inject/__init__.py' 2023-06-22T19:16:12,682 adding 'deepspeed/module_inject/auto_tp.py' 2023-06-22T19:16:12,685 adding 'deepspeed/module_inject/inject.py' 2023-06-22T19:16:12,688 adding 'deepspeed/module_inject/layers.py' 2023-06-22T19:16:12,692 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-06-22T19:16:12,695 adding 'deepspeed/module_inject/module_quantize.py' 2023-06-22T19:16:12,699 adding 'deepspeed/module_inject/policy.py' 2023-06-22T19:16:12,710 adding 'deepspeed/module_inject/replace_module.py' 2023-06-22T19:16:12,713 adding 'deepspeed/module_inject/replace_policy.py' 2023-06-22T19:16:12,716 adding 'deepspeed/module_inject/utils.py' 2023-06-22T19:16:12,720 adding 'deepspeed/module_inject/containers/__init__.py' 2023-06-22T19:16:12,725 adding 'deepspeed/module_inject/containers/base.py' 2023-06-22T19:16:12,728 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-06-22T19:16:12,731 adding 'deepspeed/module_inject/containers/bert.py' 2023-06-22T19:16:12,734 adding 'deepspeed/module_inject/containers/bloom.py' 2023-06-22T19:16:12,737 adding 'deepspeed/module_inject/containers/clip.py' 2023-06-22T19:16:12,740 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-06-22T19:16:12,743 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-06-22T19:16:12,746 adding 'deepspeed/module_inject/containers/gptj.py' 2023-06-22T19:16:12,749 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-06-22T19:16:12,752 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-06-22T19:16:12,755 adding 'deepspeed/module_inject/containers/llama.py' 2023-06-22T19:16:12,758 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-06-22T19:16:12,761 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-06-22T19:16:12,764 adding 'deepspeed/module_inject/containers/opt.py' 2023-06-22T19:16:12,767 adding 'deepspeed/module_inject/containers/unet.py' 2023-06-22T19:16:12,770 adding 'deepspeed/module_inject/containers/vae.py' 2023-06-22T19:16:12,773 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-06-22T19:16:12,776 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2023-06-22T19:16:12,780 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2023-06-22T19:16:12,783 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2023-06-22T19:16:12,786 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-06-22T19:16:12,789 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-06-22T19:16:12,792 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2023-06-22T19:16:12,796 adding 'deepspeed/moe/__init__.py' 2023-06-22T19:16:12,799 adding 'deepspeed/moe/experts.py' 2023-06-22T19:16:12,802 adding 'deepspeed/moe/layer.py' 2023-06-22T19:16:12,805 adding 'deepspeed/moe/mappings.py' 2023-06-22T19:16:12,811 adding 'deepspeed/moe/sharded_moe.py' 2023-06-22T19:16:12,815 adding 'deepspeed/moe/utils.py' 2023-06-22T19:16:12,819 adding 'deepspeed/monitor/__init__.py' 2023-06-22T19:16:12,822 adding 'deepspeed/monitor/config.py' 2023-06-22T19:16:12,824 adding 'deepspeed/monitor/csv_monitor.py' 2023-06-22T19:16:12,827 adding 'deepspeed/monitor/monitor.py' 2023-06-22T19:16:12,830 adding 'deepspeed/monitor/tensorboard.py' 2023-06-22T19:16:12,832 adding 'deepspeed/monitor/utils.py' 2023-06-22T19:16:12,835 adding 'deepspeed/monitor/wandb.py' 2023-06-22T19:16:12,838 adding 'deepspeed/nebula/__init__.py' 2023-06-22T19:16:12,841 adding 'deepspeed/nebula/config.py' 2023-06-22T19:16:12,844 adding 'deepspeed/nebula/constants.py' 2023-06-22T19:16:12,847 adding 'deepspeed/ops/__init__.py' 2023-06-22T19:16:12,851 adding 'deepspeed/ops/adagrad/__init__.py' 2023-06-22T19:16:12,855 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-06-22T19:16:12,858 adding 'deepspeed/ops/adam/__init__.py' 2023-06-22T19:16:12,862 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-06-22T19:16:12,866 adding 'deepspeed/ops/adam/fused_adam.py' 2023-06-22T19:16:12,868 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-06-22T19:16:12,872 adding 'deepspeed/ops/aio/__init__.py' 2023-06-22T19:16:12,878 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-06-22T19:16:12,883 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-06-22T19:16:12,886 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-06-22T19:16:12,889 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-06-22T19:16:12,892 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-06-22T19:16:12,899 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-06-22T19:16:12,903 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-06-22T19:16:12,905 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-06-22T19:16:12,908 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-06-22T19:16:12,911 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-06-22T19:16:12,914 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-06-22T19:16:12,919 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-06-22T19:16:12,922 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-06-22T19:16:12,924 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-06-22T19:16:12,927 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-06-22T19:16:12,930 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-06-22T19:16:12,932 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-06-22T19:16:12,936 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-06-22T19:16:12,939 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-06-22T19:16:12,943 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-06-22T19:16:12,945 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-06-22T19:16:12,948 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-06-22T19:16:12,952 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-06-22T19:16:12,955 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-06-22T19:16:12,961 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2023-06-22T19:16:12,966 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-06-22T19:16:12,968 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-06-22T19:16:12,971 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-06-22T19:16:12,974 adding 'deepspeed/ops/csrc/includes/context.h' 2023-06-22T19:16:12,978 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-06-22T19:16:12,982 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-06-22T19:16:12,986 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-06-22T19:16:12,989 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-06-22T19:16:12,993 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-06-22T19:16:12,996 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-06-22T19:16:12,999 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-06-22T19:16:13,002 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-06-22T19:16:13,005 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-06-22T19:16:13,008 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-06-22T19:16:13,011 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-06-22T19:16:13,014 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-06-22T19:16:13,017 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-06-22T19:16:13,023 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-06-22T19:16:13,027 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-06-22T19:16:13,029 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-06-22T19:16:13,034 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-06-22T19:16:13,037 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-06-22T19:16:13,042 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-06-22T19:16:13,045 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-06-22T19:16:13,048 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-06-22T19:16:13,051 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-06-22T19:16:13,054 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-06-22T19:16:13,058 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-06-22T19:16:13,063 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-06-22T19:16:13,068 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-06-22T19:16:13,074 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-06-22T19:16:13,078 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-06-22T19:16:13,082 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-06-22T19:16:13,086 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-06-22T19:16:13,090 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-06-22T19:16:13,093 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-06-22T19:16:13,097 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-06-22T19:16:13,101 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-06-22T19:16:13,107 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-06-22T19:16:13,110 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-06-22T19:16:13,114 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-06-22T19:16:13,119 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-06-22T19:16:13,125 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-06-22T19:16:13,134 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-06-22T19:16:13,139 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-06-22T19:16:13,143 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-06-22T19:16:13,154 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-06-22T19:16:13,161 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-06-22T19:16:13,168 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-06-22T19:16:13,174 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-06-22T19:16:13,177 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-06-22T19:16:13,184 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-06-22T19:16:13,189 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-06-22T19:16:13,192 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2023-06-22T19:16:13,206 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-06-22T19:16:13,210 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-06-22T19:16:13,215 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2023-06-22T19:16:13,221 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-06-22T19:16:13,227 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-06-22T19:16:13,233 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-06-22T19:16:13,237 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-06-22T19:16:13,240 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-06-22T19:16:13,244 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-06-22T19:16:13,248 adding 'deepspeed/ops/lamb/__init__.py' 2023-06-22T19:16:13,251 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-06-22T19:16:13,256 adding 'deepspeed/ops/op_builder/__init__.py' 2023-06-22T19:16:13,258 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-06-22T19:16:13,262 adding 'deepspeed/ops/op_builder/async_io.py' 2023-06-22T19:16:13,270 adding 'deepspeed/ops/op_builder/builder.py' 2023-06-22T19:16:13,273 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-06-22T19:16:13,276 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-06-22T19:16:13,278 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-06-22T19:16:13,281 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-06-22T19:16:13,283 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-06-22T19:16:13,286 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-06-22T19:16:13,289 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-06-22T19:16:13,292 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-06-22T19:16:13,294 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-06-22T19:16:13,297 adding 'deepspeed/ops/op_builder/transformer.py' 2023-06-22T19:16:13,300 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-06-22T19:16:13,303 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2023-06-22T19:16:13,306 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2023-06-22T19:16:13,309 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2023-06-22T19:16:13,311 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2023-06-22T19:16:13,314 adding 'deepspeed/ops/quantizer/__init__.py' 2023-06-22T19:16:13,317 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-06-22T19:16:13,320 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-06-22T19:16:13,323 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-06-22T19:16:13,327 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-06-22T19:16:13,330 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-06-22T19:16:13,339 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-06-22T19:16:13,344 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-06-22T19:16:13,349 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-06-22T19:16:13,353 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-06-22T19:16:13,360 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-06-22T19:16:13,365 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-06-22T19:16:13,369 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-06-22T19:16:13,372 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-06-22T19:16:13,375 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-06-22T19:16:13,378 adding 'deepspeed/ops/transformer/__init__.py' 2023-06-22T19:16:13,384 adding 'deepspeed/ops/transformer/transformer.py' 2023-06-22T19:16:13,388 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-06-22T19:16:13,391 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-06-22T19:16:13,394 adding 'deepspeed/ops/transformer/inference/config.py' 2023-06-22T19:16:13,397 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-06-22T19:16:13,401 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-06-22T19:16:13,404 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-06-22T19:16:13,409 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-06-22T19:16:13,413 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-06-22T19:16:13,418 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-06-22T19:16:13,422 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-06-22T19:16:13,426 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-06-22T19:16:13,428 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-06-22T19:16:13,431 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-06-22T19:16:13,434 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-06-22T19:16:13,437 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-06-22T19:16:13,440 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-06-22T19:16:13,443 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-06-22T19:16:13,445 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-06-22T19:16:13,448 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-06-22T19:16:13,451 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-06-22T19:16:13,455 adding 'deepspeed/pipe/__init__.py' 2023-06-22T19:16:13,458 adding 'deepspeed/profiling/__init__.py' 2023-06-22T19:16:13,461 adding 'deepspeed/profiling/config.py' 2023-06-22T19:16:13,464 adding 'deepspeed/profiling/constants.py' 2023-06-22T19:16:13,467 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-06-22T19:16:13,480 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-06-22T19:16:13,486 adding 'deepspeed/runtime/__init__.py' 2023-06-22T19:16:13,491 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-06-22T19:16:13,501 adding 'deepspeed/runtime/config.py' 2023-06-22T19:16:13,506 adding 'deepspeed/runtime/config_utils.py' 2023-06-22T19:16:13,510 adding 'deepspeed/runtime/constants.py' 2023-06-22T19:16:13,514 adding 'deepspeed/runtime/dataloader.py' 2023-06-22T19:16:13,517 adding 'deepspeed/runtime/eigenvalue.py' 2023-06-22T19:16:13,558 adding 'deepspeed/runtime/engine.py' 2023-06-22T19:16:13,567 adding 'deepspeed/runtime/hybrid_engine.py' 2023-06-22T19:16:13,576 adding 'deepspeed/runtime/lr_schedules.py' 2023-06-22T19:16:13,580 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-06-22T19:16:13,584 adding 'deepspeed/runtime/quantize.py' 2023-06-22T19:16:13,587 adding 'deepspeed/runtime/sparse_tensor.py' 2023-06-22T19:16:13,592 adding 'deepspeed/runtime/state_dict_factory.py' 2023-06-22T19:16:13,602 adding 'deepspeed/runtime/utils.py' 2023-06-22T19:16:13,606 adding 'deepspeed/runtime/weight_quantizer.py' 2023-06-22T19:16:13,610 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-06-22T19:16:13,619 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-06-22T19:16:13,623 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-06-22T19:16:13,626 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-06-22T19:16:13,629 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-06-22T19:16:13,632 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-06-22T19:16:13,635 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-06-22T19:16:13,639 adding 'deepspeed/runtime/comm/__init__.py' 2023-06-22T19:16:13,642 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-06-22T19:16:13,646 adding 'deepspeed/runtime/comm/mpi.py' 2023-06-22T19:16:13,649 adding 'deepspeed/runtime/comm/nccl.py' 2023-06-22T19:16:13,653 adding 'deepspeed/runtime/compression/__init__.py' 2023-06-22T19:16:13,656 adding 'deepspeed/runtime/compression/cupy.py' 2023-06-22T19:16:13,660 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-06-22T19:16:13,663 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-06-22T19:16:13,666 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-06-22T19:16:13,670 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-06-22T19:16:13,674 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-06-22T19:16:13,677 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-06-22T19:16:13,680 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-06-22T19:16:13,683 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-06-22T19:16:13,686 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-06-22T19:16:13,689 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-06-22T19:16:13,696 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-06-22T19:16:13,701 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-06-22T19:16:13,708 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-06-22T19:16:13,711 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-06-22T19:16:13,715 adding 'deepspeed/runtime/fp16/__init__.py' 2023-06-22T19:16:13,721 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-06-22T19:16:13,726 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-06-22T19:16:13,732 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-06-22T19:16:13,736 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-06-22T19:16:13,741 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-06-22T19:16:13,748 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-06-22T19:16:13,754 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-06-22T19:16:13,758 adding 'deepspeed/runtime/pipe/__init__.py' 2023-06-22T19:16:13,773 adding 'deepspeed/runtime/pipe/engine.py' 2023-06-22T19:16:13,783 adding 'deepspeed/runtime/pipe/module.py' 2023-06-22T19:16:13,787 adding 'deepspeed/runtime/pipe/p2p.py' 2023-06-22T19:16:13,792 adding 'deepspeed/runtime/pipe/schedule.py' 2023-06-22T19:16:13,798 adding 'deepspeed/runtime/pipe/topology.py' 2023-06-22T19:16:13,802 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-06-22T19:16:13,805 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-06-22T19:16:13,808 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-06-22T19:16:13,811 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-06-22T19:16:13,816 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-06-22T19:16:13,820 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-06-22T19:16:13,826 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-06-22T19:16:13,831 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-06-22T19:16:13,834 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-06-22T19:16:13,839 adding 'deepspeed/runtime/zero/__init__.py' 2023-06-22T19:16:13,843 adding 'deepspeed/runtime/zero/config.py' 2023-06-22T19:16:13,847 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-06-22T19:16:13,851 adding 'deepspeed/runtime/zero/linear.py' 2023-06-22T19:16:13,858 adding 'deepspeed/runtime/zero/mics.py' 2023-06-22T19:16:13,862 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-06-22T19:16:13,865 adding 'deepspeed/runtime/zero/offload_config.py' 2023-06-22T19:16:13,872 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-06-22T19:16:13,894 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-06-22T19:16:13,903 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-06-22T19:16:13,936 adding 'deepspeed/runtime/zero/stage3.py' 2023-06-22T19:16:13,970 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-06-22T19:16:13,975 adding 'deepspeed/runtime/zero/test.py' 2023-06-22T19:16:13,980 adding 'deepspeed/runtime/zero/tiling.py' 2023-06-22T19:16:13,983 adding 'deepspeed/runtime/zero/utils.py' 2023-06-22T19:16:13,988 adding 'deepspeed/utils/__init__.py' 2023-06-22T19:16:13,991 adding 'deepspeed/utils/comms_logging.py' 2023-06-22T19:16:13,995 adding 'deepspeed/utils/debug.py' 2023-06-22T19:16:13,997 adding 'deepspeed/utils/exceptions.py' 2023-06-22T19:16:14,002 adding 'deepspeed/utils/groups.py' 2023-06-22T19:16:14,006 adding 'deepspeed/utils/init_on_device.py' 2023-06-22T19:16:14,009 adding 'deepspeed/utils/logging.py' 2023-06-22T19:16:14,012 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-06-22T19:16:14,015 adding 'deepspeed/utils/numa.py' 2023-06-22T19:16:14,018 adding 'deepspeed/utils/nvtx.py' 2023-06-22T19:16:14,022 adding 'deepspeed/utils/tensor_fragment.py' 2023-06-22T19:16:14,026 adding 'deepspeed/utils/timer.py' 2023-06-22T19:16:14,028 adding 'deepspeed/utils/types.py' 2023-06-22T19:16:14,035 adding 'deepspeed/utils/zero_to_fp32.py' 2023-06-22T19:16:14,040 adding 'deepspeed-0.9.5.data/scripts/deepspeed' 2023-06-22T19:16:14,043 adding 'deepspeed-0.9.5.data/scripts/deepspeed.pt' 2023-06-22T19:16:14,045 adding 'deepspeed-0.9.5.data/scripts/ds' 2023-06-22T19:16:14,048 adding 'deepspeed-0.9.5.data/scripts/ds_bench' 2023-06-22T19:16:14,051 adding 'deepspeed-0.9.5.data/scripts/ds_elastic' 2023-06-22T19:16:14,053 adding 'deepspeed-0.9.5.data/scripts/ds_report' 2023-06-22T19:16:14,056 adding 'deepspeed-0.9.5.data/scripts/ds_ssh' 2023-06-22T19:16:14,058 adding 'deepspeed-0.9.5.data/scripts/dsr' 2023-06-22T19:16:14,066 adding 'deepspeed-0.9.5.dist-info/LICENSE' 2023-06-22T19:16:14,075 adding 'deepspeed-0.9.5.dist-info/METADATA' 2023-06-22T19:16:14,078 adding 'deepspeed-0.9.5.dist-info/WHEEL' 2023-06-22T19:16:14,080 adding 'deepspeed-0.9.5.dist-info/entry_points.txt' 2023-06-22T19:16:14,082 adding 'deepspeed-0.9.5.dist-info/top_level.txt' 2023-06-22T19:16:14,099 adding 'deepspeed-0.9.5.dist-info/RECORD' 2023-06-22T19:16:14,151 removing build/bdist.linux-armv7l/wheel 2023-06-22T19:16:14,383 deepspeed build time = 12.045778751373291 secs 2023-06-22T19:16:14,550 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-06-22T19:16:14,583 Created wheel for deepspeed: filename=deepspeed-0.9.5-py3-none-any.whl size=844496 sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe 2023-06-22T19:16:14,585 Stored in directory: /tmp/pip-ephem-wheel-cache-d4ii9fcr/wheels/22/ec/12/64ed42a50b2726478f246987f29c758be4108593efa0733035 2023-06-22T19:16:14,655 Successfully built deepspeed 2023-06-22T19:16:14,716 Removed build tracker: '/tmp/pip-build-tracker-_34mtwcl'