2023-05-13T20:12:57,477 Created temporary directory: /tmp/pip-build-tracker-5qqc5_yw 2023-05-13T20:12:57,480 Initialized build tracking at /tmp/pip-build-tracker-5qqc5_yw 2023-05-13T20:12:57,481 Created build tracker: /tmp/pip-build-tracker-5qqc5_yw 2023-05-13T20:12:57,481 Entered build tracker: /tmp/pip-build-tracker-5qqc5_yw 2023-05-13T20:12:57,483 Created temporary directory: /tmp/pip-wheel-f5oufjai 2023-05-13T20:12:57,491 Created temporary directory: /tmp/pip-ephem-wheel-cache-pt83vree 2023-05-13T20:12:57,545 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-05-13T20:12:57,553 2 location(s) to search for versions of deepspeed: 2023-05-13T20:12:57,553 * https://pypi.org/simple/deepspeed/ 2023-05-13T20:12:57,553 * https://www.piwheels.org/simple/deepspeed/ 2023-05-13T20:12:57,554 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-05-13T20:12:57,555 Getting page https://pypi.org/simple/deepspeed/ 2023-05-13T20:12:57,560 Found index url https://pypi.org/simple/ 2023-05-13T20:12:57,748 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-05-13T20:12:57,784 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-05-13T20:12:57,785 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-05-13T20:12:57,786 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-05-13T20:12:57,787 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-05-13T20:12:57,788 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-05-13T20:12:57,789 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-05-13T20:12:57,790 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-05-13T20:12:57,791 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-05-13T20:12:57,791 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-05-13T20:12:57,792 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-05-13T20:12:57,793 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-05-13T20:12:57,794 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-05-13T20:12:57,794 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-05-13T20:12:57,795 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-05-13T20:12:57,796 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-05-13T20:12:57,796 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-05-13T20:12:57,797 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-05-13T20:12:57,798 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-05-13T20:12:57,798 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-05-13T20:12:57,799 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-05-13T20:12:57,800 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-05-13T20:12:57,800 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-05-13T20:12:57,801 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-05-13T20:12:57,802 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-05-13T20:12:57,803 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-05-13T20:12:57,803 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-05-13T20:12:57,804 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-05-13T20:12:57,805 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-05-13T20:12:57,805 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-05-13T20:12:57,806 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-05-13T20:12:57,807 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-05-13T20:12:57,807 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-05-13T20:12:57,808 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-05-13T20:12:57,809 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-05-13T20:12:57,809 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-05-13T20:12:57,810 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-05-13T20:12:57,811 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-05-13T20:12:57,811 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-05-13T20:12:57,812 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-05-13T20:12:57,813 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-05-13T20:12:57,813 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-05-13T20:12:57,814 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-05-13T20:12:57,815 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-05-13T20:12:57,816 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-05-13T20:12:57,816 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-05-13T20:12:57,817 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-05-13T20:12:57,818 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-05-13T20:12:57,819 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-05-13T20:12:57,820 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-05-13T20:12:57,821 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-05-13T20:12:57,822 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-05-13T20:12:57,823 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-05-13T20:12:57,824 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-05-13T20:12:57,824 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-05-13T20:12:57,825 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-05-13T20:12:57,826 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-05-13T20:12:57,826 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-05-13T20:12:57,827 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-05-13T20:12:57,828 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-05-13T20:12:57,828 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-05-13T20:12:57,829 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-05-13T20:12:57,830 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-05-13T20:12:57,830 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-05-13T20:12:57,831 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-05-13T20:12:57,832 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-05-13T20:12:57,833 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-05-13T20:12:57,833 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-05-13T20:12:57,834 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-05-13T20:12:57,835 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-05-13T20:12:57,836 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-05-13T20:12:57,838 Found index url https://www.piwheels.org/simple/ 2023-05-13T20:12:58,093 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-05-13T20:12:58,126 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=ecfd5c6f19789f0436ea8ba453bf5afefd57ec5961feaf52e0a9aa5a86233731 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,127 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,127 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,128 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,128 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,129 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,129 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,130 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,131 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,131 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,132 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,132 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,133 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,133 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,134 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,134 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,135 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,135 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,136 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,136 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,137 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,138 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,138 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,139 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,139 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,140 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,140 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,141 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,141 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,142 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,142 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,143 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,143 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,144 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,144 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,145 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,146 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,146 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,147 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-05-13T20:12:58,147 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-05-13T20:12:58,148 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-05-13T20:12:58,201 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-05-13T20:12:58,233 Collecting deepspeed==0.9.2 2023-05-13T20:12:58,238 Created temporary directory: /tmp/pip-unpack-6fkthvme 2023-05-13T20:12:58,336 Downloading deepspeed-0.9.2.tar.gz (779 kB) 2023-05-13T20:13:01,148 Added deepspeed==0.9.2 from https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz to build tracker '/tmp/pip-build-tracker-5qqc5_yw' 2023-05-13T20:13:01,152 Running setup.py (path:/tmp/pip-wheel-f5oufjai/deepspeed_1e79aef75acc4f95adce8207eafb5e72/setup.py) egg_info for package deepspeed 2023-05-13T20:13:01,153 Created temporary directory: /tmp/pip-pip-egg-info-uqkq4bib 2023-05-13T20:13:01,154 Preparing metadata (setup.py): started 2023-05-13T20:13:01,156 Running command python setup.py egg_info 2023-05-13T20:13:03,398 fatal: not a git repository (or any of the parent directories): .git 2023-05-13T20:13:04,042 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-05-13T20:13:04,043  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-05-13T20:13:04,043 DS_BUILD_OPS=0 2023-05-13T20:13:04,044  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-05-13T20:13:04,044  [WARNING]  async_io: please install the libaio-dev package with apt 2023-05-13T20:13:04,044  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-05-13T20:13:04,045  [WARNING]  unable to import torch, please install it first 2023-05-13T20:13:04,045  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-05-13T20:13:04,045  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-05-13T20:13:04,046 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-05-13T20:13:04,046 version=0.9.2, git_hash=unknown, git_branch=unknown 2023-05-13T20:13:04,046 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-05-13T20:13:04,047 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-05-13T20:13:04,047 ext_modules=[] 2023-05-13T20:13:04,048 running egg_info 2023-05-13T20:13:04,048 creating /tmp/pip-pip-egg-info-uqkq4bib/deepspeed.egg-info 2023-05-13T20:13:04,110 writing /tmp/pip-pip-egg-info-uqkq4bib/deepspeed.egg-info/PKG-INFO 2023-05-13T20:13:04,117 writing dependency_links to /tmp/pip-pip-egg-info-uqkq4bib/deepspeed.egg-info/dependency_links.txt 2023-05-13T20:13:04,121 writing entry points to /tmp/pip-pip-egg-info-uqkq4bib/deepspeed.egg-info/entry_points.txt 2023-05-13T20:13:04,126 writing requirements to /tmp/pip-pip-egg-info-uqkq4bib/deepspeed.egg-info/requires.txt 2023-05-13T20:13:04,128 writing top-level names to /tmp/pip-pip-egg-info-uqkq4bib/deepspeed.egg-info/top_level.txt 2023-05-13T20:13:04,130 writing manifest file '/tmp/pip-pip-egg-info-uqkq4bib/deepspeed.egg-info/SOURCES.txt' 2023-05-13T20:13:04,518 reading manifest file '/tmp/pip-pip-egg-info-uqkq4bib/deepspeed.egg-info/SOURCES.txt' 2023-05-13T20:13:04,521 reading manifest template 'MANIFEST.in' 2023-05-13T20:13:05,843 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-05-13T20:13:06,840 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-05-13T20:13:07,508 warning: no files found matching '*.tr' under directory 'csrc' 2023-05-13T20:13:07,655 warning: no files found matching '*.cc' under directory 'csrc' 2023-05-13T20:13:07,681 warning: no files found matching '*.py' under directory 'benchmarks' 2023-05-13T20:13:07,691 adding license file 'LICENSE' 2023-05-13T20:13:07,748 writing manifest file '/tmp/pip-pip-egg-info-uqkq4bib/deepspeed.egg-info/SOURCES.txt' 2023-05-13T20:13:07,751 deepspeed build time = 4.3438098430633545 secs 2023-05-13T20:13:07,883 Preparing metadata (setup.py): finished with status 'done' 2023-05-13T20:13:07,908 Source in /tmp/pip-wheel-f5oufjai/deepspeed_1e79aef75acc4f95adce8207eafb5e72 has version 0.9.2, which satisfies requirement deepspeed==0.9.2 from https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz 2023-05-13T20:13:07,910 Removed deepspeed==0.9.2 from https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz from build tracker '/tmp/pip-build-tracker-5qqc5_yw' 2023-05-13T20:13:07,929 Created temporary directory: /tmp/pip-unpack-47rc6l87 2023-05-13T20:13:07,930 Building wheels for collected packages: deepspeed 2023-05-13T20:13:07,939 Created temporary directory: /tmp/pip-wheel-jku0af01 2023-05-13T20:13:07,940 Building wheel for deepspeed (setup.py): started 2023-05-13T20:13:07,942 Destination directory: /tmp/pip-wheel-jku0af01 2023-05-13T20:13:07,942 Running command python setup.py bdist_wheel 2023-05-13T20:13:09,080 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-05-13T20:13:09,104  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-05-13T20:13:09,185 DS_BUILD_OPS=0 2023-05-13T20:13:09,490  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-05-13T20:13:09,675  [WARNING]  async_io: please install the libaio-dev package with apt 2023-05-13T20:13:09,675  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-05-13T20:13:09,679  [WARNING]  unable to import torch, please install it first 2023-05-13T20:13:09,680  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-05-13T20:13:09,682  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-05-13T20:13:09,682 Install Ops={'async_io': False, 'cpu_adagrad': False, 'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False, 'utils': False} 2023-05-13T20:13:09,720 fatal: not a git repository (or any of the parent directories): .git 2023-05-13T20:13:09,725 version=0.9.2, git_hash=unknown, git_branch=unknown 2023-05-13T20:13:09,727 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic<2.0.0', 'torch', 'tqdm'] 2023-05-13T20:13:09,727 compatible_ops={'async_io': False, 'cpu_adagrad': True, 'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'utils': True} 2023-05-13T20:13:09,728 ext_modules=[] 2023-05-13T20:13:10,874 running bdist_wheel 2023-05-13T20:13:11,082 running build 2023-05-13T20:13:11,083 running build_py 2023-05-13T20:13:11,157 creating build 2023-05-13T20:13:11,158 creating build/lib 2023-05-13T20:13:11,159 creating build/lib/deepspeed 2023-05-13T20:13:11,161 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-05-13T20:13:11,165 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-05-13T20:13:11,169 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-05-13T20:13:11,172 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-05-13T20:13:11,176 copying deepspeed/constants.py -> build/lib/deepspeed 2023-05-13T20:13:11,180 creating build/lib/deepspeed/profiling 2023-05-13T20:13:11,182 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-05-13T20:13:11,186 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-05-13T20:13:11,189 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-05-13T20:13:11,213 creating build/lib/deepspeed/monitor 2023-05-13T20:13:11,215 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-05-13T20:13:11,218 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-05-13T20:13:11,222 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-05-13T20:13:11,225 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-05-13T20:13:11,228 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-05-13T20:13:11,231 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-05-13T20:13:11,235 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-05-13T20:13:11,239 creating build/lib/deepspeed/autotuning 2023-05-13T20:13:11,241 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-05-13T20:13:11,245 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-05-13T20:13:11,251 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-05-13T20:13:11,256 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-05-13T20:13:11,260 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-05-13T20:13:11,263 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-05-13T20:13:11,268 creating build/lib/deepspeed/nebula 2023-05-13T20:13:11,269 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-05-13T20:13:11,273 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-05-13T20:13:11,276 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-05-13T20:13:11,281 creating build/lib/deepspeed/elasticity 2023-05-13T20:13:11,283 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-05-13T20:13:11,286 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-05-13T20:13:11,290 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-05-13T20:13:11,295 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-05-13T20:13:11,299 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-05-13T20:13:11,302 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-05-13T20:13:11,306 creating build/lib/deepspeed/moe 2023-05-13T20:13:11,308 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-05-13T20:13:11,312 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-05-13T20:13:11,315 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-05-13T20:13:11,319 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-05-13T20:13:11,324 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-05-13T20:13:11,327 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-05-13T20:13:11,332 creating build/lib/deepspeed/accelerator 2023-05-13T20:13:11,334 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-05-13T20:13:11,338 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-05-13T20:13:11,342 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-05-13T20:13:11,345 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-05-13T20:13:11,350 creating build/lib/deepspeed/module_inject 2023-05-13T20:13:11,351 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-05-13T20:13:11,356 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-05-13T20:13:11,359 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-05-13T20:13:11,362 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-05-13T20:13:11,368 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-05-13T20:13:11,371 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-05-13T20:13:11,375 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-05-13T20:13:11,378 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-05-13T20:13:11,382 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-05-13T20:13:11,386 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-05-13T20:13:11,392 creating build/lib/deepspeed/utils 2023-05-13T20:13:11,394 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,398 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,402 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,406 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,410 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,415 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,421 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,426 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,429 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,433 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,437 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,441 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,444 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-05-13T20:13:11,449 creating build/lib/deepspeed/compression 2023-05-13T20:13:11,451 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-05-13T20:13:11,455 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-05-13T20:13:11,459 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-05-13T20:13:11,463 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-05-13T20:13:11,468 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-05-13T20:13:11,474 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-05-13T20:13:11,477 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-05-13T20:13:11,480 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-05-13T20:13:11,487 creating build/lib/deepspeed/runtime 2023-05-13T20:13:11,489 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,494 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,498 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,503 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,514 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,520 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,526 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,531 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,536 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,542 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,546 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,550 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,553 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,557 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,560 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,566 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-05-13T20:13:11,572 creating build/lib/deepspeed/launcher 2023-05-13T20:13:11,573 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-05-13T20:13:11,578 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-05-13T20:13:11,583 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-05-13T20:13:11,587 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-05-13T20:13:11,590 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-05-13T20:13:11,595 creating build/lib/deepspeed/model_implementations 2023-05-13T20:13:11,596 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-05-13T20:13:11,601 creating build/lib/deepspeed/ops 2023-05-13T20:13:11,602 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-05-13T20:13:11,607 creating build/lib/deepspeed/comm 2023-05-13T20:13:11,609 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-05-13T20:13:11,613 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-05-13T20:13:11,616 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-05-13T20:13:11,619 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-05-13T20:13:11,623 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-05-13T20:13:11,627 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-05-13T20:13:11,632 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-05-13T20:13:11,668 creating build/lib/deepspeed/inference 2023-05-13T20:13:11,683 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-05-13T20:13:11,688 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-05-13T20:13:11,692 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-05-13T20:13:11,697 creating build/lib/deepspeed/checkpoint 2023-05-13T20:13:11,698 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-05-13T20:13:11,703 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-05-13T20:13:11,707 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-05-13T20:13:11,710 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-05-13T20:13:11,714 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-05-13T20:13:11,718 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-05-13T20:13:11,722 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-05-13T20:13:11,726 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-05-13T20:13:11,730 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-05-13T20:13:11,735 creating build/lib/deepspeed/pipe 2023-05-13T20:13:11,737 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-05-13T20:13:11,741 creating build/lib/deepspeed/profiling/flops_profiler 2023-05-13T20:13:11,743 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-05-13T20:13:11,749 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-05-13T20:13:11,754 creating build/lib/deepspeed/autotuning/tuner 2023-05-13T20:13:11,756 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-05-13T20:13:11,759 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-05-13T20:13:11,763 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-05-13T20:13:11,766 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-05-13T20:13:11,769 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-05-13T20:13:11,773 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-05-13T20:13:11,779 creating build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,780 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,784 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,787 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,791 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,795 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,799 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,803 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,807 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,811 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,815 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,819 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,822 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,825 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,829 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,833 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,836 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-05-13T20:13:11,841 creating build/lib/deepspeed/module_inject/containers/features 2023-05-13T20:13:11,843 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-05-13T20:13:11,847 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-05-13T20:13:11,850 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-05-13T20:13:11,855 creating build/lib/deepspeed/runtime/fp16 2023-05-13T20:13:11,857 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-05-13T20:13:11,862 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-05-13T20:13:11,866 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-05-13T20:13:11,870 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-05-13T20:13:11,877 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-05-13T20:13:11,879 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-05-13T20:13:11,885 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-05-13T20:13:11,889 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-05-13T20:13:11,894 creating build/lib/deepspeed/runtime/compression 2023-05-13T20:13:11,896 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-05-13T20:13:11,899 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-05-13T20:13:11,906 creating build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,908 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,917 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,922 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,928 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,934 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,944 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,948 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,953 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,958 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,962 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,973 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,977 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,981 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,986 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,990 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-05-13T20:13:11,995 creating build/lib/deepspeed/runtime/data_pipeline 2023-05-13T20:13:11,997 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-05-13T20:13:12,002 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-05-13T20:13:12,005 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-05-13T20:13:12,009 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-05-13T20:13:12,016 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-05-13T20:13:12,017 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-05-13T20:13:12,022 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-05-13T20:13:12,025 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-05-13T20:13:12,029 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-05-13T20:13:12,034 creating build/lib/deepspeed/runtime/swap_tensor 2023-05-13T20:13:12,036 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-05-13T20:13:12,042 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-05-13T20:13:12,061 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-05-13T20:13:12,065 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-05-13T20:13:12,070 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-05-13T20:13:12,074 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-05-13T20:13:12,077 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-05-13T20:13:12,081 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-05-13T20:13:12,085 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-05-13T20:13:12,091 creating build/lib/deepspeed/runtime/comm 2023-05-13T20:13:12,093 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-05-13T20:13:12,098 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-05-13T20:13:12,102 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-05-13T20:13:12,107 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-05-13T20:13:12,113 creating build/lib/deepspeed/runtime/pipe 2023-05-13T20:13:12,114 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-05-13T20:13:12,128 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-05-13T20:13:12,134 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-05-13T20:13:12,137 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-05-13T20:13:12,141 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-05-13T20:13:12,146 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-05-13T20:13:12,153 creating build/lib/deepspeed/runtime/fp16/onebit 2023-05-13T20:13:12,155 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-05-13T20:13:12,161 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-05-13T20:13:12,166 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-05-13T20:13:12,169 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-05-13T20:13:12,176 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:12,178 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:12,181 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:12,186 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:12,190 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:12,195 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:12,203 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:12,205 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:12,209 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:12,213 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:12,217 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:12,220 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:12,226 creating build/lib/deepspeed/model_implementations/transformers 2023-05-13T20:13:12,227 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-05-13T20:13:12,231 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-05-13T20:13:12,235 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-05-13T20:13:12,238 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-05-13T20:13:12,241 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-05-13T20:13:12,244 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-05-13T20:13:12,247 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-05-13T20:13:12,251 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-05-13T20:13:12,254 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-05-13T20:13:12,258 creating build/lib/deepspeed/model_implementations/features 2023-05-13T20:13:12,260 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-05-13T20:13:12,264 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-05-13T20:13:12,268 creating build/lib/deepspeed/model_implementations/diffusers 2023-05-13T20:13:12,270 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-05-13T20:13:12,274 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-05-13T20:13:12,277 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-05-13T20:13:12,284 creating build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,287 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,291 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,295 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,299 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,303 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,307 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,311 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,315 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,319 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,323 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,327 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,331 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,335 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,339 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,344 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,348 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-05-13T20:13:12,356 creating build/lib/deepspeed/ops/sparse_attention 2023-05-13T20:13:12,358 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-05-13T20:13:12,364 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-05-13T20:13:12,372 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-05-13T20:13:12,376 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-05-13T20:13:12,380 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-05-13T20:13:12,384 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-05-13T20:13:12,388 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-05-13T20:13:12,394 creating build/lib/deepspeed/ops/aio 2023-05-13T20:13:12,396 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-05-13T20:13:12,401 creating build/lib/deepspeed/ops/random_ltd 2023-05-13T20:13:12,403 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-05-13T20:13:12,406 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-05-13T20:13:12,412 creating build/lib/deepspeed/ops/transformer 2023-05-13T20:13:12,414 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-05-13T20:13:12,418 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-05-13T20:13:12,427 creating build/lib/deepspeed/ops/quantizer 2023-05-13T20:13:12,429 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-05-13T20:13:12,432 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-05-13T20:13:12,437 creating build/lib/deepspeed/ops/adam 2023-05-13T20:13:12,439 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-05-13T20:13:12,442 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-05-13T20:13:12,446 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-05-13T20:13:12,450 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-05-13T20:13:12,455 creating build/lib/deepspeed/ops/adagrad 2023-05-13T20:13:12,457 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-05-13T20:13:12,460 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-05-13T20:13:12,465 creating build/lib/deepspeed/ops/lamb 2023-05-13T20:13:12,467 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-05-13T20:13:12,471 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-05-13T20:13:12,476 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-05-13T20:13:12,477 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-05-13T20:13:12,484 creating build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,485 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,491 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,495 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,499 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,504 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,508 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,512 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,516 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,520 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,523 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-05-13T20:13:12,529 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,531 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,535 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,565 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,569 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,573 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,576 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,580 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,583 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,587 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,590 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:12,595 running egg_info 2023-05-13T20:13:12,727 writing deepspeed.egg-info/PKG-INFO 2023-05-13T20:13:12,734 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-05-13T20:13:12,738 writing entry points to deepspeed.egg-info/entry_points.txt 2023-05-13T20:13:12,743 writing requirements to deepspeed.egg-info/requires.txt 2023-05-13T20:13:12,746 writing top-level names to deepspeed.egg-info/top_level.txt 2023-05-13T20:13:12,902 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-05-13T20:13:12,938 reading manifest template 'MANIFEST.in' 2023-05-13T20:13:14,287 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-05-13T20:13:15,271 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-05-13T20:13:15,904 warning: no files found matching '*.tr' under directory 'csrc' 2023-05-13T20:13:16,058 warning: no files found matching '*.cc' under directory 'csrc' 2023-05-13T20:13:16,084 warning: no files found matching '*.py' under directory 'benchmarks' 2023-05-13T20:13:16,094 adding license file 'LICENSE' 2023-05-13T20:13:16,164 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-05-13T20:13:16,182 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-05-13T20:13:16,183 !! 2023-05-13T20:13:16,183 ******************************************************************************** 2023-05-13T20:13:16,184 ############################ 2023-05-13T20:13:16,184 # Package would be ignored # 2023-05-13T20:13:16,184 ############################ 2023-05-13T20:13:16,185 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-05-13T20:13:16,185 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,185 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,186 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-05-13T20:13:16,186 to the `packages` configuration field. 2023-05-13T20:13:16,187 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,187 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,187 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,188 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,188 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,189 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-05-13T20:13:16,189 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-05-13T20:13:16,190 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,190 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,190 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,191 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,191 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,193 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,193 even if it does not contain any `.py` files. 2023-05-13T20:13:16,193 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,193 directory, all directories are treated like packages. 2023-05-13T20:13:16,194 ******************************************************************************** 2023-05-13T20:13:16,194 !! 2023-05-13T20:13:16,195 check.warn(importable) 2023-05-13T20:13:16,195 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-05-13T20:13:16,195 !! 2023-05-13T20:13:16,196 ******************************************************************************** 2023-05-13T20:13:16,196 ############################ 2023-05-13T20:13:16,197 # Package would be ignored # 2023-05-13T20:13:16,197 ############################ 2023-05-13T20:13:16,197 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-05-13T20:13:16,198 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,198 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,199 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-05-13T20:13:16,199 to the `packages` configuration field. 2023-05-13T20:13:16,200 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,200 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,200 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,201 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,201 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,202 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-05-13T20:13:16,202 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-05-13T20:13:16,203 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,203 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,203 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,204 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,204 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,205 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,206 even if it does not contain any `.py` files. 2023-05-13T20:13:16,206 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,206 directory, all directories are treated like packages. 2023-05-13T20:13:16,206 ******************************************************************************** 2023-05-13T20:13:16,207 !! 2023-05-13T20:13:16,207 check.warn(importable) 2023-05-13T20:13:16,208 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-05-13T20:13:16,208 !! 2023-05-13T20:13:16,209 ******************************************************************************** 2023-05-13T20:13:16,209 ############################ 2023-05-13T20:13:16,209 # Package would be ignored # 2023-05-13T20:13:16,209 ############################ 2023-05-13T20:13:16,210 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-05-13T20:13:16,210 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,211 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,211 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-05-13T20:13:16,211 to the `packages` configuration field. 2023-05-13T20:13:16,212 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,212 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,213 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,213 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,214 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,214 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-05-13T20:13:16,215 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-05-13T20:13:16,215 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,215 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,215 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,216 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,217 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,217 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,218 even if it does not contain any `.py` files. 2023-05-13T20:13:16,218 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,218 directory, all directories are treated like packages. 2023-05-13T20:13:16,219 ******************************************************************************** 2023-05-13T20:13:16,219 !! 2023-05-13T20:13:16,219 check.warn(importable) 2023-05-13T20:13:16,220 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-05-13T20:13:16,220 !! 2023-05-13T20:13:16,221 ******************************************************************************** 2023-05-13T20:13:16,221 ############################ 2023-05-13T20:13:16,221 # Package would be ignored # 2023-05-13T20:13:16,222 ############################ 2023-05-13T20:13:16,222 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-05-13T20:13:16,222 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,223 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,223 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-05-13T20:13:16,223 to the `packages` configuration field. 2023-05-13T20:13:16,224 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,224 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,224 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,225 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,226 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,226 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-05-13T20:13:16,226 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-05-13T20:13:16,227 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,227 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,227 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,228 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,228 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,229 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,230 even if it does not contain any `.py` files. 2023-05-13T20:13:16,230 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,230 directory, all directories are treated like packages. 2023-05-13T20:13:16,230 ******************************************************************************** 2023-05-13T20:13:16,231 !! 2023-05-13T20:13:16,231 check.warn(importable) 2023-05-13T20:13:16,232 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-05-13T20:13:16,232 !! 2023-05-13T20:13:16,233 ******************************************************************************** 2023-05-13T20:13:16,233 ############################ 2023-05-13T20:13:16,233 # Package would be ignored # 2023-05-13T20:13:16,234 ############################ 2023-05-13T20:13:16,234 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-05-13T20:13:16,234 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,235 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,235 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-05-13T20:13:16,235 to the `packages` configuration field. 2023-05-13T20:13:16,236 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,236 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,236 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,237 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,237 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,238 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-05-13T20:13:16,238 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-05-13T20:13:16,239 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,239 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,239 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,240 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,240 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,241 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,242 even if it does not contain any `.py` files. 2023-05-13T20:13:16,242 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,242 directory, all directories are treated like packages. 2023-05-13T20:13:16,243 ******************************************************************************** 2023-05-13T20:13:16,243 !! 2023-05-13T20:13:16,244 check.warn(importable) 2023-05-13T20:13:16,244 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-05-13T20:13:16,244 !! 2023-05-13T20:13:16,245 ******************************************************************************** 2023-05-13T20:13:16,245 ############################ 2023-05-13T20:13:16,245 # Package would be ignored # 2023-05-13T20:13:16,246 ############################ 2023-05-13T20:13:16,246 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-05-13T20:13:16,246 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,247 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,247 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-05-13T20:13:16,247 to the `packages` configuration field. 2023-05-13T20:13:16,248 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,248 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,249 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,249 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,250 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,250 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-05-13T20:13:16,251 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-05-13T20:13:16,251 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,251 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,252 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,252 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,253 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,254 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,254 even if it does not contain any `.py` files. 2023-05-13T20:13:16,254 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,255 directory, all directories are treated like packages. 2023-05-13T20:13:16,255 ******************************************************************************** 2023-05-13T20:13:16,256 !! 2023-05-13T20:13:16,256 check.warn(importable) 2023-05-13T20:13:16,256 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-05-13T20:13:16,257 !! 2023-05-13T20:13:16,257 ******************************************************************************** 2023-05-13T20:13:16,258 ############################ 2023-05-13T20:13:16,258 # Package would be ignored # 2023-05-13T20:13:16,258 ############################ 2023-05-13T20:13:16,259 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-05-13T20:13:16,259 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,260 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,260 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-05-13T20:13:16,261 to the `packages` configuration field. 2023-05-13T20:13:16,261 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,262 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,262 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,263 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,264 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,264 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-05-13T20:13:16,265 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-05-13T20:13:16,265 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,265 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,266 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,266 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,267 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,268 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,269 even if it does not contain any `.py` files. 2023-05-13T20:13:16,269 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,269 directory, all directories are treated like packages. 2023-05-13T20:13:16,270 ******************************************************************************** 2023-05-13T20:13:16,270 !! 2023-05-13T20:13:16,271 check.warn(importable) 2023-05-13T20:13:16,271 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-05-13T20:13:16,271 !! 2023-05-13T20:13:16,272 ******************************************************************************** 2023-05-13T20:13:16,273 ############################ 2023-05-13T20:13:16,273 # Package would be ignored # 2023-05-13T20:13:16,273 ############################ 2023-05-13T20:13:16,274 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-05-13T20:13:16,274 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,275 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,275 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-05-13T20:13:16,275 to the `packages` configuration field. 2023-05-13T20:13:16,276 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,276 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,277 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,277 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,278 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,278 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-05-13T20:13:16,279 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-05-13T20:13:16,279 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,279 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,280 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,281 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,282 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,283 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,283 even if it does not contain any `.py` files. 2023-05-13T20:13:16,283 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,284 directory, all directories are treated like packages. 2023-05-13T20:13:16,284 ******************************************************************************** 2023-05-13T20:13:16,285 !! 2023-05-13T20:13:16,285 check.warn(importable) 2023-05-13T20:13:16,285 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-05-13T20:13:16,286 !! 2023-05-13T20:13:16,286 ******************************************************************************** 2023-05-13T20:13:16,287 ############################ 2023-05-13T20:13:16,287 # Package would be ignored # 2023-05-13T20:13:16,287 ############################ 2023-05-13T20:13:16,288 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-05-13T20:13:16,288 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,288 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,289 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-05-13T20:13:16,289 to the `packages` configuration field. 2023-05-13T20:13:16,290 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,290 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,290 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,291 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,292 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,292 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-05-13T20:13:16,293 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-05-13T20:13:16,293 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,293 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,294 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,294 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,295 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,296 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,296 even if it does not contain any `.py` files. 2023-05-13T20:13:16,297 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,297 directory, all directories are treated like packages. 2023-05-13T20:13:16,297 ******************************************************************************** 2023-05-13T20:13:16,298 !! 2023-05-13T20:13:16,299 check.warn(importable) 2023-05-13T20:13:16,299 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-05-13T20:13:16,299 !! 2023-05-13T20:13:16,300 ******************************************************************************** 2023-05-13T20:13:16,300 ############################ 2023-05-13T20:13:16,301 # Package would be ignored # 2023-05-13T20:13:16,301 ############################ 2023-05-13T20:13:16,301 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-05-13T20:13:16,302 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,302 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,303 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-05-13T20:13:16,303 to the `packages` configuration field. 2023-05-13T20:13:16,304 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,304 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,304 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,305 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,306 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,306 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-05-13T20:13:16,306 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-05-13T20:13:16,307 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,307 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,307 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,308 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,309 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,310 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,310 even if it does not contain any `.py` files. 2023-05-13T20:13:16,310 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,311 directory, all directories are treated like packages. 2023-05-13T20:13:16,311 ******************************************************************************** 2023-05-13T20:13:16,312 !! 2023-05-13T20:13:16,312 check.warn(importable) 2023-05-13T20:13:16,312 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-05-13T20:13:16,313 !! 2023-05-13T20:13:16,313 ******************************************************************************** 2023-05-13T20:13:16,314 ############################ 2023-05-13T20:13:16,314 # Package would be ignored # 2023-05-13T20:13:16,314 ############################ 2023-05-13T20:13:16,315 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-05-13T20:13:16,315 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,316 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,316 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-05-13T20:13:16,316 to the `packages` configuration field. 2023-05-13T20:13:16,317 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,317 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,317 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,318 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,319 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,319 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-05-13T20:13:16,320 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-05-13T20:13:16,320 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,320 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,321 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,321 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,322 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,323 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,323 even if it does not contain any `.py` files. 2023-05-13T20:13:16,324 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,324 directory, all directories are treated like packages. 2023-05-13T20:13:16,324 ******************************************************************************** 2023-05-13T20:13:16,325 !! 2023-05-13T20:13:16,325 check.warn(importable) 2023-05-13T20:13:16,325 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-05-13T20:13:16,326 !! 2023-05-13T20:13:16,327 ******************************************************************************** 2023-05-13T20:13:16,327 ############################ 2023-05-13T20:13:16,327 # Package would be ignored # 2023-05-13T20:13:16,327 ############################ 2023-05-13T20:13:16,328 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-05-13T20:13:16,328 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,329 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,329 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-05-13T20:13:16,329 to the `packages` configuration field. 2023-05-13T20:13:16,330 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,330 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,331 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,331 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,332 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,333 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-05-13T20:13:16,333 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-05-13T20:13:16,333 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,334 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,334 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,335 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,335 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,336 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,337 even if it does not contain any `.py` files. 2023-05-13T20:13:16,337 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,337 directory, all directories are treated like packages. 2023-05-13T20:13:16,338 ******************************************************************************** 2023-05-13T20:13:16,338 !! 2023-05-13T20:13:16,338 check.warn(importable) 2023-05-13T20:13:16,339 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-05-13T20:13:16,339 !! 2023-05-13T20:13:16,340 ******************************************************************************** 2023-05-13T20:13:16,340 ############################ 2023-05-13T20:13:16,340 # Package would be ignored # 2023-05-13T20:13:16,341 ############################ 2023-05-13T20:13:16,341 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-05-13T20:13:16,341 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,342 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,342 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-05-13T20:13:16,343 to the `packages` configuration field. 2023-05-13T20:13:16,343 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,344 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,344 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,345 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,345 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,346 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-05-13T20:13:16,346 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-05-13T20:13:16,347 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,347 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,347 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,348 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,349 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,350 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,350 even if it does not contain any `.py` files. 2023-05-13T20:13:16,351 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,351 directory, all directories are treated like packages. 2023-05-13T20:13:16,351 ******************************************************************************** 2023-05-13T20:13:16,352 !! 2023-05-13T20:13:16,352 check.warn(importable) 2023-05-13T20:13:16,353 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-05-13T20:13:16,353 !! 2023-05-13T20:13:16,354 ******************************************************************************** 2023-05-13T20:13:16,354 ############################ 2023-05-13T20:13:16,354 # Package would be ignored # 2023-05-13T20:13:16,355 ############################ 2023-05-13T20:13:16,355 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-05-13T20:13:16,355 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,356 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,356 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-05-13T20:13:16,357 to the `packages` configuration field. 2023-05-13T20:13:16,357 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,358 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,358 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,359 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,359 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,360 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-05-13T20:13:16,360 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-05-13T20:13:16,361 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,361 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,361 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,362 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,363 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,363 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,364 even if it does not contain any `.py` files. 2023-05-13T20:13:16,364 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,364 directory, all directories are treated like packages. 2023-05-13T20:13:16,365 ******************************************************************************** 2023-05-13T20:13:16,365 !! 2023-05-13T20:13:16,366 check.warn(importable) 2023-05-13T20:13:16,366 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-05-13T20:13:16,366 !! 2023-05-13T20:13:16,367 ******************************************************************************** 2023-05-13T20:13:16,367 ############################ 2023-05-13T20:13:16,368 # Package would be ignored # 2023-05-13T20:13:16,368 ############################ 2023-05-13T20:13:16,368 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-05-13T20:13:16,369 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,369 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,370 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-05-13T20:13:16,370 to the `packages` configuration field. 2023-05-13T20:13:16,371 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,371 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,371 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,372 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,372 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,373 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-05-13T20:13:16,374 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-05-13T20:13:16,374 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,374 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,375 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,375 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,376 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,377 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,377 even if it does not contain any `.py` files. 2023-05-13T20:13:16,377 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,378 directory, all directories are treated like packages. 2023-05-13T20:13:16,378 ******************************************************************************** 2023-05-13T20:13:16,379 !! 2023-05-13T20:13:16,379 check.warn(importable) 2023-05-13T20:13:16,379 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-05-13T20:13:16,380 !! 2023-05-13T20:13:16,380 ******************************************************************************** 2023-05-13T20:13:16,381 ############################ 2023-05-13T20:13:16,381 # Package would be ignored # 2023-05-13T20:13:16,381 ############################ 2023-05-13T20:13:16,382 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-05-13T20:13:16,382 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,383 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,383 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-05-13T20:13:16,383 to the `packages` configuration field. 2023-05-13T20:13:16,384 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,384 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,385 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,385 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,386 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,387 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-05-13T20:13:16,387 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-05-13T20:13:16,387 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,388 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,388 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,388 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,389 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,390 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,390 even if it does not contain any `.py` files. 2023-05-13T20:13:16,391 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,391 directory, all directories are treated like packages. 2023-05-13T20:13:16,391 ******************************************************************************** 2023-05-13T20:13:16,392 !! 2023-05-13T20:13:16,392 check.warn(importable) 2023-05-13T20:13:16,393 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-05-13T20:13:16,393 !! 2023-05-13T20:13:16,394 ******************************************************************************** 2023-05-13T20:13:16,394 ############################ 2023-05-13T20:13:16,394 # Package would be ignored # 2023-05-13T20:13:16,395 ############################ 2023-05-13T20:13:16,395 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-05-13T20:13:16,395 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,396 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,396 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-05-13T20:13:16,397 to the `packages` configuration field. 2023-05-13T20:13:16,397 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,398 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,398 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,399 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,400 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,400 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-05-13T20:13:16,401 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-05-13T20:13:16,401 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,401 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,402 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,402 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,403 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,404 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,404 even if it does not contain any `.py` files. 2023-05-13T20:13:16,405 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,405 directory, all directories are treated like packages. 2023-05-13T20:13:16,405 ******************************************************************************** 2023-05-13T20:13:16,406 !! 2023-05-13T20:13:16,406 check.warn(importable) 2023-05-13T20:13:16,407 /usr/local/lib/python3.7/dist-packages/setuptools/command/build_py.py:201: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-05-13T20:13:16,407 !! 2023-05-13T20:13:16,408 ******************************************************************************** 2023-05-13T20:13:16,408 ############################ 2023-05-13T20:13:16,408 # Package would be ignored # 2023-05-13T20:13:16,409 ############################ 2023-05-13T20:13:16,409 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-05-13T20:13:16,409 but it is absent from setuptools' `packages` configuration. 2023-05-13T20:13:16,410 This leads to an ambiguous overall configuration. If you want to distribute this 2023-05-13T20:13:16,410 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-05-13T20:13:16,411 to the `packages` configuration field. 2023-05-13T20:13:16,411 Alternatively, you can also rely on setuptools' discovery methods 2023-05-13T20:13:16,411 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-05-13T20:13:16,412 instead of `find_packages(...)`/`find:`). 2023-05-13T20:13:16,412 You can read more about "package discovery" on setuptools documentation page: 2023-05-13T20:13:16,413 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-05-13T20:13:16,414 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-05-13T20:13:16,414 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-05-13T20:13:16,414 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-05-13T20:13:16,415 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-05-13T20:13:16,415 combination with a more fine grained `package-data` configuration. 2023-05-13T20:13:16,416 You can read more about "package data files" on setuptools documentation page: 2023-05-13T20:13:16,416 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-05-13T20:13:16,417 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-05-13T20:13:16,418 even if it does not contain any `.py` files. 2023-05-13T20:13:16,418 On the other hand, currently there is no concept of package data 2023-05-13T20:13:16,418 directory, all directories are treated like packages. 2023-05-13T20:13:16,419 ******************************************************************************** 2023-05-13T20:13:16,419 !! 2023-05-13T20:13:16,420 check.warn(importable) 2023-05-13T20:13:16,420 creating build/lib/deepspeed/autotuning/config_templates 2023-05-13T20:13:16,420 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-05-13T20:13:16,420 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-05-13T20:13:16,421 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-05-13T20:13:16,421 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-05-13T20:13:16,421 creating build/lib/deepspeed/ops/csrc 2023-05-13T20:13:16,422 creating build/lib/deepspeed/ops/csrc/adagrad 2023-05-13T20:13:16,422 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-05-13T20:13:16,422 creating build/lib/deepspeed/ops/csrc/adam 2023-05-13T20:13:16,423 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-05-13T20:13:16,423 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-05-13T20:13:16,423 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-05-13T20:13:16,423 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-05-13T20:13:16,424 creating build/lib/deepspeed/ops/csrc/aio 2023-05-13T20:13:16,424 creating build/lib/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:16,424 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:16,425 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:16,425 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:16,425 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:16,425 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:16,426 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:16,426 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,426 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,427 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,427 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,427 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,427 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,428 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,428 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,428 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,429 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,429 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,429 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:16,429 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-05-13T20:13:16,430 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-05-13T20:13:16,430 creating build/lib/deepspeed/ops/csrc/common 2023-05-13T20:13:16,430 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-05-13T20:13:16,431 creating build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,431 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,431 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,432 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,433 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,438 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,444 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,449 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,454 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,458 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,464 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,470 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,475 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,480 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,485 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,489 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,493 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,498 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,502 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,509 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,514 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,518 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,525 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,529 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,535 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,539 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,544 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,549 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-05-13T20:13:16,554 creating build/lib/deepspeed/ops/csrc/lamb 2023-05-13T20:13:16,556 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-05-13T20:13:16,560 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-05-13T20:13:16,566 creating build/lib/deepspeed/ops/csrc/quantization 2023-05-13T20:13:16,567 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-05-13T20:13:16,571 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-05-13T20:13:16,578 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-05-13T20:13:16,583 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-05-13T20:13:16,588 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-05-13T20:13:16,590 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-05-13T20:13:16,596 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-05-13T20:13:16,601 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-05-13T20:13:16,607 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-05-13T20:13:16,612 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-05-13T20:13:16,614 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-05-13T20:13:16,620 creating build/lib/deepspeed/ops/csrc/spatial 2023-05-13T20:13:16,622 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-05-13T20:13:16,625 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-05-13T20:13:16,631 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-05-13T20:13:16,636 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-05-13T20:13:16,638 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-05-13T20:13:16,643 creating build/lib/deepspeed/ops/csrc/transformer 2023-05-13T20:13:16,645 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-05-13T20:13:16,651 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-05-13T20:13:16,658 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-05-13T20:13:16,666 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-05-13T20:13:16,672 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-05-13T20:13:16,678 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-05-13T20:13:16,687 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-05-13T20:13:16,694 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-05-13T20:13:16,701 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-05-13T20:13:16,702 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:16,705 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:16,711 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:16,717 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:16,723 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:16,729 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:16,741 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:16,745 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:16,750 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:16,757 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-05-13T20:13:16,759 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-05-13T20:13:16,764 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-05-13T20:13:16,769 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-05-13T20:13:16,774 creating build/lib/deepspeed/ops/csrc/utils 2023-05-13T20:13:16,775 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-05-13T20:13:16,779 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-05-13T20:13:16,784 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-05-13T20:13:16,788 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-05-13T20:13:16,877 running build_scripts 2023-05-13T20:13:16,878 creating build/scripts-3.7 2023-05-13T20:13:16,881 copying and adjusting bin/deepspeed -> build/scripts-3.7 2023-05-13T20:13:16,884 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2023-05-13T20:13:16,887 copying and adjusting bin/ds -> build/scripts-3.7 2023-05-13T20:13:16,890 copying bin/ds_ssh -> build/scripts-3.7 2023-05-13T20:13:16,894 copying and adjusting bin/ds_report -> build/scripts-3.7 2023-05-13T20:13:16,897 copying and adjusting bin/ds_bench -> build/scripts-3.7 2023-05-13T20:13:16,900 copying and adjusting bin/dsr -> build/scripts-3.7 2023-05-13T20:13:16,903 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2023-05-13T20:13:16,905 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2023-05-13T20:13:16,906 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2023-05-13T20:13:16,906 changing mode of build/scripts-3.7/ds from 644 to 755 2023-05-13T20:13:16,907 changing mode of build/scripts-3.7/ds_report from 644 to 755 2023-05-13T20:13:16,908 changing mode of build/scripts-3.7/ds_bench from 644 to 755 2023-05-13T20:13:16,908 changing mode of build/scripts-3.7/dsr from 644 to 755 2023-05-13T20:13:16,909 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2023-05-13T20:13:16,985 /usr/local/lib/python3.7/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-05-13T20:13:16,985 !! 2023-05-13T20:13:16,986 ******************************************************************************** 2023-05-13T20:13:16,986 Please avoid running ``setup.py`` directly. 2023-05-13T20:13:16,987 Instead, use pypa/build, pypa/installer, pypa/build or 2023-05-13T20:13:16,987 other standards-based tools. 2023-05-13T20:13:16,988 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-05-13T20:13:16,988 ******************************************************************************** 2023-05-13T20:13:16,989 !! 2023-05-13T20:13:16,989 self.initialize_options() 2023-05-13T20:13:17,054 installing to build/bdist.linux-armv7l/wheel 2023-05-13T20:13:17,055 running install 2023-05-13T20:13:17,117 running install_lib 2023-05-13T20:13:17,189 creating build/bdist.linux-armv7l 2023-05-13T20:13:17,190 creating build/bdist.linux-armv7l/wheel 2023-05-13T20:13:17,194 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-05-13T20:13:17,196 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-05-13T20:13:17,202 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-05-13T20:13:17,204 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-05-13T20:13:17,207 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-05-13T20:13:17,214 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-05-13T20:13:17,218 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-05-13T20:13:17,222 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-05-13T20:13:17,225 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-05-13T20:13:17,230 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-05-13T20:13:17,232 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-05-13T20:13:17,237 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-05-13T20:13:17,241 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-05-13T20:13:17,244 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-05-13T20:13:17,248 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-05-13T20:13:17,252 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-05-13T20:13:17,256 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-05-13T20:13:17,261 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-05-13T20:13:17,264 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-05-13T20:13:17,266 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-05-13T20:13:17,270 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-05-13T20:13:17,274 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-05-13T20:13:17,278 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-05-13T20:13:17,282 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-05-13T20:13:17,286 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-05-13T20:13:17,291 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-05-13T20:13:17,293 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-05-13T20:13:17,297 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-05-13T20:13:17,300 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-05-13T20:13:17,303 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-05-13T20:13:17,307 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-05-13T20:13:17,311 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-05-13T20:13:17,318 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-05-13T20:13:17,322 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-05-13T20:13:17,327 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-05-13T20:13:17,330 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-05-13T20:13:17,336 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-05-13T20:13:17,338 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-05-13T20:13:17,342 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-05-13T20:13:17,346 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-05-13T20:13:17,352 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-05-13T20:13:17,354 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-05-13T20:13:17,359 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-05-13T20:13:17,363 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-05-13T20:13:17,369 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-05-13T20:13:17,374 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-05-13T20:13:17,378 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-05-13T20:13:17,383 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-05-13T20:13:17,385 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-05-13T20:13:17,390 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-05-13T20:13:17,394 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-05-13T20:13:17,398 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-05-13T20:13:17,404 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-05-13T20:13:17,409 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-05-13T20:13:17,414 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-05-13T20:13:17,417 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-05-13T20:13:17,422 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-05-13T20:13:17,426 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-05-13T20:13:17,431 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-05-13T20:13:17,436 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,438 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,444 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,448 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,452 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,458 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,463 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,467 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,473 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,475 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,479 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,483 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,488 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,492 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,497 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,502 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,506 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,512 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,517 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,522 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-05-13T20:13:17,524 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-05-13T20:13:17,527 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-05-13T20:13:17,531 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-05-13T20:13:17,534 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,537 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,541 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,545 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,549 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,554 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-05-13T20:13:17,558 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,563 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,568 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-05-13T20:13:17,573 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,575 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,580 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,584 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,589 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,593 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,598 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,603 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,608 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,612 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,616 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,621 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,626 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,630 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-05-13T20:13:17,636 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-05-13T20:13:17,638 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-05-13T20:13:17,649 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-05-13T20:13:17,653 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-05-13T20:13:17,657 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-05-13T20:13:17,662 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-05-13T20:13:17,668 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-05-13T20:13:17,672 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-05-13T20:13:17,677 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-05-13T20:13:17,682 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-05-13T20:13:17,688 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,690 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,694 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,698 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,703 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,714 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,720 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,728 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-05-13T20:13:17,730 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-05-13T20:13:17,735 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-05-13T20:13:17,739 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-05-13T20:13:17,743 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-05-13T20:13:17,749 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-05-13T20:13:17,750 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-05-13T20:13:17,756 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-05-13T20:13:17,760 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-05-13T20:13:17,764 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-05-13T20:13:17,769 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,775 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-05-13T20:13:17,777 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-05-13T20:13:17,784 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-05-13T20:13:17,788 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-05-13T20:13:17,792 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,797 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,803 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,808 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,812 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,817 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-05-13T20:13:17,820 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-05-13T20:13:17,824 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-05-13T20:13:17,828 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,833 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,838 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,841 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,849 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,854 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,860 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,866 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,876 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,880 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,885 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,891 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,895 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,905 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,909 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,913 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,918 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,922 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-05-13T20:13:17,926 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:17,932 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-05-13T20:13:17,933 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-05-13T20:13:17,939 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:17,941 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:17,945 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:17,950 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:17,954 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:17,959 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-05-13T20:13:17,964 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-05-13T20:13:17,967 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-05-13T20:13:17,971 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-05-13T20:13:17,978 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:17,979 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:17,983 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:17,987 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:17,991 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:17,995 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-05-13T20:13:17,999 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-05-13T20:13:18,004 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-05-13T20:13:18,006 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-05-13T20:13:18,011 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-05-13T20:13:18,014 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-05-13T20:13:18,018 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-05-13T20:13:18,023 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-05-13T20:13:18,024 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-05-13T20:13:18,030 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-05-13T20:13:18,034 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-05-13T20:13:18,038 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-05-13T20:13:18,043 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-05-13T20:13:18,047 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-05-13T20:13:18,051 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-05-13T20:13:18,054 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-05-13T20:13:18,058 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-05-13T20:13:18,063 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-05-13T20:13:18,065 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-05-13T20:13:18,069 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-05-13T20:13:18,073 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-05-13T20:13:18,077 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-05-13T20:13:18,082 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-05-13T20:13:18,084 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-05-13T20:13:18,090 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-05-13T20:13:18,095 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-05-13T20:13:18,099 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-05-13T20:13:18,103 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-05-13T20:13:18,108 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-05-13T20:13:18,113 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-05-13T20:13:18,117 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-05-13T20:13:18,122 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-05-13T20:13:18,123 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-05-13T20:13:18,128 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-05-13T20:13:18,134 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-05-13T20:13:18,138 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-05-13T20:13:18,142 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-05-13T20:13:18,145 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-05-13T20:13:18,150 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-05-13T20:13:18,151 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-05-13T20:13:18,156 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-05-13T20:13:18,158 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-05-13T20:13:18,162 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-05-13T20:13:18,166 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-05-13T20:13:18,169 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-05-13T20:13:18,173 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-05-13T20:13:18,176 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-05-13T20:13:18,179 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-05-13T20:13:18,183 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-05-13T20:13:18,186 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-05-13T20:13:18,191 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-05-13T20:13:18,193 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-05-13T20:13:18,196 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-05-13T20:13:18,201 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-05-13T20:13:18,203 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-05-13T20:13:18,206 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-05-13T20:13:18,210 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-05-13T20:13:18,215 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-05-13T20:13:18,218 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,220 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,224 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,227 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,230 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,234 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,237 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,241 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,255 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,259 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,262 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,266 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,269 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,273 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,276 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,279 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,283 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-05-13T20:13:18,289 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-05-13T20:13:18,291 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-05-13T20:13:18,297 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-05-13T20:13:18,304 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-05-13T20:13:18,306 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-05-13T20:13:18,309 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-05-13T20:13:18,313 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-05-13T20:13:18,317 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-05-13T20:13:18,321 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-05-13T20:13:18,325 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-05-13T20:13:18,329 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-05-13T20:13:18,332 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-05-13T20:13:18,337 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-05-13T20:13:18,343 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-05-13T20:13:18,344 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-05-13T20:13:18,349 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-05-13T20:13:18,350 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-05-13T20:13:18,354 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-05-13T20:13:18,358 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-05-13T20:13:18,363 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-05-13T20:13:18,364 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-05-13T20:13:18,368 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-05-13T20:13:18,374 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,376 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,382 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,388 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,390 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,395 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,399 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,403 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,407 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,411 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,415 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,419 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,423 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,427 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-05-13T20:13:18,431 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,437 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,441 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,445 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,449 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,453 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,457 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,460 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-05-13T20:13:18,465 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-05-13T20:13:18,466 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-05-13T20:13:18,470 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-05-13T20:13:18,474 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-05-13T20:13:18,477 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-05-13T20:13:18,480 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-05-13T20:13:18,482 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-05-13T20:13:18,486 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-05-13T20:13:18,490 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-05-13T20:13:18,492 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-05-13T20:13:18,497 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-05-13T20:13:18,498 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-05-13T20:13:18,504 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-05-13T20:13:18,506 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-05-13T20:13:18,510 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-05-13T20:13:18,512 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-05-13T20:13:18,516 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-05-13T20:13:18,523 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-05-13T20:13:18,527 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-05-13T20:13:18,532 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-05-13T20:13:18,534 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:18,536 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:18,540 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:18,544 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:18,547 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:18,551 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:18,556 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-05-13T20:13:18,561 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,562 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,566 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,569 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,574 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,577 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,581 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,584 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,588 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,591 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,595 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,598 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-05-13T20:13:18,604 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-05-13T20:13:18,605 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-05-13T20:13:18,610 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-05-13T20:13:18,612 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-05-13T20:13:18,617 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-05-13T20:13:18,618 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-05-13T20:13:18,623 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-05-13T20:13:18,627 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-05-13T20:13:18,631 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-05-13T20:13:18,637 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-05-13T20:13:18,639 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-05-13T20:13:18,644 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-05-13T20:13:18,649 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-05-13T20:13:18,655 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-05-13T20:13:18,661 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-05-13T20:13:18,694 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-05-13T20:13:18,699 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-05-13T20:13:18,704 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-05-13T20:13:18,711 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-05-13T20:13:18,714 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:18,716 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:18,721 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:18,726 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:18,732 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:18,736 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:18,742 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:18,750 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:18,755 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-05-13T20:13:18,760 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-05-13T20:13:18,762 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-05-13T20:13:18,767 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-05-13T20:13:18,771 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-05-13T20:13:18,777 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,779 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,784 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,787 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,791 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,795 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,800 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,805 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,810 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,814 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,817 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,822 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,826 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,830 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,834 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,837 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,841 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,845 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,849 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,852 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,856 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,861 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,865 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,868 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,874 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,877 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,882 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,886 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-05-13T20:13:18,891 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-05-13T20:13:18,892 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-05-13T20:13:18,897 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-05-13T20:13:18,901 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-05-13T20:13:18,905 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-05-13T20:13:18,911 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-05-13T20:13:18,913 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-05-13T20:13:18,918 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-05-13T20:13:18,920 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-05-13T20:13:18,925 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-05-13T20:13:18,930 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-05-13T20:13:18,932 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-05-13T20:13:18,936 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-05-13T20:13:18,939 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-05-13T20:13:18,943 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-05-13T20:13:18,949 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-05-13T20:13:18,950 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-05-13T20:13:18,954 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-05-13T20:13:18,959 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-05-13T20:13:18,961 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-05-13T20:13:18,965 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-05-13T20:13:18,970 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-05-13T20:13:18,971 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-05-13T20:13:18,975 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-05-13T20:13:18,979 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-05-13T20:13:18,982 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-05-13T20:13:18,987 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-05-13T20:13:18,990 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-05-13T20:13:18,996 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-05-13T20:13:19,000 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-05-13T20:13:19,002 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-05-13T20:13:19,009 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-05-13T20:13:19,013 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-05-13T20:13:19,017 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-05-13T20:13:19,019 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-05-13T20:13:19,024 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-05-13T20:13:19,028 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-05-13T20:13:19,031 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-05-13T20:13:19,035 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-05-13T20:13:19,039 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-05-13T20:13:19,043 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-05-13T20:13:19,046 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-05-13T20:13:19,049 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-05-13T20:13:19,054 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-05-13T20:13:19,056 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-05-13T20:13:19,059 running install_egg_info 2023-05-13T20:13:19,137 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.9.2-py3.7.egg-info 2023-05-13T20:13:19,177 running install_scripts 2023-05-13T20:13:19,179 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data 2023-05-13T20:13:19,180 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts 2023-05-13T20:13:19,182 copying build/scripts-3.7/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts 2023-05-13T20:13:19,186 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts 2023-05-13T20:13:19,189 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts 2023-05-13T20:13:19,192 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts 2023-05-13T20:13:19,196 copying build/scripts-3.7/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts 2023-05-13T20:13:19,199 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts 2023-05-13T20:13:19,203 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts 2023-05-13T20:13:19,206 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts 2023-05-13T20:13:19,209 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts/ds_bench to 755 2023-05-13T20:13:19,209 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts/deepspeed to 755 2023-05-13T20:13:19,210 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts/ds to 755 2023-05-13T20:13:19,211 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts/ds_report to 755 2023-05-13T20:13:19,211 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts/dsr to 755 2023-05-13T20:13:19,212 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts/ds_elastic to 755 2023-05-13T20:13:19,213 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts/ds_ssh to 755 2023-05-13T20:13:19,214 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.data/scripts/deepspeed.pt to 755 2023-05-13T20:13:19,357 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2023-05-13T20:13:19,366 creating build/bdist.linux-armv7l/wheel/deepspeed-0.9.2.dist-info/WHEEL 2023-05-13T20:13:19,371 creating '/tmp/pip-wheel-jku0af01/deepspeed-0.9.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-05-13T20:13:19,379 adding 'deepspeed/__init__.py' 2023-05-13T20:13:19,382 adding 'deepspeed/constants.py' 2023-05-13T20:13:19,385 adding 'deepspeed/env_report.py' 2023-05-13T20:13:19,388 adding 'deepspeed/git_version_info.py' 2023-05-13T20:13:19,390 adding 'deepspeed/git_version_info_installed.py' 2023-05-13T20:13:19,394 adding 'deepspeed/accelerator/__init__.py' 2023-05-13T20:13:19,397 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-05-13T20:13:19,400 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-05-13T20:13:19,403 adding 'deepspeed/accelerator/real_accelerator.py' 2023-05-13T20:13:19,407 adding 'deepspeed/autotuning/__init__.py' 2023-05-13T20:13:19,420 adding 'deepspeed/autotuning/autotuner.py' 2023-05-13T20:13:19,424 adding 'deepspeed/autotuning/config.py' 2023-05-13T20:13:19,427 adding 'deepspeed/autotuning/constants.py' 2023-05-13T20:13:19,432 adding 'deepspeed/autotuning/scheduler.py' 2023-05-13T20:13:19,438 adding 'deepspeed/autotuning/utils.py' 2023-05-13T20:13:19,441 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-05-13T20:13:19,444 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-05-13T20:13:19,446 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-05-13T20:13:19,449 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-05-13T20:13:19,452 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-05-13T20:13:19,455 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-05-13T20:13:19,457 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-05-13T20:13:19,460 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-05-13T20:13:19,463 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-05-13T20:13:19,466 adding 'deepspeed/autotuning/tuner/utils.py' 2023-05-13T20:13:19,470 adding 'deepspeed/checkpoint/__init__.py' 2023-05-13T20:13:19,473 adding 'deepspeed/checkpoint/constants.py' 2023-05-13T20:13:19,477 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-05-13T20:13:19,480 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-05-13T20:13:19,484 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-05-13T20:13:19,487 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-05-13T20:13:19,490 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-05-13T20:13:19,493 adding 'deepspeed/checkpoint/utils.py' 2023-05-13T20:13:19,496 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-05-13T20:13:19,499 adding 'deepspeed/comm/__init__.py' 2023-05-13T20:13:19,502 adding 'deepspeed/comm/backend.py' 2023-05-13T20:13:19,509 adding 'deepspeed/comm/comm.py' 2023-05-13T20:13:19,512 adding 'deepspeed/comm/config.py' 2023-05-13T20:13:19,515 adding 'deepspeed/comm/constants.py' 2023-05-13T20:13:19,519 adding 'deepspeed/comm/torch.py' 2023-05-13T20:13:19,522 adding 'deepspeed/comm/utils.py' 2023-05-13T20:13:19,526 adding 'deepspeed/compression/__init__.py' 2023-05-13T20:13:19,533 adding 'deepspeed/compression/basic_layer.py' 2023-05-13T20:13:19,538 adding 'deepspeed/compression/compress.py' 2023-05-13T20:13:19,543 adding 'deepspeed/compression/config.py' 2023-05-13T20:13:19,546 adding 'deepspeed/compression/constants.py' 2023-05-13T20:13:19,550 adding 'deepspeed/compression/helper.py' 2023-05-13T20:13:19,553 adding 'deepspeed/compression/scheduler.py' 2023-05-13T20:13:19,557 adding 'deepspeed/compression/utils.py' 2023-05-13T20:13:19,560 adding 'deepspeed/elasticity/__init__.py' 2023-05-13T20:13:19,563 adding 'deepspeed/elasticity/config.py' 2023-05-13T20:13:19,566 adding 'deepspeed/elasticity/constants.py' 2023-05-13T20:13:19,570 adding 'deepspeed/elasticity/elastic_agent.py' 2023-05-13T20:13:19,575 adding 'deepspeed/elasticity/elasticity.py' 2023-05-13T20:13:19,585 adding 'deepspeed/elasticity/utils.py' 2023-05-13T20:13:19,589 adding 'deepspeed/inference/__init__.py' 2023-05-13T20:13:19,593 adding 'deepspeed/inference/config.py' 2023-05-13T20:13:19,601 adding 'deepspeed/inference/engine.py' 2023-05-13T20:13:19,605 adding 'deepspeed/launcher/__init__.py' 2023-05-13T20:13:19,607 adding 'deepspeed/launcher/constants.py' 2023-05-13T20:13:19,613 adding 'deepspeed/launcher/launch.py' 2023-05-13T20:13:19,617 adding 'deepspeed/launcher/multinode_runner.py' 2023-05-13T20:13:19,624 adding 'deepspeed/launcher/runner.py' 2023-05-13T20:13:19,628 adding 'deepspeed/model_implementations/__init__.py' 2023-05-13T20:13:19,631 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-05-13T20:13:19,634 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-05-13T20:13:19,637 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-05-13T20:13:19,640 adding 'deepspeed/model_implementations/features/__init__.py' 2023-05-13T20:13:19,643 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-05-13T20:13:19,646 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-05-13T20:13:19,649 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-05-13T20:13:19,651 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-05-13T20:13:19,654 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-05-13T20:13:19,656 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-05-13T20:13:19,659 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-05-13T20:13:19,661 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-05-13T20:13:19,663 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-05-13T20:13:19,667 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-05-13T20:13:19,670 adding 'deepspeed/module_inject/__init__.py' 2023-05-13T20:13:19,674 adding 'deepspeed/module_inject/auto_tp.py' 2023-05-13T20:13:19,677 adding 'deepspeed/module_inject/inject.py' 2023-05-13T20:13:19,680 adding 'deepspeed/module_inject/layers.py' 2023-05-13T20:13:19,684 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-05-13T20:13:19,687 adding 'deepspeed/module_inject/module_quantize.py' 2023-05-13T20:13:19,690 adding 'deepspeed/module_inject/policy.py' 2023-05-13T20:13:19,699 adding 'deepspeed/module_inject/replace_module.py' 2023-05-13T20:13:19,703 adding 'deepspeed/module_inject/replace_policy.py' 2023-05-13T20:13:19,705 adding 'deepspeed/module_inject/utils.py' 2023-05-13T20:13:19,709 adding 'deepspeed/module_inject/containers/__init__.py' 2023-05-13T20:13:19,715 adding 'deepspeed/module_inject/containers/base.py' 2023-05-13T20:13:19,718 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-05-13T20:13:19,721 adding 'deepspeed/module_inject/containers/bert.py' 2023-05-13T20:13:19,724 adding 'deepspeed/module_inject/containers/bloom.py' 2023-05-13T20:13:19,727 adding 'deepspeed/module_inject/containers/clip.py' 2023-05-13T20:13:19,730 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-05-13T20:13:19,732 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-05-13T20:13:19,735 adding 'deepspeed/module_inject/containers/gptj.py' 2023-05-13T20:13:19,738 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-05-13T20:13:19,741 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-05-13T20:13:19,744 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-05-13T20:13:19,747 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-05-13T20:13:19,750 adding 'deepspeed/module_inject/containers/opt.py' 2023-05-13T20:13:19,753 adding 'deepspeed/module_inject/containers/unet.py' 2023-05-13T20:13:19,756 adding 'deepspeed/module_inject/containers/vae.py' 2023-05-13T20:13:19,759 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-05-13T20:13:19,762 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-05-13T20:13:19,765 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-05-13T20:13:19,768 adding 'deepspeed/moe/__init__.py' 2023-05-13T20:13:19,770 adding 'deepspeed/moe/experts.py' 2023-05-13T20:13:19,774 adding 'deepspeed/moe/layer.py' 2023-05-13T20:13:19,777 adding 'deepspeed/moe/mappings.py' 2023-05-13T20:13:19,783 adding 'deepspeed/moe/sharded_moe.py' 2023-05-13T20:13:19,787 adding 'deepspeed/moe/utils.py' 2023-05-13T20:13:19,790 adding 'deepspeed/monitor/__init__.py' 2023-05-13T20:13:19,793 adding 'deepspeed/monitor/config.py' 2023-05-13T20:13:19,795 adding 'deepspeed/monitor/csv_monitor.py' 2023-05-13T20:13:19,798 adding 'deepspeed/monitor/monitor.py' 2023-05-13T20:13:19,801 adding 'deepspeed/monitor/tensorboard.py' 2023-05-13T20:13:19,803 adding 'deepspeed/monitor/utils.py' 2023-05-13T20:13:19,806 adding 'deepspeed/monitor/wandb.py' 2023-05-13T20:13:19,810 adding 'deepspeed/nebula/__init__.py' 2023-05-13T20:13:19,812 adding 'deepspeed/nebula/config.py' 2023-05-13T20:13:19,815 adding 'deepspeed/nebula/constants.py' 2023-05-13T20:13:19,819 adding 'deepspeed/ops/__init__.py' 2023-05-13T20:13:19,822 adding 'deepspeed/ops/adagrad/__init__.py' 2023-05-13T20:13:19,825 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-05-13T20:13:19,828 adding 'deepspeed/ops/adam/__init__.py' 2023-05-13T20:13:19,832 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-05-13T20:13:19,836 adding 'deepspeed/ops/adam/fused_adam.py' 2023-05-13T20:13:19,838 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-05-13T20:13:19,842 adding 'deepspeed/ops/aio/__init__.py' 2023-05-13T20:13:19,847 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-05-13T20:13:19,852 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-05-13T20:13:19,855 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-05-13T20:13:19,858 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-05-13T20:13:19,861 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-05-13T20:13:19,868 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-05-13T20:13:19,871 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-05-13T20:13:19,873 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-05-13T20:13:19,876 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-05-13T20:13:19,879 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-05-13T20:13:19,882 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-05-13T20:13:19,886 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-05-13T20:13:19,888 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-05-13T20:13:19,891 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-05-13T20:13:19,894 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-05-13T20:13:19,896 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-05-13T20:13:19,899 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-05-13T20:13:19,902 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-05-13T20:13:19,905 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-05-13T20:13:19,908 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-05-13T20:13:19,911 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-05-13T20:13:19,913 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-05-13T20:13:19,917 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-05-13T20:13:19,920 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-05-13T20:13:19,925 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-05-13T20:13:19,927 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-05-13T20:13:19,930 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-05-13T20:13:19,933 adding 'deepspeed/ops/csrc/includes/context.h' 2023-05-13T20:13:19,936 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-05-13T20:13:19,940 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-05-13T20:13:19,943 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-05-13T20:13:19,946 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-05-13T20:13:19,950 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-05-13T20:13:19,954 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-05-13T20:13:19,957 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-05-13T20:13:20,014 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-05-13T20:13:20,017 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-05-13T20:13:20,020 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-05-13T20:13:20,022 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-05-13T20:13:20,026 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-05-13T20:13:20,029 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-05-13T20:13:20,034 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-05-13T20:13:20,038 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-05-13T20:13:20,041 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-05-13T20:13:20,046 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-05-13T20:13:20,048 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-05-13T20:13:20,053 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-05-13T20:13:20,056 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-05-13T20:13:20,059 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-05-13T20:13:20,063 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-05-13T20:13:20,066 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-05-13T20:13:20,070 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-05-13T20:13:20,075 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-05-13T20:13:20,079 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-05-13T20:13:20,085 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-05-13T20:13:20,089 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-05-13T20:13:20,093 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-05-13T20:13:20,097 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-05-13T20:13:20,100 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-05-13T20:13:20,103 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-05-13T20:13:20,107 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-05-13T20:13:20,111 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-05-13T20:13:20,116 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-05-13T20:13:20,119 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-05-13T20:13:20,123 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-05-13T20:13:20,128 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-05-13T20:13:20,134 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-05-13T20:13:20,143 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-05-13T20:13:20,148 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-05-13T20:13:20,152 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-05-13T20:13:20,163 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-05-13T20:13:20,170 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-05-13T20:13:20,176 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-05-13T20:13:20,182 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-05-13T20:13:20,186 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-05-13T20:13:20,193 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-05-13T20:13:20,200 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-05-13T20:13:20,213 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-05-13T20:13:20,217 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-05-13T20:13:20,222 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-05-13T20:13:20,229 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-05-13T20:13:20,235 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-05-13T20:13:20,239 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-05-13T20:13:20,242 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-05-13T20:13:20,246 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-05-13T20:13:20,249 adding 'deepspeed/ops/lamb/__init__.py' 2023-05-13T20:13:20,253 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-05-13T20:13:20,257 adding 'deepspeed/ops/op_builder/__init__.py' 2023-05-13T20:13:20,260 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-05-13T20:13:20,263 adding 'deepspeed/ops/op_builder/async_io.py' 2023-05-13T20:13:20,270 adding 'deepspeed/ops/op_builder/builder.py' 2023-05-13T20:13:20,273 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-05-13T20:13:20,276 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-05-13T20:13:20,278 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-05-13T20:13:20,281 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-05-13T20:13:20,284 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-05-13T20:13:20,286 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-05-13T20:13:20,289 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-05-13T20:13:20,291 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-05-13T20:13:20,294 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-05-13T20:13:20,296 adding 'deepspeed/ops/op_builder/transformer.py' 2023-05-13T20:13:20,299 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-05-13T20:13:20,302 adding 'deepspeed/ops/op_builder/utils.py' 2023-05-13T20:13:20,305 adding 'deepspeed/ops/quantizer/__init__.py' 2023-05-13T20:13:20,307 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-05-13T20:13:20,311 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-05-13T20:13:20,314 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-05-13T20:13:20,317 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-05-13T20:13:20,320 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-05-13T20:13:20,329 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-05-13T20:13:20,334 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-05-13T20:13:20,338 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-05-13T20:13:20,342 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-05-13T20:13:20,349 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-05-13T20:13:20,354 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-05-13T20:13:20,357 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-05-13T20:13:20,360 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-05-13T20:13:20,363 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-05-13T20:13:20,367 adding 'deepspeed/ops/transformer/__init__.py' 2023-05-13T20:13:20,372 adding 'deepspeed/ops/transformer/transformer.py' 2023-05-13T20:13:20,376 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-05-13T20:13:20,379 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-05-13T20:13:20,382 adding 'deepspeed/ops/transformer/inference/config.py' 2023-05-13T20:13:20,385 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-05-13T20:13:20,388 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-05-13T20:13:20,391 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-05-13T20:13:20,396 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-05-13T20:13:20,399 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-05-13T20:13:20,405 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-05-13T20:13:20,409 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-05-13T20:13:20,413 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-05-13T20:13:20,415 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-05-13T20:13:20,417 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-05-13T20:13:20,420 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-05-13T20:13:20,423 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-05-13T20:13:20,425 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-05-13T20:13:20,428 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-05-13T20:13:20,443 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-05-13T20:13:20,446 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-05-13T20:13:20,448 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-05-13T20:13:20,452 adding 'deepspeed/pipe/__init__.py' 2023-05-13T20:13:20,455 adding 'deepspeed/profiling/__init__.py' 2023-05-13T20:13:20,458 adding 'deepspeed/profiling/config.py' 2023-05-13T20:13:20,460 adding 'deepspeed/profiling/constants.py' 2023-05-13T20:13:20,464 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-05-13T20:13:20,475 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-05-13T20:13:20,480 adding 'deepspeed/runtime/__init__.py' 2023-05-13T20:13:20,486 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-05-13T20:13:20,495 adding 'deepspeed/runtime/config.py' 2023-05-13T20:13:20,500 adding 'deepspeed/runtime/config_utils.py' 2023-05-13T20:13:20,504 adding 'deepspeed/runtime/constants.py' 2023-05-13T20:13:20,508 adding 'deepspeed/runtime/dataloader.py' 2023-05-13T20:13:20,511 adding 'deepspeed/runtime/eigenvalue.py' 2023-05-13T20:13:20,551 adding 'deepspeed/runtime/engine.py' 2023-05-13T20:13:20,560 adding 'deepspeed/runtime/hybrid_engine.py' 2023-05-13T20:13:20,568 adding 'deepspeed/runtime/lr_schedules.py' 2023-05-13T20:13:20,571 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-05-13T20:13:20,575 adding 'deepspeed/runtime/quantize.py' 2023-05-13T20:13:20,578 adding 'deepspeed/runtime/sparse_tensor.py' 2023-05-13T20:13:20,582 adding 'deepspeed/runtime/state_dict_factory.py' 2023-05-13T20:13:20,593 adding 'deepspeed/runtime/utils.py' 2023-05-13T20:13:20,597 adding 'deepspeed/runtime/weight_quantizer.py' 2023-05-13T20:13:20,600 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-05-13T20:13:20,609 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-05-13T20:13:20,613 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-05-13T20:13:20,616 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-05-13T20:13:20,618 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-05-13T20:13:20,621 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-05-13T20:13:20,624 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-05-13T20:13:20,628 adding 'deepspeed/runtime/comm/__init__.py' 2023-05-13T20:13:20,630 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-05-13T20:13:20,634 adding 'deepspeed/runtime/comm/mpi.py' 2023-05-13T20:13:20,638 adding 'deepspeed/runtime/comm/nccl.py' 2023-05-13T20:13:20,641 adding 'deepspeed/runtime/compression/__init__.py' 2023-05-13T20:13:20,644 adding 'deepspeed/runtime/compression/cupy.py' 2023-05-13T20:13:20,647 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-05-13T20:13:20,650 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-05-13T20:13:20,654 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-05-13T20:13:20,657 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-05-13T20:13:20,661 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-05-13T20:13:20,664 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-05-13T20:13:20,666 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-05-13T20:13:20,669 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-05-13T20:13:20,672 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-05-13T20:13:20,675 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-05-13T20:13:20,681 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-05-13T20:13:20,687 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-05-13T20:13:20,693 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-05-13T20:13:20,696 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-05-13T20:13:20,700 adding 'deepspeed/runtime/fp16/__init__.py' 2023-05-13T20:13:20,705 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-05-13T20:13:20,710 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-05-13T20:13:20,716 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-05-13T20:13:20,719 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-05-13T20:13:20,724 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-05-13T20:13:20,731 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-05-13T20:13:20,736 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-05-13T20:13:20,740 adding 'deepspeed/runtime/pipe/__init__.py' 2023-05-13T20:13:20,755 adding 'deepspeed/runtime/pipe/engine.py' 2023-05-13T20:13:20,764 adding 'deepspeed/runtime/pipe/module.py' 2023-05-13T20:13:20,768 adding 'deepspeed/runtime/pipe/p2p.py' 2023-05-13T20:13:20,772 adding 'deepspeed/runtime/pipe/schedule.py' 2023-05-13T20:13:20,778 adding 'deepspeed/runtime/pipe/topology.py' 2023-05-13T20:13:20,782 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-05-13T20:13:20,785 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-05-13T20:13:20,788 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-05-13T20:13:20,790 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-05-13T20:13:20,796 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-05-13T20:13:20,800 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-05-13T20:13:20,806 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-05-13T20:13:20,810 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-05-13T20:13:20,813 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-05-13T20:13:20,817 adding 'deepspeed/runtime/zero/__init__.py' 2023-05-13T20:13:20,821 adding 'deepspeed/runtime/zero/config.py' 2023-05-13T20:13:20,826 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-05-13T20:13:20,829 adding 'deepspeed/runtime/zero/linear.py' 2023-05-13T20:13:20,835 adding 'deepspeed/runtime/zero/mics.py' 2023-05-13T20:13:20,840 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-05-13T20:13:20,843 adding 'deepspeed/runtime/zero/offload_config.py' 2023-05-13T20:13:20,849 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-05-13T20:13:20,869 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-05-13T20:13:20,877 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-05-13T20:13:20,909 adding 'deepspeed/runtime/zero/stage3.py' 2023-05-13T20:13:20,941 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-05-13T20:13:20,946 adding 'deepspeed/runtime/zero/test.py' 2023-05-13T20:13:20,950 adding 'deepspeed/runtime/zero/tiling.py' 2023-05-13T20:13:20,954 adding 'deepspeed/runtime/zero/utils.py' 2023-05-13T20:13:20,957 adding 'deepspeed/utils/__init__.py' 2023-05-13T20:13:20,961 adding 'deepspeed/utils/comms_logging.py' 2023-05-13T20:13:20,964 adding 'deepspeed/utils/debug.py' 2023-05-13T20:13:20,966 adding 'deepspeed/utils/exceptions.py' 2023-05-13T20:13:20,971 adding 'deepspeed/utils/groups.py' 2023-05-13T20:13:20,974 adding 'deepspeed/utils/init_on_device.py' 2023-05-13T20:13:20,977 adding 'deepspeed/utils/logging.py' 2023-05-13T20:13:20,980 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-05-13T20:13:20,982 adding 'deepspeed/utils/nvtx.py' 2023-05-13T20:13:20,986 adding 'deepspeed/utils/tensor_fragment.py' 2023-05-13T20:13:20,989 adding 'deepspeed/utils/timer.py' 2023-05-13T20:13:20,992 adding 'deepspeed/utils/types.py' 2023-05-13T20:13:20,998 adding 'deepspeed/utils/zero_to_fp32.py' 2023-05-13T20:13:21,003 adding 'deepspeed-0.9.2.data/scripts/deepspeed' 2023-05-13T20:13:21,005 adding 'deepspeed-0.9.2.data/scripts/deepspeed.pt' 2023-05-13T20:13:21,008 adding 'deepspeed-0.9.2.data/scripts/ds' 2023-05-13T20:13:21,010 adding 'deepspeed-0.9.2.data/scripts/ds_bench' 2023-05-13T20:13:21,013 adding 'deepspeed-0.9.2.data/scripts/ds_elastic' 2023-05-13T20:13:21,015 adding 'deepspeed-0.9.2.data/scripts/ds_report' 2023-05-13T20:13:21,017 adding 'deepspeed-0.9.2.data/scripts/ds_ssh' 2023-05-13T20:13:21,020 adding 'deepspeed-0.9.2.data/scripts/dsr' 2023-05-13T20:13:21,027 adding 'deepspeed-0.9.2.dist-info/LICENSE' 2023-05-13T20:13:21,035 adding 'deepspeed-0.9.2.dist-info/METADATA' 2023-05-13T20:13:21,038 adding 'deepspeed-0.9.2.dist-info/WHEEL' 2023-05-13T20:13:21,040 adding 'deepspeed-0.9.2.dist-info/entry_points.txt' 2023-05-13T20:13:21,041 adding 'deepspeed-0.9.2.dist-info/top_level.txt' 2023-05-13T20:13:21,052 adding 'deepspeed-0.9.2.dist-info/RECORD' 2023-05-13T20:13:21,097 removing build/bdist.linux-armv7l/wheel 2023-05-13T20:13:21,325 deepspeed build time = 11.596287727355957 secs 2023-05-13T20:13:21,490 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-05-13T20:13:21,521 Created wheel for deepspeed: filename=deepspeed-0.9.2-py3-none-any.whl size=811178 sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 2023-05-13T20:13:21,523 Stored in directory: /tmp/pip-ephem-wheel-cache-pt83vree/wheels/5b/f6/cc/5d96e6439cad8825d346933a4ade9df56470a4959437c708a3 2023-05-13T20:13:21,589 Successfully built deepspeed 2023-05-13T20:13:21,660 Removed build tracker: '/tmp/pip-build-tracker-5qqc5_yw'