2023-12-16T01:22:25,529 Created temporary directory: /tmp/pip-build-tracker-ldre5wgi 2023-12-16T01:22:25,530 Initialized build tracking at /tmp/pip-build-tracker-ldre5wgi 2023-12-16T01:22:25,531 Created build tracker: /tmp/pip-build-tracker-ldre5wgi 2023-12-16T01:22:25,531 Entered build tracker: /tmp/pip-build-tracker-ldre5wgi 2023-12-16T01:22:25,532 Created temporary directory: /tmp/pip-wheel-dfonpmqf 2023-12-16T01:22:25,535 Created temporary directory: /tmp/pip-ephem-wheel-cache-n0a8u651 2023-12-16T01:22:25,557 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-12-16T01:22:25,560 2 location(s) to search for versions of deepspeed: 2023-12-16T01:22:25,560 * https://pypi.org/simple/deepspeed/ 2023-12-16T01:22:25,560 * https://www.piwheels.org/simple/deepspeed/ 2023-12-16T01:22:25,561 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-12-16T01:22:25,562 Getting page https://pypi.org/simple/deepspeed/ 2023-12-16T01:22:25,563 Found index url https://pypi.org/simple/ 2023-12-16T01:22:25,787 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-12-16T01:22:25,801 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-12-16T01:22:25,802 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-12-16T01:22:25,803 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-12-16T01:22:25,803 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-12-16T01:22:25,804 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-12-16T01:22:25,804 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-12-16T01:22:25,805 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-12-16T01:22:25,806 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-12-16T01:22:25,806 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-12-16T01:22:25,807 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-12-16T01:22:25,808 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-12-16T01:22:25,808 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-12-16T01:22:25,809 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-12-16T01:22:25,810 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-12-16T01:22:25,810 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-12-16T01:22:25,811 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-12-16T01:22:25,811 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-12-16T01:22:25,812 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-12-16T01:22:25,812 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-12-16T01:22:25,813 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-12-16T01:22:25,813 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-12-16T01:22:25,814 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-12-16T01:22:25,815 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-12-16T01:22:25,815 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-12-16T01:22:25,816 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-12-16T01:22:25,817 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-12-16T01:22:25,817 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-12-16T01:22:25,818 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-12-16T01:22:25,819 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-12-16T01:22:25,819 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-12-16T01:22:25,820 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-12-16T01:22:25,821 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-12-16T01:22:25,821 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-12-16T01:22:25,822 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-12-16T01:22:25,822 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-12-16T01:22:25,823 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-12-16T01:22:25,824 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-12-16T01:22:25,824 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-12-16T01:22:25,825 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-12-16T01:22:25,825 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-12-16T01:22:25,826 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-12-16T01:22:25,827 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-12-16T01:22:25,827 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-12-16T01:22:25,828 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-12-16T01:22:25,828 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-12-16T01:22:25,829 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-12-16T01:22:25,830 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-12-16T01:22:25,830 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-12-16T01:22:25,831 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-12-16T01:22:25,832 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-12-16T01:22:25,832 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-12-16T01:22:25,833 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-12-16T01:22:25,833 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-12-16T01:22:25,834 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-12-16T01:22:25,835 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-12-16T01:22:25,835 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-12-16T01:22:25,836 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-12-16T01:22:25,836 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-12-16T01:22:25,837 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-12-16T01:22:25,838 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-12-16T01:22:25,838 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-12-16T01:22:25,839 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-12-16T01:22:25,840 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-12-16T01:22:25,840 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-12-16T01:22:25,841 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-12-16T01:22:25,841 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-12-16T01:22:25,842 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-12-16T01:22:25,843 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-12-16T01:22:25,843 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2023-12-16T01:22:25,844 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2023-12-16T01:22:25,845 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2023-12-16T01:22:25,845 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2023-12-16T01:22:25,846 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2023-12-16T01:22:25,846 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2023-12-16T01:22:25,847 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2023-12-16T01:22:25,847 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2023-12-16T01:22:25,848 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2023-12-16T01:22:25,849 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2023-12-16T01:22:25,849 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2023-12-16T01:22:25,850 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2023-12-16T01:22:25,850 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2023-12-16T01:22:25,851 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2023-12-16T01:22:25,852 Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4 2023-12-16T01:22:25,852 Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5 2023-12-16T01:22:25,853 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-12-16T01:22:25,854 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-12-16T01:22:25,855 Found index url https://www.piwheels.org/simple/ 2023-12-16T01:22:26,017 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-12-16T01:22:26,031 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,032 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,032 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,033 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,033 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,034 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,034 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,035 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,035 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,036 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,036 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,037 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,037 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,038 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,038 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,039 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,039 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,040 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,040 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,041 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,041 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,042 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,042 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,042 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,043 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,043 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,044 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,044 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,045 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,045 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,046 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,046 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,047 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,047 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,048 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,048 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,049 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,049 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,049 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,050 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,050 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,051 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,051 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,052 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,053 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,053 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,054 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,054 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,055 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,055 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,055 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,056 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,056 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,057 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-12-16T01:22:26,057 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-12-16T01:22:26,058 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-12-16T01:22:26,085 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-12-16T01:22:26,103 Collecting deepspeed==0.12.5 2023-12-16T01:22:26,105 Created temporary directory: /tmp/pip-unpack-zncnpmjr 2023-12-16T01:22:26,325 Downloading deepspeed-0.12.5.tar.gz (1.2 MB) 2023-12-16T01:22:28,395 Added deepspeed==0.12.5 from https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz to build tracker '/tmp/pip-build-tracker-ldre5wgi' 2023-12-16T01:22:28,397 Running setup.py (path:/tmp/pip-wheel-dfonpmqf/deepspeed_f2bc5116a96446789dde8a808e5964ac/setup.py) egg_info for package deepspeed 2023-12-16T01:22:28,398 Created temporary directory: /tmp/pip-pip-egg-info-z_b_78bz 2023-12-16T01:22:28,399 Preparing metadata (setup.py): started 2023-12-16T01:22:28,400 Running command python setup.py egg_info 2023-12-16T01:22:29,313 fatal: not a git repository (or any of the parent directories): .git 2023-12-16T01:22:30,660 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-12-16T01:22:30,661  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-12-16T01:22:30,662 DS_BUILD_OPS=0 2023-12-16T01:22:30,662  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-12-16T01:22:30,663  [WARNING]  async_io: please install the libaio-dev package with apt 2023-12-16T01:22:30,663  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-12-16T01:22:30,664  [WARNING]  Please install torch if trying to pre-compile kernels 2023-12-16T01:22:30,664  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:30,665  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:30,665  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:30,665  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:30,666  [WARNING]  unable to import torch, please install it first 2023-12-16T01:22:30,666  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:30,667  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:30,667 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-12-16T01:22:30,668 version=0.12.5, git_hash=unknown, git_branch=unknown 2023-12-16T01:22:30,668 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2023-12-16T01:22:30,669 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-12-16T01:22:30,669 ext_modules=[] 2023-12-16T01:22:30,670 running egg_info 2023-12-16T01:22:30,670 creating /tmp/pip-pip-egg-info-z_b_78bz/deepspeed.egg-info 2023-12-16T01:22:30,691 writing /tmp/pip-pip-egg-info-z_b_78bz/deepspeed.egg-info/PKG-INFO 2023-12-16T01:22:30,721 writing dependency_links to /tmp/pip-pip-egg-info-z_b_78bz/deepspeed.egg-info/dependency_links.txt 2023-12-16T01:22:30,723 writing entry points to /tmp/pip-pip-egg-info-z_b_78bz/deepspeed.egg-info/entry_points.txt 2023-12-16T01:22:30,739 writing requirements to /tmp/pip-pip-egg-info-z_b_78bz/deepspeed.egg-info/requires.txt 2023-12-16T01:22:30,740 writing top-level names to /tmp/pip-pip-egg-info-z_b_78bz/deepspeed.egg-info/top_level.txt 2023-12-16T01:22:30,742 writing manifest file '/tmp/pip-pip-egg-info-z_b_78bz/deepspeed.egg-info/SOURCES.txt' 2023-12-16T01:22:30,943 reading manifest file '/tmp/pip-pip-egg-info-z_b_78bz/deepspeed.egg-info/SOURCES.txt' 2023-12-16T01:22:30,944 reading manifest template 'MANIFEST.in' 2023-12-16T01:22:30,946 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2023-12-16T01:22:30,947 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2023-12-16T01:22:32,239 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-12-16T01:22:32,989 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-12-16T01:22:33,416 warning: no files found matching '*.tr' under directory 'csrc' 2023-12-16T01:22:33,507 warning: no files found matching '*.cc' under directory 'csrc' 2023-12-16T01:22:33,531 warning: no files found matching '*.py' under directory 'benchmarks' 2023-12-16T01:22:33,563 writing manifest file '/tmp/pip-pip-egg-info-z_b_78bz/deepspeed.egg-info/SOURCES.txt' 2023-12-16T01:22:33,566 deepspeed build time = 4.249537467956543 secs 2023-12-16T01:22:33,678 Preparing metadata (setup.py): finished with status 'done' 2023-12-16T01:22:33,683 Source in /tmp/pip-wheel-dfonpmqf/deepspeed_f2bc5116a96446789dde8a808e5964ac has version 0.12.5, which satisfies requirement deepspeed==0.12.5 from https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz 2023-12-16T01:22:33,684 Removed deepspeed==0.12.5 from https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz from build tracker '/tmp/pip-build-tracker-ldre5wgi' 2023-12-16T01:22:33,693 Created temporary directory: /tmp/pip-unpack-oq0p35x0 2023-12-16T01:22:33,694 Created temporary directory: /tmp/pip-unpack-7qh_sbc8 2023-12-16T01:22:33,936 Building wheels for collected packages: deepspeed 2023-12-16T01:22:33,940 Created temporary directory: /tmp/pip-wheel-4c269h0w 2023-12-16T01:22:33,940 Building wheel for deepspeed (setup.py): started 2023-12-16T01:22:33,941 Destination directory: /tmp/pip-wheel-4c269h0w 2023-12-16T01:22:33,942 Running command python setup.py bdist_wheel 2023-12-16T01:22:34,361 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-12-16T01:22:34,369  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-12-16T01:22:34,426 DS_BUILD_OPS=0 2023-12-16T01:22:34,536  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-12-16T01:22:34,593  [WARNING]  async_io: please install the libaio-dev package with apt 2023-12-16T01:22:34,594  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-12-16T01:22:34,595  [WARNING]  Please install torch if trying to pre-compile kernels 2023-12-16T01:22:34,595  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:34,596  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:34,597  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:34,597  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:34,598  [WARNING]  unable to import torch, please install it first 2023-12-16T01:22:34,598  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:34,599  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-12-16T01:22:34,599 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-12-16T01:22:34,607 fatal: not a git repository (or any of the parent directories): .git 2023-12-16T01:22:34,609 version=0.12.5, git_hash=unknown, git_branch=unknown 2023-12-16T01:22:34,610 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2023-12-16T01:22:34,610 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-12-16T01:22:34,611 ext_modules=[] 2023-12-16T01:22:35,230 running bdist_wheel 2023-12-16T01:22:35,328 running build 2023-12-16T01:22:35,329 running build_py 2023-12-16T01:22:35,356 creating build 2023-12-16T01:22:35,356 creating build/lib 2023-12-16T01:22:35,357 creating build/lib/deepspeed 2023-12-16T01:22:35,358 copying deepspeed/pydantic_v1.py -> build/lib/deepspeed 2023-12-16T01:22:35,360 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-12-16T01:22:35,361 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-12-16T01:22:35,363 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-12-16T01:22:35,365 copying deepspeed/constants.py -> build/lib/deepspeed 2023-12-16T01:22:35,367 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-12-16T01:22:35,369 creating build/lib/deepspeed/elasticity 2023-12-16T01:22:35,370 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-12-16T01:22:35,372 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-12-16T01:22:35,374 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-12-16T01:22:35,376 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-12-16T01:22:35,378 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-12-16T01:22:35,380 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-12-16T01:22:35,382 creating build/lib/deepspeed/moe 2023-12-16T01:22:35,383 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-12-16T01:22:35,385 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-12-16T01:22:35,387 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-12-16T01:22:35,389 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-12-16T01:22:35,391 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-12-16T01:22:35,393 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-12-16T01:22:35,396 creating build/lib/deepspeed/inference 2023-12-16T01:22:35,397 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-12-16T01:22:35,399 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-12-16T01:22:35,402 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-12-16T01:22:35,404 creating build/lib/deepspeed/autotuning 2023-12-16T01:22:35,405 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-12-16T01:22:35,407 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-12-16T01:22:35,409 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-12-16T01:22:35,411 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-12-16T01:22:35,413 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-12-16T01:22:35,416 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-12-16T01:22:35,420 creating build/lib/deepspeed/pipe 2023-12-16T01:22:35,420 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-12-16T01:22:35,423 creating build/lib/deepspeed/monitor 2023-12-16T01:22:35,424 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-12-16T01:22:35,426 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-12-16T01:22:35,428 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-12-16T01:22:35,429 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-12-16T01:22:35,431 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-12-16T01:22:35,433 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-12-16T01:22:35,434 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-12-16T01:22:35,437 creating build/lib/deepspeed/comm 2023-12-16T01:22:35,438 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-12-16T01:22:35,439 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2023-12-16T01:22:35,441 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-12-16T01:22:35,443 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-12-16T01:22:35,445 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-12-16T01:22:35,447 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-12-16T01:22:35,449 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-12-16T01:22:35,450 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-12-16T01:22:35,453 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2023-12-16T01:22:35,455 creating build/lib/deepspeed/ops 2023-12-16T01:22:35,456 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-12-16T01:22:35,458 creating build/lib/deepspeed/model_implementations 2023-12-16T01:22:35,459 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-12-16T01:22:35,462 creating build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,462 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,465 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,467 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,469 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,471 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,474 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,475 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,477 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,479 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,481 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-12-16T01:22:35,483 creating build/lib/deepspeed/profiling 2023-12-16T01:22:35,484 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-12-16T01:22:35,486 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-12-16T01:22:35,488 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-12-16T01:22:35,490 creating build/lib/deepspeed/compression 2023-12-16T01:22:35,491 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-12-16T01:22:35,494 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-12-16T01:22:35,497 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-12-16T01:22:35,499 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-12-16T01:22:35,501 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-12-16T01:22:35,504 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-12-16T01:22:35,506 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-12-16T01:22:35,508 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-12-16T01:22:35,511 creating build/lib/deepspeed/module_inject 2023-12-16T01:22:35,512 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,515 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,517 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,519 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,521 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,523 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,525 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,527 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,528 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,530 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,533 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,534 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,536 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-12-16T01:22:35,539 creating build/lib/deepspeed/nebula 2023-12-16T01:22:35,540 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-12-16T01:22:35,542 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-12-16T01:22:35,543 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-12-16T01:22:35,546 creating build/lib/deepspeed/utils 2023-12-16T01:22:35,547 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,549 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,551 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,553 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,556 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,557 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,559 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,561 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,563 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,566 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,567 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,569 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,571 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,573 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-12-16T01:22:35,576 creating build/lib/deepspeed/launcher 2023-12-16T01:22:35,577 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-12-16T01:22:35,579 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-12-16T01:22:35,581 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-12-16T01:22:35,583 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-12-16T01:22:35,585 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-12-16T01:22:35,588 creating build/lib/deepspeed/accelerator 2023-12-16T01:22:35,589 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-16T01:22:35,592 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-16T01:22:35,594 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-16T01:22:35,596 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-12-16T01:22:35,598 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-16T01:22:35,600 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-16T01:22:35,602 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2023-12-16T01:22:35,605 creating build/lib/deepspeed/runtime 2023-12-16T01:22:35,605 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,608 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,611 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,612 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,614 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,617 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,619 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,624 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,626 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,627 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,629 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,632 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,634 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,636 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,638 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,640 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-12-16T01:22:35,643 creating build/lib/deepspeed/sequence 2023-12-16T01:22:35,644 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2023-12-16T01:22:35,646 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2023-12-16T01:22:35,648 creating build/lib/deepspeed/inference/v2 2023-12-16T01:22:35,649 copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2 2023-12-16T01:22:35,651 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2023-12-16T01:22:35,653 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2023-12-16T01:22:35,654 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2023-12-16T01:22:35,656 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2023-12-16T01:22:35,658 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2023-12-16T01:22:35,660 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2023-12-16T01:22:35,661 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2023-12-16T01:22:35,663 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2023-12-16T01:22:35,666 creating build/lib/deepspeed/inference/quantization 2023-12-16T01:22:35,667 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2023-12-16T01:22:35,669 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2023-12-16T01:22:35,671 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2023-12-16T01:22:35,673 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2023-12-16T01:22:35,675 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2023-12-16T01:22:35,677 creating build/lib/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:35,678 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:35,681 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:35,683 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:35,685 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:35,688 copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:35,690 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:35,691 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:35,694 creating build/lib/deepspeed/inference/v2/checkpoint 2023-12-16T01:22:35,695 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-12-16T01:22:35,697 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-12-16T01:22:35,698 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-12-16T01:22:35,700 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-12-16T01:22:35,702 creating build/lib/deepspeed/inference/v2/kernels 2023-12-16T01:22:35,703 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2023-12-16T01:22:35,705 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2023-12-16T01:22:35,707 creating build/lib/deepspeed/inference/v2/ragged 2023-12-16T01:22:35,708 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-16T01:22:35,710 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-16T01:22:35,712 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-16T01:22:35,714 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-16T01:22:35,716 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-16T01:22:35,718 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-16T01:22:35,720 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2023-12-16T01:22:35,723 creating build/lib/deepspeed/inference/v2/modules 2023-12-16T01:22:35,724 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2023-12-16T01:22:35,726 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2023-12-16T01:22:35,728 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2023-12-16T01:22:35,730 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2023-12-16T01:22:35,732 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-12-16T01:22:35,733 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-12-16T01:22:35,735 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-12-16T01:22:35,737 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-12-16T01:22:35,739 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-12-16T01:22:35,741 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2023-12-16T01:22:35,742 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-12-16T01:22:35,744 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-12-16T01:22:35,746 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-12-16T01:22:35,747 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-12-16T01:22:35,749 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:35,750 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:35,752 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:35,754 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:35,756 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:35,757 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:35,760 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:35,761 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:35,763 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:35,765 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:35,767 creating build/lib/deepspeed/inference/v2/model_implementations/falcon 2023-12-16T01:22:35,768 copying deepspeed/inference/v2/model_implementations/falcon/falcon_containers.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2023-12-16T01:22:35,770 copying deepspeed/inference/v2/model_implementations/falcon/falcon_policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2023-12-16T01:22:35,772 copying deepspeed/inference/v2/model_implementations/falcon/falcon_model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2023-12-16T01:22:35,774 copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2023-12-16T01:22:35,777 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:35,778 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:35,780 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:35,781 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:35,783 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:35,785 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:35,787 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:35,788 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:35,790 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:35,792 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:35,794 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-16T01:22:35,795 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-16T01:22:35,796 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-16T01:22:35,798 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-16T01:22:35,800 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-16T01:22:35,802 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2023-12-16T01:22:35,803 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2023-12-16T01:22:35,805 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-12-16T01:22:35,806 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-12-16T01:22:35,808 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-16T01:22:35,809 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-16T01:22:35,811 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:35,812 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:35,814 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:35,816 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:35,817 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:35,819 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-16T01:22:35,820 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-16T01:22:35,822 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-16T01:22:35,824 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:35,825 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:35,827 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:35,829 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:35,830 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:35,832 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:35,834 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:35,835 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:35,836 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:35,838 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:35,839 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:35,841 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:35,843 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:35,844 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:35,846 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:35,848 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:35,849 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:35,851 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:35,853 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:35,854 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:35,856 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:35,858 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:35,858 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:35,860 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:35,862 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:35,863 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:35,865 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:35,867 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:35,868 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:35,871 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:35,872 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:35,873 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:35,875 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-16T01:22:35,876 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-16T01:22:35,878 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-16T01:22:35,880 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:35,880 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:35,882 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:35,884 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:35,885 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:35,887 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:35,888 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:35,890 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:35,891 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:35,893 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:35,896 creating build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:35,896 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:35,898 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:35,900 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:35,902 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:35,903 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:35,905 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:35,907 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:35,909 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:35,911 creating build/lib/deepspeed/inference/v2/modules/implementations 2023-12-16T01:22:35,912 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2023-12-16T01:22:35,914 creating build/lib/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:35,915 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:35,917 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:35,919 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:35,920 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:35,922 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:35,923 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:35,925 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:35,927 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-12-16T01:22:35,928 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-12-16T01:22:35,930 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-12-16T01:22:35,932 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-12-16T01:22:35,933 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-12-16T01:22:35,935 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-12-16T01:22:35,938 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-12-16T01:22:35,938 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-12-16T01:22:35,940 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-12-16T01:22:35,942 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-16T01:22:35,943 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-16T01:22:35,945 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-16T01:22:35,947 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-16T01:22:35,948 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-16T01:22:35,950 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-16T01:22:35,952 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-16T01:22:35,954 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-12-16T01:22:35,955 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-12-16T01:22:35,957 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-12-16T01:22:35,959 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-12-16T01:22:35,960 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-12-16T01:22:35,962 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-12-16T01:22:35,964 creating build/lib/deepspeed/autotuning/tuner 2023-12-16T01:22:35,965 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-12-16T01:22:35,967 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-12-16T01:22:35,968 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-12-16T01:22:35,970 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-12-16T01:22:35,972 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-12-16T01:22:35,973 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-12-16T01:22:35,975 creating build/lib/deepspeed/ops/lion 2023-12-16T01:22:35,976 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2023-12-16T01:22:35,978 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2023-12-16T01:22:35,980 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2023-12-16T01:22:35,981 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2023-12-16T01:22:35,984 creating build/lib/deepspeed/ops/sparse_attention 2023-12-16T01:22:35,985 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-16T01:22:35,987 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-16T01:22:35,989 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-16T01:22:35,991 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-16T01:22:35,992 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-16T01:22:35,995 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-16T01:22:35,997 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-12-16T01:22:36,001 creating build/lib/deepspeed/ops/aio 2023-12-16T01:22:36,002 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-12-16T01:22:36,004 creating build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,005 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,008 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,009 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,011 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,013 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,014 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,016 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,018 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,020 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,021 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,023 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,025 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,026 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,028 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,030 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,032 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,033 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,035 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,037 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,039 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,040 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,042 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-12-16T01:22:36,044 creating build/lib/deepspeed/ops/deepspeed4science 2023-12-16T01:22:36,045 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2023-12-16T01:22:36,047 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2023-12-16T01:22:36,049 creating build/lib/deepspeed/ops/quantizer 2023-12-16T01:22:36,050 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-12-16T01:22:36,052 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-12-16T01:22:36,054 creating build/lib/deepspeed/ops/adagrad 2023-12-16T01:22:36,055 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-12-16T01:22:36,057 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-12-16T01:22:36,060 creating build/lib/deepspeed/ops/adam 2023-12-16T01:22:36,061 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-12-16T01:22:36,063 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-12-16T01:22:36,065 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-12-16T01:22:36,066 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-12-16T01:22:36,069 creating build/lib/deepspeed/ops/random_ltd 2023-12-16T01:22:36,070 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-12-16T01:22:36,072 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-12-16T01:22:36,075 creating build/lib/deepspeed/ops/transformer 2023-12-16T01:22:36,076 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-12-16T01:22:36,078 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-12-16T01:22:36,080 creating build/lib/deepspeed/ops/lamb 2023-12-16T01:22:36,081 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-12-16T01:22:36,083 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-12-16T01:22:36,087 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-12-16T01:22:36,088 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-12-16T01:22:36,090 creating build/lib/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:36,091 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:36,093 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:36,095 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:36,097 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:36,099 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:36,100 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:36,103 creating build/lib/deepspeed/ops/op_builder/npu 2023-12-16T01:22:36,104 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-16T01:22:36,106 copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-16T01:22:36,108 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-16T01:22:36,109 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-16T01:22:36,111 copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-16T01:22:36,113 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-16T01:22:36,115 copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2023-12-16T01:22:36,117 creating build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,118 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,121 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,123 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,124 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,127 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,129 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,131 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,133 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,135 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,137 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-12-16T01:22:36,140 creating build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,141 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,143 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,145 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,147 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,150 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,152 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,154 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,157 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,159 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,161 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:36,164 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,165 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,167 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,169 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,171 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,173 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,175 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,177 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,179 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,180 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,182 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:36,185 creating build/lib/deepspeed/model_implementations/diffusers 2023-12-16T01:22:36,186 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-12-16T01:22:36,188 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-12-16T01:22:36,189 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-12-16T01:22:36,192 creating build/lib/deepspeed/model_implementations/features 2023-12-16T01:22:36,193 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-12-16T01:22:36,195 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-12-16T01:22:36,197 creating build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,198 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,200 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,202 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,204 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,205 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,208 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,210 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,211 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,213 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,215 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-12-16T01:22:36,218 creating build/lib/deepspeed/profiling/flops_profiler 2023-12-16T01:22:36,219 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-12-16T01:22:36,222 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-12-16T01:22:36,225 creating build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,225 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,228 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,230 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,232 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,234 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,236 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,238 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,240 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,242 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,244 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,246 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,248 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,250 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,252 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,254 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,256 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,258 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,260 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,262 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-12-16T01:22:36,265 creating build/lib/deepspeed/module_inject/containers/features 2023-12-16T01:22:36,266 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-16T01:22:36,268 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-16T01:22:36,270 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-16T01:22:36,272 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-16T01:22:36,274 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-16T01:22:36,276 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-16T01:22:36,278 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2023-12-16T01:22:36,281 creating build/lib/deepspeed/runtime/fp16 2023-12-16T01:22:36,282 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-12-16T01:22:36,285 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-12-16T01:22:36,287 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-12-16T01:22:36,290 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-12-16T01:22:36,292 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-12-16T01:22:36,293 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-12-16T01:22:36,295 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-12-16T01:22:36,298 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-12-16T01:22:36,300 creating build/lib/deepspeed/runtime/swap_tensor 2023-12-16T01:22:36,301 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-16T01:22:36,303 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-16T01:22:36,306 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-16T01:22:36,308 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-16T01:22:36,310 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-16T01:22:36,312 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-16T01:22:36,315 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-16T01:22:36,316 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-16T01:22:36,319 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-12-16T01:22:36,321 creating build/lib/deepspeed/runtime/pipe 2023-12-16T01:22:36,322 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-12-16T01:22:36,325 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-12-16T01:22:36,328 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-12-16T01:22:36,330 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-12-16T01:22:36,332 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-12-16T01:22:36,335 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-12-16T01:22:36,338 creating build/lib/deepspeed/runtime/comm 2023-12-16T01:22:36,339 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-12-16T01:22:36,341 copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm 2023-12-16T01:22:36,343 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-12-16T01:22:36,346 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-12-16T01:22:36,347 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-12-16T01:22:36,350 creating build/lib/deepspeed/runtime/data_pipeline 2023-12-16T01:22:36,351 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-12-16T01:22:36,354 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-12-16T01:22:36,356 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-12-16T01:22:36,358 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-12-16T01:22:36,361 creating build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,362 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,365 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,367 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,369 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,372 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,374 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,376 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,378 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,382 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,384 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,386 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,390 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,394 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,396 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,398 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,400 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-12-16T01:22:36,402 creating build/lib/deepspeed/runtime/compression 2023-12-16T01:22:36,404 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-12-16T01:22:36,405 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-12-16T01:22:36,408 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-12-16T01:22:36,409 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-12-16T01:22:36,411 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-12-16T01:22:36,413 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-12-16T01:22:36,414 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-12-16T01:22:36,417 creating build/lib/deepspeed/runtime/fp16/onebit 2023-12-16T01:22:36,418 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-12-16T01:22:36,421 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-12-16T01:22:36,423 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-12-16T01:22:36,426 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-12-16T01:22:36,428 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:36,429 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:36,432 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:36,434 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:36,436 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:36,438 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:36,440 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:36,442 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:36,444 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:36,447 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:36,449 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:36,450 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:36,454 running egg_info 2023-12-16T01:22:36,503 writing deepspeed.egg-info/PKG-INFO 2023-12-16T01:22:36,533 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-12-16T01:22:36,535 writing entry points to deepspeed.egg-info/entry_points.txt 2023-12-16T01:22:36,550 writing requirements to deepspeed.egg-info/requires.txt 2023-12-16T01:22:36,551 writing top-level names to deepspeed.egg-info/top_level.txt 2023-12-16T01:22:36,658 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-12-16T01:22:36,685 reading manifest template 'MANIFEST.in' 2023-12-16T01:22:36,686 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2023-12-16T01:22:36,687 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2023-12-16T01:22:37,726 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-12-16T01:22:38,453 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-12-16T01:22:38,896 warning: no files found matching '*.tr' under directory 'csrc' 2023-12-16T01:22:38,987 warning: no files found matching '*.cc' under directory 'csrc' 2023-12-16T01:22:39,010 warning: no files found matching '*.py' under directory 'benchmarks' 2023-12-16T01:22:39,053 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-12-16T01:22:39,060 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-12-16T01:22:39,061 !! 2023-12-16T01:22:39,062 ******************************************************************************** 2023-12-16T01:22:39,062 ############################ 2023-12-16T01:22:39,063 # Package would be ignored # 2023-12-16T01:22:39,064 ############################ 2023-12-16T01:22:39,064 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-12-16T01:22:39,065 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,066 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,066 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-12-16T01:22:39,067 to the `packages` configuration field. 2023-12-16T01:22:39,068 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,068 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,069 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,070 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,071 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,072 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-12-16T01:22:39,073 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-12-16T01:22:39,073 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,074 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,075 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,076 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,077 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,078 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,078 even if it does not contain any `.py` files. 2023-12-16T01:22:39,078 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,079 directory, all directories are treated like packages. 2023-12-16T01:22:39,079 ******************************************************************************** 2023-12-16T01:22:39,080 !! 2023-12-16T01:22:39,080 check.warn(importable) 2023-12-16T01:22:39,080 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2023-12-16T01:22:39,081 !! 2023-12-16T01:22:39,082 ******************************************************************************** 2023-12-16T01:22:39,082 ############################ 2023-12-16T01:22:39,082 # Package would be ignored # 2023-12-16T01:22:39,083 ############################ 2023-12-16T01:22:39,083 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2023-12-16T01:22:39,084 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,084 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,085 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2023-12-16T01:22:39,085 to the `packages` configuration field. 2023-12-16T01:22:39,086 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,087 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,087 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,088 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,089 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,090 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2023-12-16T01:22:39,090 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2023-12-16T01:22:39,090 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,091 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,092 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,092 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,093 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,095 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,095 even if it does not contain any `.py` files. 2023-12-16T01:22:39,096 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,096 directory, all directories are treated like packages. 2023-12-16T01:22:39,097 ******************************************************************************** 2023-12-16T01:22:39,098 !! 2023-12-16T01:22:39,098 check.warn(importable) 2023-12-16T01:22:39,099 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2023-12-16T01:22:39,099 !! 2023-12-16T01:22:39,100 ******************************************************************************** 2023-12-16T01:22:39,100 ############################ 2023-12-16T01:22:39,101 # Package would be ignored # 2023-12-16T01:22:39,101 ############################ 2023-12-16T01:22:39,101 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2023-12-16T01:22:39,102 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,102 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,102 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2023-12-16T01:22:39,103 to the `packages` configuration field. 2023-12-16T01:22:39,103 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,104 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,104 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,105 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,106 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,106 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2023-12-16T01:22:39,107 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2023-12-16T01:22:39,107 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,107 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,108 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,109 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,110 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,111 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,112 even if it does not contain any `.py` files. 2023-12-16T01:22:39,112 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,112 directory, all directories are treated like packages. 2023-12-16T01:22:39,113 ******************************************************************************** 2023-12-16T01:22:39,114 !! 2023-12-16T01:22:39,115 check.warn(importable) 2023-12-16T01:22:39,115 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2023-12-16T01:22:39,116 !! 2023-12-16T01:22:39,117 ******************************************************************************** 2023-12-16T01:22:39,117 ############################ 2023-12-16T01:22:39,117 # Package would be ignored # 2023-12-16T01:22:39,118 ############################ 2023-12-16T01:22:39,118 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2023-12-16T01:22:39,119 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,120 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,120 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2023-12-16T01:22:39,120 to the `packages` configuration field. 2023-12-16T01:22:39,121 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,122 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,122 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,123 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,124 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,125 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2023-12-16T01:22:39,125 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2023-12-16T01:22:39,125 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,125 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,126 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,126 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,127 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,128 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,129 even if it does not contain any `.py` files. 2023-12-16T01:22:39,129 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,129 directory, all directories are treated like packages. 2023-12-16T01:22:39,130 ******************************************************************************** 2023-12-16T01:22:39,130 !! 2023-12-16T01:22:39,131 check.warn(importable) 2023-12-16T01:22:39,131 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2023-12-16T01:22:39,131 !! 2023-12-16T01:22:39,132 ******************************************************************************** 2023-12-16T01:22:39,133 ############################ 2023-12-16T01:22:39,133 # Package would be ignored # 2023-12-16T01:22:39,133 ############################ 2023-12-16T01:22:39,134 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2023-12-16T01:22:39,134 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,135 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,136 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2023-12-16T01:22:39,136 to the `packages` configuration field. 2023-12-16T01:22:39,137 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,138 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,138 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,139 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,140 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,140 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2023-12-16T01:22:39,141 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2023-12-16T01:22:39,141 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,142 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,142 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,143 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,144 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,146 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,147 even if it does not contain any `.py` files. 2023-12-16T01:22:39,148 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,148 directory, all directories are treated like packages. 2023-12-16T01:22:39,149 ******************************************************************************** 2023-12-16T01:22:39,149 !! 2023-12-16T01:22:39,150 check.warn(importable) 2023-12-16T01:22:39,150 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2023-12-16T01:22:39,150 !! 2023-12-16T01:22:39,151 ******************************************************************************** 2023-12-16T01:22:39,151 ############################ 2023-12-16T01:22:39,152 # Package would be ignored # 2023-12-16T01:22:39,152 ############################ 2023-12-16T01:22:39,152 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2023-12-16T01:22:39,153 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,154 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,154 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2023-12-16T01:22:39,154 to the `packages` configuration field. 2023-12-16T01:22:39,155 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,155 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,156 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,157 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,158 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,159 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2023-12-16T01:22:39,159 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2023-12-16T01:22:39,159 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,160 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,160 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,161 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,162 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,164 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,164 even if it does not contain any `.py` files. 2023-12-16T01:22:39,164 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,165 directory, all directories are treated like packages. 2023-12-16T01:22:39,165 ******************************************************************************** 2023-12-16T01:22:39,166 !! 2023-12-16T01:22:39,166 check.warn(importable) 2023-12-16T01:22:39,167 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-12-16T01:22:39,168 !! 2023-12-16T01:22:39,168 ******************************************************************************** 2023-12-16T01:22:39,169 ############################ 2023-12-16T01:22:39,169 # Package would be ignored # 2023-12-16T01:22:39,170 ############################ 2023-12-16T01:22:39,170 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-12-16T01:22:39,171 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,172 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,173 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-12-16T01:22:39,173 to the `packages` configuration field. 2023-12-16T01:22:39,174 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,174 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,174 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,175 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,176 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,176 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-12-16T01:22:39,177 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-12-16T01:22:39,177 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,177 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,178 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,178 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,179 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,180 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,180 even if it does not contain any `.py` files. 2023-12-16T01:22:39,181 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,181 directory, all directories are treated like packages. 2023-12-16T01:22:39,182 ******************************************************************************** 2023-12-16T01:22:39,182 !! 2023-12-16T01:22:39,183 check.warn(importable) 2023-12-16T01:22:39,184 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-12-16T01:22:39,184 !! 2023-12-16T01:22:39,185 ******************************************************************************** 2023-12-16T01:22:39,185 ############################ 2023-12-16T01:22:39,186 # Package would be ignored # 2023-12-16T01:22:39,186 ############################ 2023-12-16T01:22:39,187 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-12-16T01:22:39,188 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,188 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,189 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-12-16T01:22:39,189 to the `packages` configuration field. 2023-12-16T01:22:39,190 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,191 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,191 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,192 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,193 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,194 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-12-16T01:22:39,194 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-12-16T01:22:39,195 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,195 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,196 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,197 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,197 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,198 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,198 even if it does not contain any `.py` files. 2023-12-16T01:22:39,199 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,199 directory, all directories are treated like packages. 2023-12-16T01:22:39,200 ******************************************************************************** 2023-12-16T01:22:39,200 !! 2023-12-16T01:22:39,201 check.warn(importable) 2023-12-16T01:22:39,201 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-12-16T01:22:39,201 !! 2023-12-16T01:22:39,202 ******************************************************************************** 2023-12-16T01:22:39,202 ############################ 2023-12-16T01:22:39,203 # Package would be ignored # 2023-12-16T01:22:39,203 ############################ 2023-12-16T01:22:39,203 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-12-16T01:22:39,204 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,204 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,205 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-12-16T01:22:39,206 to the `packages` configuration field. 2023-12-16T01:22:39,207 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,207 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,208 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,209 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,210 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,211 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-12-16T01:22:39,211 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-12-16T01:22:39,212 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,212 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,213 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,214 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,215 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,216 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,217 even if it does not contain any `.py` files. 2023-12-16T01:22:39,217 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,218 directory, all directories are treated like packages. 2023-12-16T01:22:39,218 ******************************************************************************** 2023-12-16T01:22:39,219 !! 2023-12-16T01:22:39,220 check.warn(importable) 2023-12-16T01:22:39,220 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-12-16T01:22:39,221 !! 2023-12-16T01:22:39,222 ******************************************************************************** 2023-12-16T01:22:39,222 ############################ 2023-12-16T01:22:39,223 # Package would be ignored # 2023-12-16T01:22:39,223 ############################ 2023-12-16T01:22:39,224 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-12-16T01:22:39,224 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,225 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,225 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-12-16T01:22:39,225 to the `packages` configuration field. 2023-12-16T01:22:39,226 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,226 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,227 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,227 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,228 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,229 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-12-16T01:22:39,229 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-12-16T01:22:39,229 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,230 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,230 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,231 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,232 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,234 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,234 even if it does not contain any `.py` files. 2023-12-16T01:22:39,235 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,235 directory, all directories are treated like packages. 2023-12-16T01:22:39,236 ******************************************************************************** 2023-12-16T01:22:39,237 !! 2023-12-16T01:22:39,238 check.warn(importable) 2023-12-16T01:22:39,238 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-12-16T01:22:39,239 !! 2023-12-16T01:22:39,240 ******************************************************************************** 2023-12-16T01:22:39,240 ############################ 2023-12-16T01:22:39,241 # Package would be ignored # 2023-12-16T01:22:39,241 ############################ 2023-12-16T01:22:39,242 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-12-16T01:22:39,242 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,243 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,244 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-12-16T01:22:39,245 to the `packages` configuration field. 2023-12-16T01:22:39,246 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,246 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,247 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,248 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,249 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,250 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-12-16T01:22:39,251 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-12-16T01:22:39,251 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,252 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,252 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,253 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,254 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,255 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,256 even if it does not contain any `.py` files. 2023-12-16T01:22:39,256 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,257 directory, all directories are treated like packages. 2023-12-16T01:22:39,257 ******************************************************************************** 2023-12-16T01:22:39,258 !! 2023-12-16T01:22:39,259 check.warn(importable) 2023-12-16T01:22:39,259 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-12-16T01:22:39,260 !! 2023-12-16T01:22:39,261 ******************************************************************************** 2023-12-16T01:22:39,261 ############################ 2023-12-16T01:22:39,262 # Package would be ignored # 2023-12-16T01:22:39,262 ############################ 2023-12-16T01:22:39,263 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-12-16T01:22:39,263 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,264 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,265 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-12-16T01:22:39,265 to the `packages` configuration field. 2023-12-16T01:22:39,266 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,267 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,267 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,268 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,269 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,271 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-12-16T01:22:39,271 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-12-16T01:22:39,272 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,272 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,273 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,274 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,275 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,277 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,277 even if it does not contain any `.py` files. 2023-12-16T01:22:39,278 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,278 directory, all directories are treated like packages. 2023-12-16T01:22:39,279 ******************************************************************************** 2023-12-16T01:22:39,280 !! 2023-12-16T01:22:39,280 check.warn(importable) 2023-12-16T01:22:39,281 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2023-12-16T01:22:39,281 !! 2023-12-16T01:22:39,282 ******************************************************************************** 2023-12-16T01:22:39,283 ############################ 2023-12-16T01:22:39,283 # Package would be ignored # 2023-12-16T01:22:39,283 ############################ 2023-12-16T01:22:39,284 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2023-12-16T01:22:39,284 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,285 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,286 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2023-12-16T01:22:39,286 to the `packages` configuration field. 2023-12-16T01:22:39,287 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,288 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,288 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,289 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,290 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,291 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2023-12-16T01:22:39,292 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2023-12-16T01:22:39,293 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,293 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,294 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,295 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,296 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,298 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,298 even if it does not contain any `.py` files. 2023-12-16T01:22:39,299 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,300 directory, all directories are treated like packages. 2023-12-16T01:22:39,300 ******************************************************************************** 2023-12-16T01:22:39,302 !! 2023-12-16T01:22:39,302 check.warn(importable) 2023-12-16T01:22:39,303 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2023-12-16T01:22:39,304 !! 2023-12-16T01:22:39,305 ******************************************************************************** 2023-12-16T01:22:39,306 ############################ 2023-12-16T01:22:39,306 # Package would be ignored # 2023-12-16T01:22:39,307 ############################ 2023-12-16T01:22:39,308 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2023-12-16T01:22:39,308 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,309 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,310 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2023-12-16T01:22:39,311 to the `packages` configuration field. 2023-12-16T01:22:39,312 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,313 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,313 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,314 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,315 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,316 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2023-12-16T01:22:39,317 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2023-12-16T01:22:39,317 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,318 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,318 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,319 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,321 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,322 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,323 even if it does not contain any `.py` files. 2023-12-16T01:22:39,323 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,324 directory, all directories are treated like packages. 2023-12-16T01:22:39,325 ******************************************************************************** 2023-12-16T01:22:39,326 !! 2023-12-16T01:22:39,326 check.warn(importable) 2023-12-16T01:22:39,327 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2023-12-16T01:22:39,328 !! 2023-12-16T01:22:39,329 ******************************************************************************** 2023-12-16T01:22:39,329 ############################ 2023-12-16T01:22:39,330 # Package would be ignored # 2023-12-16T01:22:39,330 ############################ 2023-12-16T01:22:39,331 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2023-12-16T01:22:39,332 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,333 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,333 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2023-12-16T01:22:39,334 to the `packages` configuration field. 2023-12-16T01:22:39,335 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,335 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,336 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,337 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,338 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,339 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2023-12-16T01:22:39,340 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2023-12-16T01:22:39,340 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,341 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,341 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,342 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,343 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,345 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,345 even if it does not contain any `.py` files. 2023-12-16T01:22:39,346 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,346 directory, all directories are treated like packages. 2023-12-16T01:22:39,347 ******************************************************************************** 2023-12-16T01:22:39,348 !! 2023-12-16T01:22:39,348 check.warn(importable) 2023-12-16T01:22:39,348 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2023-12-16T01:22:39,349 !! 2023-12-16T01:22:39,350 ******************************************************************************** 2023-12-16T01:22:39,350 ############################ 2023-12-16T01:22:39,351 # Package would be ignored # 2023-12-16T01:22:39,351 ############################ 2023-12-16T01:22:39,352 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2023-12-16T01:22:39,352 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,353 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,354 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2023-12-16T01:22:39,354 to the `packages` configuration field. 2023-12-16T01:22:39,355 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,356 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,356 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,357 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,358 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,359 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2023-12-16T01:22:39,360 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2023-12-16T01:22:39,360 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,361 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,361 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,362 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,363 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,365 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,365 even if it does not contain any `.py` files. 2023-12-16T01:22:39,366 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,366 directory, all directories are treated like packages. 2023-12-16T01:22:39,367 ******************************************************************************** 2023-12-16T01:22:39,368 !! 2023-12-16T01:22:39,368 check.warn(importable) 2023-12-16T01:22:39,369 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2023-12-16T01:22:39,369 !! 2023-12-16T01:22:39,370 ******************************************************************************** 2023-12-16T01:22:39,371 ############################ 2023-12-16T01:22:39,372 # Package would be ignored # 2023-12-16T01:22:39,372 ############################ 2023-12-16T01:22:39,373 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2023-12-16T01:22:39,374 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,375 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,376 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2023-12-16T01:22:39,377 to the `packages` configuration field. 2023-12-16T01:22:39,378 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,378 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,379 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,380 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,381 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,382 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2023-12-16T01:22:39,382 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2023-12-16T01:22:39,383 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,383 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,384 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,385 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,386 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,388 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,388 even if it does not contain any `.py` files. 2023-12-16T01:22:39,389 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,389 directory, all directories are treated like packages. 2023-12-16T01:22:39,390 ******************************************************************************** 2023-12-16T01:22:39,391 !! 2023-12-16T01:22:39,392 check.warn(importable) 2023-12-16T01:22:39,392 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2023-12-16T01:22:39,393 !! 2023-12-16T01:22:39,395 ******************************************************************************** 2023-12-16T01:22:39,396 ############################ 2023-12-16T01:22:39,396 # Package would be ignored # 2023-12-16T01:22:39,397 ############################ 2023-12-16T01:22:39,398 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2023-12-16T01:22:39,399 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,401 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,403 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2023-12-16T01:22:39,404 to the `packages` configuration field. 2023-12-16T01:22:39,406 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,407 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,408 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,410 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,412 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,415 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2023-12-16T01:22:39,416 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2023-12-16T01:22:39,417 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,418 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,420 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,422 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,424 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,427 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,427 even if it does not contain any `.py` files. 2023-12-16T01:22:39,428 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,429 directory, all directories are treated like packages. 2023-12-16T01:22:39,430 ******************************************************************************** 2023-12-16T01:22:39,432 !! 2023-12-16T01:22:39,433 check.warn(importable) 2023-12-16T01:22:39,434 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2023-12-16T01:22:39,435 !! 2023-12-16T01:22:39,438 ******************************************************************************** 2023-12-16T01:22:39,438 ############################ 2023-12-16T01:22:39,439 # Package would be ignored # 2023-12-16T01:22:39,440 ############################ 2023-12-16T01:22:39,442 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2023-12-16T01:22:39,442 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,444 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,444 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2023-12-16T01:22:39,445 to the `packages` configuration field. 2023-12-16T01:22:39,446 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,447 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,448 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,450 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,452 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,453 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2023-12-16T01:22:39,454 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2023-12-16T01:22:39,455 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,456 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,457 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,459 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,461 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,464 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,465 even if it does not contain any `.py` files. 2023-12-16T01:22:39,466 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,468 directory, all directories are treated like packages. 2023-12-16T01:22:39,468 ******************************************************************************** 2023-12-16T01:22:39,469 !! 2023-12-16T01:22:39,469 check.warn(importable) 2023-12-16T01:22:39,470 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2023-12-16T01:22:39,470 !! 2023-12-16T01:22:39,471 ******************************************************************************** 2023-12-16T01:22:39,472 ############################ 2023-12-16T01:22:39,472 # Package would be ignored # 2023-12-16T01:22:39,473 ############################ 2023-12-16T01:22:39,474 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2023-12-16T01:22:39,474 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,476 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,476 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2023-12-16T01:22:39,477 to the `packages` configuration field. 2023-12-16T01:22:39,478 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,479 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,480 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,481 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,482 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,484 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2023-12-16T01:22:39,485 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2023-12-16T01:22:39,485 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,486 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,487 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,490 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,492 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,497 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,498 even if it does not contain any `.py` files. 2023-12-16T01:22:39,499 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,500 directory, all directories are treated like packages. 2023-12-16T01:22:39,502 ******************************************************************************** 2023-12-16T01:22:39,504 !! 2023-12-16T01:22:39,505 check.warn(importable) 2023-12-16T01:22:39,507 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-12-16T01:22:39,508 !! 2023-12-16T01:22:39,511 ******************************************************************************** 2023-12-16T01:22:39,512 ############################ 2023-12-16T01:22:39,514 # Package would be ignored # 2023-12-16T01:22:39,515 ############################ 2023-12-16T01:22:39,516 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-12-16T01:22:39,518 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,521 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,522 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-12-16T01:22:39,523 to the `packages` configuration field. 2023-12-16T01:22:39,524 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,525 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,526 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,528 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,530 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,532 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-12-16T01:22:39,533 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-12-16T01:22:39,534 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,535 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,537 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,539 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,541 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,545 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,546 even if it does not contain any `.py` files. 2023-12-16T01:22:39,547 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,549 directory, all directories are treated like packages. 2023-12-16T01:22:39,549 ******************************************************************************** 2023-12-16T01:22:39,550 !! 2023-12-16T01:22:39,551 check.warn(importable) 2023-12-16T01:22:39,551 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-12-16T01:22:39,552 !! 2023-12-16T01:22:39,553 ******************************************************************************** 2023-12-16T01:22:39,553 ############################ 2023-12-16T01:22:39,554 # Package would be ignored # 2023-12-16T01:22:39,554 ############################ 2023-12-16T01:22:39,555 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-12-16T01:22:39,555 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,556 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,557 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-12-16T01:22:39,557 to the `packages` configuration field. 2023-12-16T01:22:39,558 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,559 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,560 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,561 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,562 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,563 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-12-16T01:22:39,564 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-12-16T01:22:39,564 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,565 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,565 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,566 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,567 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,569 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,569 even if it does not contain any `.py` files. 2023-12-16T01:22:39,570 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,570 directory, all directories are treated like packages. 2023-12-16T01:22:39,571 ******************************************************************************** 2023-12-16T01:22:39,572 !! 2023-12-16T01:22:39,572 check.warn(importable) 2023-12-16T01:22:39,573 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2023-12-16T01:22:39,573 !! 2023-12-16T01:22:39,575 ******************************************************************************** 2023-12-16T01:22:39,575 ############################ 2023-12-16T01:22:39,576 # Package would be ignored # 2023-12-16T01:22:39,576 ############################ 2023-12-16T01:22:39,577 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2023-12-16T01:22:39,578 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,579 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,580 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2023-12-16T01:22:39,580 to the `packages` configuration field. 2023-12-16T01:22:39,582 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,583 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,584 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,585 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,586 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,588 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2023-12-16T01:22:39,589 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2023-12-16T01:22:39,589 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,590 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,591 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,592 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,593 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,594 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,595 even if it does not contain any `.py` files. 2023-12-16T01:22:39,595 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,596 directory, all directories are treated like packages. 2023-12-16T01:22:39,596 ******************************************************************************** 2023-12-16T01:22:39,598 !! 2023-12-16T01:22:39,598 check.warn(importable) 2023-12-16T01:22:39,599 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-12-16T01:22:39,599 !! 2023-12-16T01:22:39,600 ******************************************************************************** 2023-12-16T01:22:39,601 ############################ 2023-12-16T01:22:39,601 # Package would be ignored # 2023-12-16T01:22:39,602 ############################ 2023-12-16T01:22:39,602 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-12-16T01:22:39,603 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,604 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,604 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-12-16T01:22:39,604 to the `packages` configuration field. 2023-12-16T01:22:39,605 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,606 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,606 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,607 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,608 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,609 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-12-16T01:22:39,609 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-12-16T01:22:39,610 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,610 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,611 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,612 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,613 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,614 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,615 even if it does not contain any `.py` files. 2023-12-16T01:22:39,615 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,616 directory, all directories are treated like packages. 2023-12-16T01:22:39,616 ******************************************************************************** 2023-12-16T01:22:39,617 !! 2023-12-16T01:22:39,618 check.warn(importable) 2023-12-16T01:22:39,618 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-12-16T01:22:39,619 !! 2023-12-16T01:22:39,620 ******************************************************************************** 2023-12-16T01:22:39,620 ############################ 2023-12-16T01:22:39,620 # Package would be ignored # 2023-12-16T01:22:39,621 ############################ 2023-12-16T01:22:39,622 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-12-16T01:22:39,622 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,623 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,624 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-12-16T01:22:39,624 to the `packages` configuration field. 2023-12-16T01:22:39,625 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,626 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,626 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,627 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,629 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,630 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-12-16T01:22:39,630 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-12-16T01:22:39,630 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,631 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,631 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,632 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,633 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,634 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,635 even if it does not contain any `.py` files. 2023-12-16T01:22:39,635 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,636 directory, all directories are treated like packages. 2023-12-16T01:22:39,636 ******************************************************************************** 2023-12-16T01:22:39,637 !! 2023-12-16T01:22:39,637 check.warn(importable) 2023-12-16T01:22:39,638 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-12-16T01:22:39,638 !! 2023-12-16T01:22:39,642 ******************************************************************************** 2023-12-16T01:22:39,643 ############################ 2023-12-16T01:22:39,643 # Package would be ignored # 2023-12-16T01:22:39,644 ############################ 2023-12-16T01:22:39,644 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-12-16T01:22:39,645 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,646 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,646 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-12-16T01:22:39,647 to the `packages` configuration field. 2023-12-16T01:22:39,648 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,648 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,649 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,650 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,651 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,652 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-12-16T01:22:39,652 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-12-16T01:22:39,653 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,653 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,654 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,655 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,656 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,657 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,657 even if it does not contain any `.py` files. 2023-12-16T01:22:39,658 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,658 directory, all directories are treated like packages. 2023-12-16T01:22:39,659 ******************************************************************************** 2023-12-16T01:22:39,660 !! 2023-12-16T01:22:39,660 check.warn(importable) 2023-12-16T01:22:39,661 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-12-16T01:22:39,661 !! 2023-12-16T01:22:39,662 ******************************************************************************** 2023-12-16T01:22:39,662 ############################ 2023-12-16T01:22:39,663 # Package would be ignored # 2023-12-16T01:22:39,663 ############################ 2023-12-16T01:22:39,663 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-12-16T01:22:39,664 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,665 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,665 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-12-16T01:22:39,665 to the `packages` configuration field. 2023-12-16T01:22:39,666 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,667 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,667 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,668 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,669 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,670 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-12-16T01:22:39,670 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-12-16T01:22:39,671 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,671 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,672 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,673 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,674 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,675 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,676 even if it does not contain any `.py` files. 2023-12-16T01:22:39,676 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,677 directory, all directories are treated like packages. 2023-12-16T01:22:39,677 ******************************************************************************** 2023-12-16T01:22:39,678 !! 2023-12-16T01:22:39,678 check.warn(importable) 2023-12-16T01:22:39,679 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-12-16T01:22:39,679 !! 2023-12-16T01:22:39,680 ******************************************************************************** 2023-12-16T01:22:39,681 ############################ 2023-12-16T01:22:39,681 # Package would be ignored # 2023-12-16T01:22:39,682 ############################ 2023-12-16T01:22:39,682 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-12-16T01:22:39,683 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,684 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,684 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-12-16T01:22:39,685 to the `packages` configuration field. 2023-12-16T01:22:39,686 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,686 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,687 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,688 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,688 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,689 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-12-16T01:22:39,690 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-12-16T01:22:39,690 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,690 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,691 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,692 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,693 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,694 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,695 even if it does not contain any `.py` files. 2023-12-16T01:22:39,695 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,696 directory, all directories are treated like packages. 2023-12-16T01:22:39,696 ******************************************************************************** 2023-12-16T01:22:39,697 !! 2023-12-16T01:22:39,698 check.warn(importable) 2023-12-16T01:22:39,698 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-12-16T01:22:39,698 !! 2023-12-16T01:22:39,699 ******************************************************************************** 2023-12-16T01:22:39,700 ############################ 2023-12-16T01:22:39,700 # Package would be ignored # 2023-12-16T01:22:39,701 ############################ 2023-12-16T01:22:39,701 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-12-16T01:22:39,702 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,702 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,703 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-12-16T01:22:39,704 to the `packages` configuration field. 2023-12-16T01:22:39,705 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,705 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,706 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,707 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,708 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,709 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-12-16T01:22:39,709 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-12-16T01:22:39,709 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,710 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,710 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,711 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,712 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,713 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,714 even if it does not contain any `.py` files. 2023-12-16T01:22:39,714 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,715 directory, all directories are treated like packages. 2023-12-16T01:22:39,715 ******************************************************************************** 2023-12-16T01:22:39,716 !! 2023-12-16T01:22:39,717 check.warn(importable) 2023-12-16T01:22:39,717 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-12-16T01:22:39,717 !! 2023-12-16T01:22:39,718 ******************************************************************************** 2023-12-16T01:22:39,719 ############################ 2023-12-16T01:22:39,719 # Package would be ignored # 2023-12-16T01:22:39,720 ############################ 2023-12-16T01:22:39,720 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-12-16T01:22:39,721 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,722 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,722 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-12-16T01:22:39,722 to the `packages` configuration field. 2023-12-16T01:22:39,723 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,724 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,724 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,725 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,726 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,727 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-12-16T01:22:39,728 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-12-16T01:22:39,728 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,728 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,729 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,730 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,731 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,733 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,733 even if it does not contain any `.py` files. 2023-12-16T01:22:39,734 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,734 directory, all directories are treated like packages. 2023-12-16T01:22:39,735 ******************************************************************************** 2023-12-16T01:22:39,736 !! 2023-12-16T01:22:39,736 check.warn(importable) 2023-12-16T01:22:39,737 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-12-16T01:22:39,737 !! 2023-12-16T01:22:39,738 ******************************************************************************** 2023-12-16T01:22:39,739 ############################ 2023-12-16T01:22:39,739 # Package would be ignored # 2023-12-16T01:22:39,740 ############################ 2023-12-16T01:22:39,740 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-12-16T01:22:39,741 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,741 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,742 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-12-16T01:22:39,742 to the `packages` configuration field. 2023-12-16T01:22:39,743 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,744 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,744 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,745 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,746 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,746 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-12-16T01:22:39,747 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-12-16T01:22:39,747 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,748 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,748 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,749 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,750 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,752 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,752 even if it does not contain any `.py` files. 2023-12-16T01:22:39,752 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,753 directory, all directories are treated like packages. 2023-12-16T01:22:39,753 ******************************************************************************** 2023-12-16T01:22:39,754 !! 2023-12-16T01:22:39,755 check.warn(importable) 2023-12-16T01:22:39,755 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-12-16T01:22:39,756 !! 2023-12-16T01:22:39,757 ******************************************************************************** 2023-12-16T01:22:39,757 ############################ 2023-12-16T01:22:39,758 # Package would be ignored # 2023-12-16T01:22:39,758 ############################ 2023-12-16T01:22:39,759 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-12-16T01:22:39,759 but it is absent from setuptools' `packages` configuration. 2023-12-16T01:22:39,760 This leads to an ambiguous overall configuration. If you want to distribute this 2023-12-16T01:22:39,761 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-12-16T01:22:39,761 to the `packages` configuration field. 2023-12-16T01:22:39,762 Alternatively, you can also rely on setuptools' discovery methods 2023-12-16T01:22:39,763 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-12-16T01:22:39,763 instead of `find_packages(...)`/`find:`). 2023-12-16T01:22:39,764 You can read more about "package discovery" on setuptools documentation page: 2023-12-16T01:22:39,766 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-12-16T01:22:39,767 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-12-16T01:22:39,767 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-12-16T01:22:39,768 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-12-16T01:22:39,768 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-12-16T01:22:39,768 combination with a more fine grained `package-data` configuration. 2023-12-16T01:22:39,769 You can read more about "package data files" on setuptools documentation page: 2023-12-16T01:22:39,770 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-12-16T01:22:39,771 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-12-16T01:22:39,772 even if it does not contain any `.py` files. 2023-12-16T01:22:39,772 On the other hand, currently there is no concept of package data 2023-12-16T01:22:39,773 directory, all directories are treated like packages. 2023-12-16T01:22:39,773 ******************************************************************************** 2023-12-16T01:22:39,774 !! 2023-12-16T01:22:39,774 check.warn(importable) 2023-12-16T01:22:39,775 creating build/lib/deepspeed/autotuning/config_templates 2023-12-16T01:22:39,775 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-12-16T01:22:39,776 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-12-16T01:22:39,776 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-12-16T01:22:39,777 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-12-16T01:22:39,777 creating build/lib/deepspeed/ops/csrc 2023-12-16T01:22:39,778 creating build/lib/deepspeed/ops/csrc/adagrad 2023-12-16T01:22:39,778 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-12-16T01:22:39,779 creating build/lib/deepspeed/ops/csrc/adam 2023-12-16T01:22:39,779 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-12-16T01:22:39,780 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-12-16T01:22:39,780 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-12-16T01:22:39,781 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-12-16T01:22:39,781 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-12-16T01:22:39,781 creating build/lib/deepspeed/ops/csrc/aio 2023-12-16T01:22:39,782 creating build/lib/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:39,782 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:39,783 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:39,784 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:39,784 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:39,785 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:39,785 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:39,786 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,786 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,787 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,787 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,788 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,788 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,789 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,789 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,789 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,790 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,790 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,791 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:39,791 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-12-16T01:22:39,792 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-12-16T01:22:39,792 creating build/lib/deepspeed/ops/csrc/common 2023-12-16T01:22:39,793 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-12-16T01:22:39,793 creating build/lib/deepspeed/ops/csrc/cpu 2023-12-16T01:22:39,793 creating build/lib/deepspeed/ops/csrc/cpu/adam 2023-12-16T01:22:39,794 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2023-12-16T01:22:39,794 creating build/lib/deepspeed/ops/csrc/cpu/comm 2023-12-16T01:22:39,795 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2023-12-16T01:22:39,795 creating build/lib/deepspeed/ops/csrc/cpu/lion 2023-12-16T01:22:39,796 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2023-12-16T01:22:39,796 creating build/lib/deepspeed/ops/csrc/deepspeed4science 2023-12-16T01:22:39,797 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:39,797 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:39,798 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:39,798 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:39,799 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:39,799 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:39,800 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:39,800 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-16T01:22:39,801 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-16T01:22:39,801 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-16T01:22:39,802 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-16T01:22:39,802 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-16T01:22:39,803 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:39,803 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:39,804 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:39,804 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:39,804 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:39,805 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:39,805 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:39,806 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:39,806 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:39,806 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:39,807 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:39,808 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:39,808 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:39,809 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:39,809 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:39,810 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:39,810 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-16T01:22:39,811 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-16T01:22:39,811 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-16T01:22:39,812 creating build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,812 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,813 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,813 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,814 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,814 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,815 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,815 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,816 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,816 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,817 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,817 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,817 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,818 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,818 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,819 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,819 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,820 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,820 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,821 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,821 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,822 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,822 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,823 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,823 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,824 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,824 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,825 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,825 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,826 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-12-16T01:22:39,826 creating build/lib/deepspeed/ops/csrc/lamb 2023-12-16T01:22:39,827 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-12-16T01:22:39,827 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-12-16T01:22:39,828 creating build/lib/deepspeed/ops/csrc/lion 2023-12-16T01:22:39,828 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-12-16T01:22:39,829 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-12-16T01:22:39,829 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-12-16T01:22:39,830 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2023-12-16T01:22:39,830 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2023-12-16T01:22:39,831 creating build/lib/deepspeed/ops/csrc/quantization 2023-12-16T01:22:39,831 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-16T01:22:39,832 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-16T01:22:39,833 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-12-16T01:22:39,833 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-16T01:22:39,833 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-16T01:22:39,834 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-16T01:22:39,834 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-12-16T01:22:39,835 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-12-16T01:22:39,835 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-12-16T01:22:39,836 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-12-16T01:22:39,836 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-12-16T01:22:39,837 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-12-16T01:22:39,837 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-12-16T01:22:39,837 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-12-16T01:22:39,838 creating build/lib/deepspeed/ops/csrc/spatial 2023-12-16T01:22:39,838 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-12-16T01:22:39,839 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-12-16T01:22:39,840 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-12-16T01:22:39,840 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-12-16T01:22:39,840 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-12-16T01:22:39,841 creating build/lib/deepspeed/ops/csrc/transformer 2023-12-16T01:22:39,841 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-16T01:22:39,842 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-16T01:22:39,842 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-12-16T01:22:39,843 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-16T01:22:39,843 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-16T01:22:39,844 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-16T01:22:39,844 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-16T01:22:39,845 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-12-16T01:22:39,845 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-12-16T01:22:39,846 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,847 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,849 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,852 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,855 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,858 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,860 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,864 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,866 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,868 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,871 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:39,873 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-12-16T01:22:39,874 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-12-16T01:22:39,877 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-12-16T01:22:39,880 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-12-16T01:22:39,882 creating build/lib/deepspeed/ops/csrc/utils 2023-12-16T01:22:39,883 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-12-16T01:22:39,886 creating build/lib/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:39,886 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:39,888 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:39,891 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:39,893 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:39,896 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:39,899 creating build/lib/deepspeed/inference/v2/ragged/csrc 2023-12-16T01:22:39,900 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2023-12-16T01:22:39,902 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2023-12-16T01:22:39,904 creating build/lib/deepspeed/inference/v2/ragged/includes 2023-12-16T01:22:39,905 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2023-12-16T01:22:39,907 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2023-12-16T01:22:39,909 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-12-16T01:22:39,911 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-16T01:22:39,912 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-16T01:22:39,914 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-16T01:22:39,916 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-16T01:22:39,918 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-16T01:22:39,920 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-12-16T01:22:39,921 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-12-16T01:22:39,923 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:39,926 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:39,928 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:39,930 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-16T01:22:39,932 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-16T01:22:39,935 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:39,938 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:39,941 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:39,943 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:39,945 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:39,948 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:39,950 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:39,953 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:39,955 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:39,957 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:39,960 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:39,962 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:39,964 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:39,967 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:39,969 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:39,972 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:39,974 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:39,976 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:39,979 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:39,981 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:39,984 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:39,986 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:39,988 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:39,991 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:39,993 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:39,995 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:39,998 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,001 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,003 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,006 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,008 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,011 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,013 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,015 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-16T01:22:40,018 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-16T01:22:40,020 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,022 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,025 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,027 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,030 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:40,032 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:40,035 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:40,037 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:40,040 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:40,043 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:40,046 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-12-16T01:22:40,049 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-12-16T01:22:40,052 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-12-16T01:22:40,116 running build_scripts 2023-12-16T01:22:40,117 creating build/scripts-3.11 2023-12-16T01:22:40,119 copying and adjusting bin/deepspeed -> build/scripts-3.11 2023-12-16T01:22:40,121 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2023-12-16T01:22:40,124 copying and adjusting bin/ds -> build/scripts-3.11 2023-12-16T01:22:40,126 copying bin/ds_ssh -> build/scripts-3.11 2023-12-16T01:22:40,129 copying and adjusting bin/ds_report -> build/scripts-3.11 2023-12-16T01:22:40,131 copying and adjusting bin/ds_bench -> build/scripts-3.11 2023-12-16T01:22:40,133 copying and adjusting bin/dsr -> build/scripts-3.11 2023-12-16T01:22:40,135 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2023-12-16T01:22:40,137 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2023-12-16T01:22:40,138 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2023-12-16T01:22:40,139 changing mode of build/scripts-3.11/ds from 644 to 755 2023-12-16T01:22:40,140 changing mode of build/scripts-3.11/ds_report from 644 to 755 2023-12-16T01:22:40,140 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2023-12-16T01:22:40,141 changing mode of build/scripts-3.11/dsr from 644 to 755 2023-12-16T01:22:40,142 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2023-12-16T01:22:40,166 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-12-16T01:22:40,167 !! 2023-12-16T01:22:40,168 ******************************************************************************** 2023-12-16T01:22:40,168 Please avoid running ``setup.py`` directly. 2023-12-16T01:22:40,169 Instead, use pypa/build, pypa/installer or other 2023-12-16T01:22:40,169 standards-based tools. 2023-12-16T01:22:40,171 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-12-16T01:22:40,171 ******************************************************************************** 2023-12-16T01:22:40,172 !! 2023-12-16T01:22:40,173 self.initialize_options() 2023-12-16T01:22:40,195 installing to build/bdist.linux-armv7l/wheel 2023-12-16T01:22:40,195 running install 2023-12-16T01:22:40,219 running install_lib 2023-12-16T01:22:40,244 creating build/bdist.linux-armv7l 2023-12-16T01:22:40,245 creating build/bdist.linux-armv7l/wheel 2023-12-16T01:22:40,248 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-12-16T01:22:40,249 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-12-16T01:22:40,251 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-12-16T01:22:40,253 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-12-16T01:22:40,256 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-12-16T01:22:40,258 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-12-16T01:22:40,261 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-12-16T01:22:40,263 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-12-16T01:22:40,265 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-12-16T01:22:40,266 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-12-16T01:22:40,269 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-12-16T01:22:40,271 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-12-16T01:22:40,273 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-12-16T01:22:40,275 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-12-16T01:22:40,278 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-12-16T01:22:40,281 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-12-16T01:22:40,282 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-12-16T01:22:40,284 copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-12-16T01:22:40,286 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-12-16T01:22:40,288 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-12-16T01:22:40,291 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:40,292 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-12-16T01:22:40,294 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-12-16T01:22:40,296 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-12-16T01:22:40,298 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-12-16T01:22:40,300 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-12-16T01:22:40,303 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-12-16T01:22:40,304 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-12-16T01:22:40,307 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-12-16T01:22:40,309 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-12-16T01:22:40,311 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-12-16T01:22:40,314 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:40,315 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:40,318 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:40,321 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:40,323 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:40,325 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:40,328 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:40,330 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:40,332 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:40,334 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-12-16T01:22:40,336 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:40,339 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2023-12-16T01:22:40,341 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/falcon_containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2023-12-16T01:22:40,343 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/falcon_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2023-12-16T01:22:40,345 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/falcon_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2023-12-16T01:22:40,348 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2023-12-16T01:22:40,350 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:40,354 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:40,355 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:40,357 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:40,359 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:40,361 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:40,364 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:40,366 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:40,368 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:40,370 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:40,372 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-12-16T01:22:40,374 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:40,377 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:40,379 copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:40,382 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:40,384 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-12-16T01:22:40,387 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-16T01:22:40,389 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-16T01:22:40,391 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-16T01:22:40,393 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-16T01:22:40,395 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-12-16T01:22:40,398 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-12-16T01:22:40,399 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-12-16T01:22:40,401 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-12-16T01:22:40,403 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-12-16T01:22:40,406 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-12-16T01:22:40,408 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-12-16T01:22:40,411 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-12-16T01:22:40,413 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-12-16T01:22:40,415 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:40,417 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:40,420 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:40,421 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:40,424 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:40,426 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-12-16T01:22:40,429 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-12-16T01:22:40,430 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:40,431 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:40,433 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:40,435 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:40,437 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:40,439 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:40,441 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:40,443 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-12-16T01:22:40,445 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-12-16T01:22:40,447 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-16T01:22:40,448 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-16T01:22:40,450 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-16T01:22:40,452 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-16T01:22:40,454 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-12-16T01:22:40,456 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:40,457 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:40,459 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:40,461 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:40,463 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:40,465 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:40,467 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:40,469 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:40,471 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-12-16T01:22:40,473 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:40,474 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:40,476 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:40,478 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:40,480 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:40,482 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-12-16T01:22:40,484 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-12-16T01:22:40,486 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:40,487 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:40,488 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:40,490 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:40,492 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:40,494 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-12-16T01:22:40,497 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-12-16T01:22:40,498 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:40,499 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:40,501 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:40,503 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:40,505 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:40,506 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:40,508 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-12-16T01:22:40,510 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:40,511 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:40,513 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:40,515 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:40,516 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:40,518 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:40,520 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-12-16T01:22:40,523 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:40,523 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:40,526 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:40,529 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:40,531 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:40,533 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:40,535 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-12-16T01:22:40,537 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-12-16T01:22:40,540 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:40,541 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:40,544 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:40,547 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:40,550 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:40,552 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:40,555 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-12-16T01:22:40,559 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,560 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,564 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,569 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,576 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,581 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,587 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,592 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,598 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-12-16T01:22:40,605 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-16T01:22:40,608 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-16T01:22:40,614 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-16T01:22:40,620 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-12-16T01:22:40,628 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,631 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,642 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,650 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,659 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,668 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,676 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-12-16T01:22:40,687 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-16T01:22:40,691 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-16T01:22:40,700 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-16T01:22:40,707 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-16T01:22:40,709 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-12-16T01:22:40,711 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-12-16T01:22:40,713 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,714 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,716 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,718 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,719 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,721 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,723 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-12-16T01:22:40,725 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-12-16T01:22:40,727 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-12-16T01:22:40,729 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-16T01:22:40,730 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-16T01:22:40,732 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-12-16T01:22:40,733 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-12-16T01:22:40,735 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:40,736 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:40,738 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:40,740 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:40,742 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:40,743 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:40,745 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-12-16T01:22:40,747 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:40,748 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:40,750 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:40,752 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:40,754 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:40,756 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-12-16T01:22:40,758 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-12-16T01:22:40,759 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-12-16T01:22:40,761 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-12-16T01:22:40,763 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-12-16T01:22:40,765 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-12-16T01:22:40,766 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-12-16T01:22:40,768 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-12-16T01:22:40,771 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2023-12-16T01:22:40,772 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2023-12-16T01:22:40,774 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-12-16T01:22:40,776 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-12-16T01:22:40,777 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-12-16T01:22:40,779 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-12-16T01:22:40,781 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-12-16T01:22:40,782 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-12-16T01:22:40,784 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-12-16T01:22:40,787 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-12-16T01:22:40,789 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-12-16T01:22:40,790 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:40,791 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:40,793 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:40,795 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:40,797 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:40,798 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:40,800 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:40,802 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:40,804 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-12-16T01:22:40,806 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2023-12-16T01:22:40,808 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-12-16T01:22:40,809 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-12-16T01:22:40,811 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-12-16T01:22:40,813 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-12-16T01:22:40,814 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-12-16T01:22:40,816 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-12-16T01:22:40,818 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-12-16T01:22:40,819 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-12-16T01:22:40,821 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-12-16T01:22:40,823 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-16T01:22:40,824 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-16T01:22:40,826 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-12-16T01:22:40,829 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-16T01:22:40,829 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-16T01:22:40,831 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-16T01:22:40,833 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-12-16T01:22:40,835 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2023-12-16T01:22:40,837 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-12-16T01:22:40,838 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-12-16T01:22:40,840 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-12-16T01:22:40,842 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-12-16T01:22:40,843 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-12-16T01:22:40,845 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-12-16T01:22:40,848 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-12-16T01:22:40,850 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-12-16T01:22:40,853 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-12-16T01:22:40,856 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:40,857 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:40,860 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:40,862 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:40,864 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:40,867 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:40,869 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:40,871 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-12-16T01:22:40,874 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-12-16T01:22:40,876 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-12-16T01:22:40,878 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-12-16T01:22:40,881 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-12-16T01:22:40,886 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-12-16T01:22:40,887 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-12-16T01:22:40,890 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-12-16T01:22:40,892 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-12-16T01:22:40,895 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-12-16T01:22:40,897 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-12-16T01:22:40,900 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-12-16T01:22:40,902 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-12-16T01:22:40,904 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-12-16T01:22:40,906 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-12-16T01:22:40,908 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-12-16T01:22:40,912 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-12-16T01:22:40,913 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-12-16T01:22:40,916 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-12-16T01:22:40,918 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-12-16T01:22:40,921 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-12-16T01:22:40,923 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-12-16T01:22:40,925 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-12-16T01:22:40,927 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-12-16T01:22:40,931 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-12-16T01:22:40,932 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-12-16T01:22:40,934 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-12-16T01:22:40,936 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-12-16T01:22:40,938 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-12-16T01:22:40,941 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-12-16T01:22:40,943 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-12-16T01:22:40,947 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-12-16T01:22:40,948 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-12-16T01:22:40,950 copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-12-16T01:22:40,952 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-12-16T01:22:40,953 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-12-16T01:22:40,954 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-12-16T01:22:40,956 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-12-16T01:22:40,958 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-12-16T01:22:40,960 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-12-16T01:22:40,961 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-12-16T01:22:40,963 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-12-16T01:22:40,965 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-12-16T01:22:40,966 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-12-16T01:22:40,968 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-12-16T01:22:40,970 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-12-16T01:22:40,971 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-12-16T01:22:40,974 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-12-16T01:22:40,975 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-12-16T01:22:40,977 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-12-16T01:22:40,979 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-12-16T01:22:40,982 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-12-16T01:22:40,984 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-12-16T01:22:40,985 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-12-16T01:22:40,986 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-12-16T01:22:40,988 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-12-16T01:22:40,990 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-12-16T01:22:40,992 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-12-16T01:22:40,994 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-12-16T01:22:40,995 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-12-16T01:22:40,998 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-12-16T01:22:41,000 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-12-16T01:22:41,001 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-12-16T01:22:41,003 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-12-16T01:22:41,005 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-12-16T01:22:41,008 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-12-16T01:22:41,011 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-12-16T01:22:41,012 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-12-16T01:22:41,014 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-12-16T01:22:41,016 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-12-16T01:22:41,017 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-12-16T01:22:41,020 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-12-16T01:22:41,020 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-12-16T01:22:41,023 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,024 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,026 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,028 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,030 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,032 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,034 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,036 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,038 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,040 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,042 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,045 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,047 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,049 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:41,050 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:41,053 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:41,055 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:41,057 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:41,059 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:41,061 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-12-16T01:22:41,063 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,065 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,067 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,069 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-12-16T01:22:41,071 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-12-16T01:22:41,073 copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-12-16T01:22:41,075 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-12-16T01:22:41,077 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-12-16T01:22:41,079 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-12-16T01:22:41,081 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-12-16T01:22:41,083 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-12-16T01:22:41,085 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,087 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,089 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,091 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,093 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,096 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,098 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-12-16T01:22:41,100 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-12-16T01:22:41,101 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-12-16T01:22:41,104 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-12-16T01:22:41,106 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-12-16T01:22:41,107 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-12-16T01:22:41,110 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-12-16T01:22:41,112 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-12-16T01:22:41,113 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-12-16T01:22:41,116 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-12-16T01:22:41,119 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-12-16T01:22:41,120 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-12-16T01:22:41,122 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-12-16T01:22:41,125 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-12-16T01:22:41,127 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-12-16T01:22:41,129 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-12-16T01:22:41,131 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-12-16T01:22:41,133 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-12-16T01:22:41,134 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-12-16T01:22:41,136 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-12-16T01:22:41,137 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-12-16T01:22:41,140 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-12-16T01:22:41,143 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-12-16T01:22:41,144 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-12-16T01:22:41,146 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-12-16T01:22:41,148 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-12-16T01:22:41,151 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-12-16T01:22:41,153 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-12-16T01:22:41,155 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-12-16T01:22:41,157 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-12-16T01:22:41,160 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-12-16T01:22:41,161 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-12-16T01:22:41,162 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-12-16T01:22:41,165 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,166 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,168 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,170 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,172 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,174 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,177 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,179 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,181 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,184 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,186 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,188 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-12-16T01:22:41,191 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:41,192 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:41,194 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:41,196 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:41,198 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:41,200 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:41,203 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-12-16T01:22:41,206 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,207 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,209 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,211 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,214 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,217 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,219 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,221 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,223 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,226 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,228 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,230 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,232 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,235 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,237 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,239 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,242 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,244 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,246 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,248 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,250 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,252 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,255 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,257 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,259 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,262 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,264 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,267 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,269 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,272 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-12-16T01:22:41,274 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2023-12-16T01:22:41,276 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:41,277 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:41,279 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:41,282 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:41,285 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:41,286 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:41,289 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:41,291 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:41,294 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:41,296 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:41,299 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:41,302 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-12-16T01:22:41,306 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:41,307 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:41,309 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:41,312 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:41,314 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:41,317 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:41,320 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:41,322 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-12-16T01:22:41,326 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:41,330 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-16T01:22:41,331 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-16T01:22:41,333 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-12-16T01:22:41,336 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-16T01:22:41,337 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-16T01:22:41,340 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-16T01:22:41,342 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-16T01:22:41,344 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-12-16T01:22:41,347 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:41,350 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-12-16T01:22:41,352 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-12-16T01:22:41,353 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-12-16T01:22:41,356 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-12-16T01:22:41,357 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-12-16T01:22:41,359 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-12-16T01:22:41,362 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-12-16T01:22:41,364 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-12-16T01:22:41,366 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-12-16T01:22:41,368 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-12-16T01:22:41,370 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-12-16T01:22:41,373 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-12-16T01:22:41,374 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-12-16T01:22:41,376 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-12-16T01:22:41,378 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-12-16T01:22:41,380 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-12-16T01:22:41,382 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-12-16T01:22:41,385 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-12-16T01:22:41,386 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-12-16T01:22:41,388 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2023-12-16T01:22:41,390 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2023-12-16T01:22:41,391 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2023-12-16T01:22:41,393 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-12-16T01:22:41,394 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-12-16T01:22:41,397 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-12-16T01:22:41,398 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-12-16T01:22:41,401 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-12-16T01:22:41,402 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-12-16T01:22:41,404 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-12-16T01:22:41,407 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-12-16T01:22:41,409 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-12-16T01:22:41,411 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-12-16T01:22:41,413 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-12-16T01:22:41,414 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-12-16T01:22:41,415 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-12-16T01:22:41,418 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-12-16T01:22:41,420 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-12-16T01:22:41,422 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,423 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,425 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,428 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,430 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,432 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,436 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,438 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,440 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,443 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,445 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-12-16T01:22:41,448 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-12-16T01:22:41,450 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-12-16T01:22:41,453 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-12-16T01:22:41,455 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-12-16T01:22:41,457 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-12-16T01:22:41,460 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-12-16T01:22:41,462 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-12-16T01:22:41,465 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-12-16T01:22:41,469 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-12-16T01:22:41,469 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-12-16T01:22:41,471 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-12-16T01:22:41,472 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-12-16T01:22:41,474 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-12-16T01:22:41,476 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-12-16T01:22:41,478 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-12-16T01:22:41,479 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-12-16T01:22:41,481 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-12-16T01:22:41,483 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-12-16T01:22:41,485 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,486 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,488 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,489 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,491 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,493 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,496 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,498 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,500 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,502 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,504 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,506 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,508 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-12-16T01:22:41,510 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,512 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,514 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,515 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,517 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,519 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,520 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,522 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,524 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,525 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,527 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,529 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,531 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-12-16T01:22:41,533 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,535 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,538 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,539 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,541 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,543 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,546 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-12-16T01:22:41,548 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-12-16T01:22:41,550 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-12-16T01:22:41,552 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-12-16T01:22:41,553 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-12-16T01:22:41,555 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-12-16T01:22:41,558 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-12-16T01:22:41,559 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-12-16T01:22:41,560 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-12-16T01:22:41,562 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-12-16T01:22:41,564 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-12-16T01:22:41,566 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-12-16T01:22:41,568 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-12-16T01:22:41,568 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-12-16T01:22:41,570 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-12-16T01:22:41,572 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,573 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,575 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,577 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,578 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,580 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,582 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,584 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,586 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,587 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,589 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-12-16T01:22:41,591 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,592 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,594 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,597 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,599 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,601 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,603 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,605 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,607 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,608 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,610 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-12-16T01:22:41,613 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-12-16T01:22:41,613 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-12-16T01:22:41,615 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-12-16T01:22:41,616 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-12-16T01:22:41,619 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-12-16T01:22:41,621 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-12-16T01:22:41,622 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-12-16T01:22:41,624 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-12-16T01:22:41,625 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-12-16T01:22:41,628 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-12-16T01:22:41,630 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-12-16T01:22:41,632 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-12-16T01:22:41,634 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-12-16T01:22:41,637 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-12-16T01:22:41,639 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-12-16T01:22:41,641 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-12-16T01:22:41,644 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,645 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,647 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,649 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,652 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,655 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,658 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,661 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,662 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,665 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,667 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,670 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,673 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,675 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,678 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,680 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,683 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,685 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,688 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,690 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,693 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,695 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,698 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,700 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,703 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,706 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-12-16T01:22:41,707 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-12-16T01:22:41,709 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-12-16T01:22:41,712 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-12-16T01:22:41,715 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-12-16T01:22:41,717 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-12-16T01:22:41,719 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-12-16T01:22:41,722 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-12-16T01:22:41,725 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,727 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-12-16T01:22:41,729 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,732 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,734 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,737 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,740 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,742 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,744 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-12-16T01:22:41,747 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-12-16T01:22:41,749 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-12-16T01:22:41,751 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-12-16T01:22:41,752 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-12-16T01:22:41,754 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-12-16T01:22:41,756 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,757 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,760 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,762 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,764 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,766 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,768 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,769 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,771 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,773 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,776 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,777 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,779 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,781 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,783 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-12-16T01:22:41,788 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-12-16T01:22:41,788 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-12-16T01:22:41,791 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-12-16T01:22:41,792 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-12-16T01:22:41,795 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-12-16T01:22:41,796 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-12-16T01:22:41,800 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-12-16T01:22:41,800 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-12-16T01:22:41,803 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-12-16T01:22:41,805 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-12-16T01:22:41,807 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-12-16T01:22:41,809 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-12-16T01:22:41,811 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-12-16T01:22:41,813 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-12-16T01:22:41,815 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-12-16T01:22:41,818 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,819 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-12-16T01:22:41,820 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-12-16T01:22:41,823 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-12-16T01:22:41,825 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-12-16T01:22:41,827 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-12-16T01:22:41,829 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-12-16T01:22:41,830 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-12-16T01:22:41,833 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-12-16T01:22:41,835 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-12-16T01:22:41,837 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-12-16T01:22:41,839 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,842 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-12-16T01:22:41,843 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-12-16T01:22:41,845 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-12-16T01:22:41,848 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-12-16T01:22:41,849 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,852 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,853 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,856 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-12-16T01:22:41,857 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-12-16T01:22:41,859 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-12-16T01:22:41,861 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-12-16T01:22:41,864 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-12-16T01:22:41,866 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-12-16T01:22:41,868 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-12-16T01:22:41,870 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-12-16T01:22:41,872 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-12-16T01:22:41,874 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-12-16T01:22:41,876 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-12-16T01:22:41,877 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-12-16T01:22:41,879 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-12-16T01:22:41,882 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-12-16T01:22:41,883 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-12-16T01:22:41,886 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-12-16T01:22:41,888 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-12-16T01:22:41,890 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-12-16T01:22:41,891 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-12-16T01:22:41,893 copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-12-16T01:22:41,896 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-12-16T01:22:41,898 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-12-16T01:22:41,900 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-12-16T01:22:41,902 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,905 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-12-16T01:22:41,906 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-12-16T01:22:41,909 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:41,910 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:41,912 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:41,914 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:41,915 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:41,917 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-12-16T01:22:41,919 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-12-16T01:22:41,922 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-12-16T01:22:41,923 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-12-16T01:22:41,926 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:41,927 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:41,929 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:41,932 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:41,933 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:41,935 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-12-16T01:22:41,938 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,940 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,941 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,944 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,946 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,949 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,951 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,953 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,955 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,957 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,961 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,963 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,965 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,969 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,972 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,975 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,977 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,979 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-12-16T01:22:41,981 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,987 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-12-16T01:22:41,988 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-12-16T01:22:41,990 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-12-16T01:22:41,991 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,993 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,995 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:41,997 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:42,000 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-12-16T01:22:42,001 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-12-16T01:22:42,003 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-12-16T01:22:42,005 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-12-16T01:22:42,007 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-12-16T01:22:42,008 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:42,010 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:42,012 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:42,015 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:42,017 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-12-16T01:22:42,020 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-12-16T01:22:42,021 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-12-16T01:22:42,023 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-12-16T01:22:42,025 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-12-16T01:22:42,027 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-12-16T01:22:42,029 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-12-16T01:22:42,030 running install_egg_info 2023-12-16T01:22:42,061 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.12.5-py3.11.egg-info 2023-12-16T01:22:42,074 running install_scripts 2023-12-16T01:22:42,075 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data 2023-12-16T01:22:42,075 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts 2023-12-16T01:22:42,076 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts 2023-12-16T01:22:42,078 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts 2023-12-16T01:22:42,080 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts 2023-12-16T01:22:42,081 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts 2023-12-16T01:22:42,083 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts 2023-12-16T01:22:42,085 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts 2023-12-16T01:22:42,086 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts 2023-12-16T01:22:42,088 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts 2023-12-16T01:22:42,090 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts/ds_bench to 755 2023-12-16T01:22:42,090 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts/deepspeed to 755 2023-12-16T01:22:42,091 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts/ds to 755 2023-12-16T01:22:42,091 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts/ds_report to 755 2023-12-16T01:22:42,092 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts/deepspeed.pt to 755 2023-12-16T01:22:42,092 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts/ds_ssh to 755 2023-12-16T01:22:42,092 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts/ds_elastic to 755 2023-12-16T01:22:42,093 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.data/scripts/dsr to 755 2023-12-16T01:22:42,135 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.5.dist-info/WHEEL 2023-12-16T01:22:42,137 creating '/tmp/pip-wheel-4c269h0w/deepspeed-0.12.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-12-16T01:22:42,140 adding 'deepspeed/__init__.py' 2023-12-16T01:22:42,141 adding 'deepspeed/constants.py' 2023-12-16T01:22:42,143 adding 'deepspeed/env_report.py' 2023-12-16T01:22:42,144 adding 'deepspeed/git_version_info.py' 2023-12-16T01:22:42,146 adding 'deepspeed/git_version_info_installed.py' 2023-12-16T01:22:42,147 adding 'deepspeed/pydantic_v1.py' 2023-12-16T01:22:42,149 adding 'deepspeed/accelerator/__init__.py' 2023-12-16T01:22:42,150 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-12-16T01:22:42,152 adding 'deepspeed/accelerator/cpu_accelerator.py' 2023-12-16T01:22:42,153 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-12-16T01:22:42,155 adding 'deepspeed/accelerator/mps_accelerator.py' 2023-12-16T01:22:42,156 adding 'deepspeed/accelerator/npu_accelerator.py' 2023-12-16T01:22:42,158 adding 'deepspeed/accelerator/real_accelerator.py' 2023-12-16T01:22:42,160 adding 'deepspeed/autotuning/__init__.py' 2023-12-16T01:22:42,165 adding 'deepspeed/autotuning/autotuner.py' 2023-12-16T01:22:42,167 adding 'deepspeed/autotuning/config.py' 2023-12-16T01:22:42,168 adding 'deepspeed/autotuning/constants.py' 2023-12-16T01:22:42,170 adding 'deepspeed/autotuning/scheduler.py' 2023-12-16T01:22:42,172 adding 'deepspeed/autotuning/utils.py' 2023-12-16T01:22:42,174 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-12-16T01:22:42,175 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-12-16T01:22:42,176 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-12-16T01:22:42,178 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-12-16T01:22:42,179 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-12-16T01:22:42,181 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-12-16T01:22:42,182 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-12-16T01:22:42,183 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-12-16T01:22:42,185 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-12-16T01:22:42,186 adding 'deepspeed/autotuning/tuner/utils.py' 2023-12-16T01:22:42,188 adding 'deepspeed/checkpoint/__init__.py' 2023-12-16T01:22:42,189 adding 'deepspeed/checkpoint/constants.py' 2023-12-16T01:22:42,191 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-12-16T01:22:42,193 adding 'deepspeed/checkpoint/ds_to_universal.py' 2023-12-16T01:22:42,195 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-12-16T01:22:42,196 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-12-16T01:22:42,198 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-12-16T01:22:42,199 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-12-16T01:22:42,201 adding 'deepspeed/checkpoint/utils.py' 2023-12-16T01:22:42,202 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-12-16T01:22:42,204 adding 'deepspeed/comm/__init__.py' 2023-12-16T01:22:42,205 adding 'deepspeed/comm/backend.py' 2023-12-16T01:22:42,206 adding 'deepspeed/comm/ccl.py' 2023-12-16T01:22:42,210 adding 'deepspeed/comm/comm.py' 2023-12-16T01:22:42,211 adding 'deepspeed/comm/config.py' 2023-12-16T01:22:42,212 adding 'deepspeed/comm/constants.py' 2023-12-16T01:22:42,213 adding 'deepspeed/comm/reduce_op.py' 2023-12-16T01:22:42,215 adding 'deepspeed/comm/torch.py' 2023-12-16T01:22:42,217 adding 'deepspeed/comm/utils.py' 2023-12-16T01:22:42,218 adding 'deepspeed/compression/__init__.py' 2023-12-16T01:22:42,222 adding 'deepspeed/compression/basic_layer.py' 2023-12-16T01:22:42,223 adding 'deepspeed/compression/compress.py' 2023-12-16T01:22:42,225 adding 'deepspeed/compression/config.py' 2023-12-16T01:22:42,227 adding 'deepspeed/compression/constants.py' 2023-12-16T01:22:42,229 adding 'deepspeed/compression/helper.py' 2023-12-16T01:22:42,230 adding 'deepspeed/compression/scheduler.py' 2023-12-16T01:22:42,232 adding 'deepspeed/compression/utils.py' 2023-12-16T01:22:42,233 adding 'deepspeed/elasticity/__init__.py' 2023-12-16T01:22:42,235 adding 'deepspeed/elasticity/config.py' 2023-12-16T01:22:42,236 adding 'deepspeed/elasticity/constants.py' 2023-12-16T01:22:42,238 adding 'deepspeed/elasticity/elastic_agent.py' 2023-12-16T01:22:42,240 adding 'deepspeed/elasticity/elasticity.py' 2023-12-16T01:22:42,241 adding 'deepspeed/elasticity/utils.py' 2023-12-16T01:22:42,242 adding 'deepspeed/inference/__init__.py' 2023-12-16T01:22:42,245 adding 'deepspeed/inference/config.py' 2023-12-16T01:22:42,248 adding 'deepspeed/inference/engine.py' 2023-12-16T01:22:42,250 adding 'deepspeed/inference/quantization/__init__.py' 2023-12-16T01:22:42,251 adding 'deepspeed/inference/quantization/layers.py' 2023-12-16T01:22:42,253 adding 'deepspeed/inference/quantization/quantization.py' 2023-12-16T01:22:42,254 adding 'deepspeed/inference/quantization/quantization_context.py' 2023-12-16T01:22:42,256 adding 'deepspeed/inference/quantization/utils.py' 2023-12-16T01:22:42,257 adding 'deepspeed/inference/v2/__init__.py' 2023-12-16T01:22:42,259 adding 'deepspeed/inference/v2/allocator.py' 2023-12-16T01:22:42,260 adding 'deepspeed/inference/v2/config_v2.py' 2023-12-16T01:22:42,261 adding 'deepspeed/inference/v2/engine_factory.py' 2023-12-16T01:22:42,263 adding 'deepspeed/inference/v2/engine_v2.py' 2023-12-16T01:22:42,264 adding 'deepspeed/inference/v2/inference_parameter.py' 2023-12-16T01:22:42,266 adding 'deepspeed/inference/v2/inference_utils.py' 2023-12-16T01:22:42,267 adding 'deepspeed/inference/v2/logging.py' 2023-12-16T01:22:42,268 adding 'deepspeed/inference/v2/scheduling_utils.py' 2023-12-16T01:22:42,270 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2023-12-16T01:22:42,271 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2023-12-16T01:22:42,273 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2023-12-16T01:22:42,274 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2023-12-16T01:22:42,276 adding 'deepspeed/inference/v2/kernels/__init__.py' 2023-12-16T01:22:42,277 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2023-12-16T01:22:42,279 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2023-12-16T01:22:42,280 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2023-12-16T01:22:42,282 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2023-12-16T01:22:42,283 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2023-12-16T01:22:42,284 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu' 2023-12-16T01:22:42,286 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2023-12-16T01:22:42,287 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2023-12-16T01:22:42,289 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2023-12-16T01:22:42,290 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2023-12-16T01:22:42,291 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2023-12-16T01:22:42,293 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2023-12-16T01:22:42,294 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2023-12-16T01:22:42,295 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2023-12-16T01:22:42,297 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2023-12-16T01:22:42,298 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2023-12-16T01:22:42,299 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2023-12-16T01:22:42,300 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2023-12-16T01:22:42,302 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu' 2023-12-16T01:22:42,304 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2023-12-16T01:22:42,305 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2023-12-16T01:22:42,307 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2023-12-16T01:22:42,309 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu' 2023-12-16T01:22:42,310 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2023-12-16T01:22:42,311 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2023-12-16T01:22:42,312 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2023-12-16T01:22:42,313 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2023-12-16T01:22:42,315 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2023-12-16T01:22:42,316 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2023-12-16T01:22:42,318 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2023-12-16T01:22:42,319 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu' 2023-12-16T01:22:42,320 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2023-12-16T01:22:42,322 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2023-12-16T01:22:42,323 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2023-12-16T01:22:42,325 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2023-12-16T01:22:42,326 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2023-12-16T01:22:42,328 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2023-12-16T01:22:42,329 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2023-12-16T01:22:42,330 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2023-12-16T01:22:42,332 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2023-12-16T01:22:42,333 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2023-12-16T01:22:42,335 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2023-12-16T01:22:42,336 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2023-12-16T01:22:42,338 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2023-12-16T01:22:42,339 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2023-12-16T01:22:42,341 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2023-12-16T01:22:42,343 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2023-12-16T01:22:42,345 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2023-12-16T01:22:42,346 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2023-12-16T01:22:42,349 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2023-12-16T01:22:42,351 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2023-12-16T01:22:42,353 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2023-12-16T01:22:42,354 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2023-12-16T01:22:42,356 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2023-12-16T01:22:42,357 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2023-12-16T01:22:42,358 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2023-12-16T01:22:42,360 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2023-12-16T01:22:42,361 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2023-12-16T01:22:42,363 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2023-12-16T01:22:42,364 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2023-12-16T01:22:42,365 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2023-12-16T01:22:42,367 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2023-12-16T01:22:42,368 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2023-12-16T01:22:42,369 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2023-12-16T01:22:42,371 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2023-12-16T01:22:42,372 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu' 2023-12-16T01:22:42,373 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2023-12-16T01:22:42,375 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2023-12-16T01:22:42,376 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2023-12-16T01:22:42,378 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2023-12-16T01:22:42,379 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2023-12-16T01:22:42,381 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu' 2023-12-16T01:22:42,382 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2023-12-16T01:22:42,384 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2023-12-16T01:22:42,385 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2023-12-16T01:22:42,387 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2023-12-16T01:22:42,388 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2023-12-16T01:22:42,390 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2023-12-16T01:22:42,391 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2023-12-16T01:22:42,393 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu' 2023-12-16T01:22:42,394 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2023-12-16T01:22:42,395 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2023-12-16T01:22:42,396 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2023-12-16T01:22:42,398 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2023-12-16T01:22:42,399 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2023-12-16T01:22:42,401 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu' 2023-12-16T01:22:42,402 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2023-12-16T01:22:42,403 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2023-12-16T01:22:42,404 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2023-12-16T01:22:42,406 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2023-12-16T01:22:42,407 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2023-12-16T01:22:42,409 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu' 2023-12-16T01:22:42,410 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2023-12-16T01:22:42,411 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2023-12-16T01:22:42,413 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2023-12-16T01:22:42,414 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2023-12-16T01:22:42,416 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2023-12-16T01:22:42,417 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2023-12-16T01:22:42,418 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py' 2023-12-16T01:22:42,420 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp' 2023-12-16T01:22:42,421 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu' 2023-12-16T01:22:42,423 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh' 2023-12-16T01:22:42,424 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h' 2023-12-16T01:22:42,425 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py' 2023-12-16T01:22:42,427 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2023-12-16T01:22:42,429 adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py' 2023-12-16T01:22:42,430 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2023-12-16T01:22:42,432 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2023-12-16T01:22:42,435 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2023-12-16T01:22:42,437 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2023-12-16T01:22:42,439 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2023-12-16T01:22:42,441 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2023-12-16T01:22:42,442 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2023-12-16T01:22:42,443 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2023-12-16T01:22:42,444 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2023-12-16T01:22:42,445 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2023-12-16T01:22:42,447 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2023-12-16T01:22:42,448 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2023-12-16T01:22:42,449 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2023-12-16T01:22:42,450 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2023-12-16T01:22:42,452 adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py' 2023-12-16T01:22:42,454 adding 'deepspeed/inference/v2/model_implementations/falcon/falcon_containers.py' 2023-12-16T01:22:42,455 adding 'deepspeed/inference/v2/model_implementations/falcon/falcon_model.py' 2023-12-16T01:22:42,456 adding 'deepspeed/inference/v2/model_implementations/falcon/falcon_policy.py' 2023-12-16T01:22:42,458 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2023-12-16T01:22:42,459 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py' 2023-12-16T01:22:42,461 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py' 2023-12-16T01:22:42,462 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py' 2023-12-16T01:22:42,464 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2023-12-16T01:22:42,465 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2023-12-16T01:22:42,466 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2023-12-16T01:22:42,467 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2023-12-16T01:22:42,469 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2023-12-16T01:22:42,470 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2023-12-16T01:22:42,472 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2023-12-16T01:22:42,473 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2023-12-16T01:22:42,475 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2023-12-16T01:22:42,476 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2023-12-16T01:22:42,477 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2023-12-16T01:22:42,479 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2023-12-16T01:22:42,480 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2023-12-16T01:22:42,481 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2023-12-16T01:22:42,482 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2023-12-16T01:22:42,484 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2023-12-16T01:22:42,485 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2023-12-16T01:22:42,487 adding 'deepspeed/inference/v2/modules/__init__.py' 2023-12-16T01:22:42,488 adding 'deepspeed/inference/v2/modules/ds_module.py' 2023-12-16T01:22:42,490 adding 'deepspeed/inference/v2/modules/heuristics.py' 2023-12-16T01:22:42,491 adding 'deepspeed/inference/v2/modules/module_registry.py' 2023-12-16T01:22:42,493 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2023-12-16T01:22:42,494 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2023-12-16T01:22:42,495 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2023-12-16T01:22:42,497 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2023-12-16T01:22:42,498 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2023-12-16T01:22:42,499 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2023-12-16T01:22:42,500 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2023-12-16T01:22:42,502 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2023-12-16T01:22:42,503 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2023-12-16T01:22:42,505 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2023-12-16T01:22:42,507 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2023-12-16T01:22:42,508 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2023-12-16T01:22:42,510 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2023-12-16T01:22:42,511 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2023-12-16T01:22:42,513 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2023-12-16T01:22:42,514 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2023-12-16T01:22:42,516 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2023-12-16T01:22:42,517 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2023-12-16T01:22:42,519 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2023-12-16T01:22:42,520 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2023-12-16T01:22:42,522 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2023-12-16T01:22:42,523 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2023-12-16T01:22:42,524 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2023-12-16T01:22:42,526 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2023-12-16T01:22:42,527 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2023-12-16T01:22:42,529 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2023-12-16T01:22:42,530 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2023-12-16T01:22:42,531 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2023-12-16T01:22:42,533 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2023-12-16T01:22:42,534 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2023-12-16T01:22:42,536 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2023-12-16T01:22:42,537 adding 'deepspeed/inference/v2/ragged/__init__.py' 2023-12-16T01:22:42,539 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2023-12-16T01:22:42,540 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2023-12-16T01:22:42,542 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2023-12-16T01:22:42,543 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2023-12-16T01:22:42,545 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2023-12-16T01:22:42,547 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2023-12-16T01:22:42,549 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2023-12-16T01:22:42,550 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2023-12-16T01:22:42,552 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2023-12-16T01:22:42,553 adding 'deepspeed/launcher/__init__.py' 2023-12-16T01:22:42,555 adding 'deepspeed/launcher/constants.py' 2023-12-16T01:22:42,557 adding 'deepspeed/launcher/launch.py' 2023-12-16T01:22:42,559 adding 'deepspeed/launcher/multinode_runner.py' 2023-12-16T01:22:42,562 adding 'deepspeed/launcher/runner.py' 2023-12-16T01:22:42,564 adding 'deepspeed/model_implementations/__init__.py' 2023-12-16T01:22:42,565 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-12-16T01:22:42,567 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-12-16T01:22:42,568 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-12-16T01:22:42,570 adding 'deepspeed/model_implementations/features/__init__.py' 2023-12-16T01:22:42,571 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-12-16T01:22:42,573 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-12-16T01:22:42,574 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-12-16T01:22:42,575 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-12-16T01:22:42,576 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-12-16T01:22:42,578 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-12-16T01:22:42,579 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-12-16T01:22:42,580 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2023-12-16T01:22:42,581 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-12-16T01:22:42,582 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-12-16T01:22:42,584 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-12-16T01:22:42,586 adding 'deepspeed/module_inject/__init__.py' 2023-12-16T01:22:42,589 adding 'deepspeed/module_inject/auto_tp.py' 2023-12-16T01:22:42,591 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2023-12-16T01:22:42,592 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2023-12-16T01:22:42,593 adding 'deepspeed/module_inject/inject.py' 2023-12-16T01:22:42,595 adding 'deepspeed/module_inject/layers.py' 2023-12-16T01:22:42,596 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-12-16T01:22:42,598 adding 'deepspeed/module_inject/module_quantize.py' 2023-12-16T01:22:42,599 adding 'deepspeed/module_inject/policy.py' 2023-12-16T01:22:42,603 adding 'deepspeed/module_inject/replace_module.py' 2023-12-16T01:22:42,604 adding 'deepspeed/module_inject/replace_policy.py' 2023-12-16T01:22:42,605 adding 'deepspeed/module_inject/tp_shard.py' 2023-12-16T01:22:42,606 adding 'deepspeed/module_inject/utils.py' 2023-12-16T01:22:42,608 adding 'deepspeed/module_inject/containers/__init__.py' 2023-12-16T01:22:42,610 adding 'deepspeed/module_inject/containers/base.py' 2023-12-16T01:22:42,612 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-12-16T01:22:42,613 adding 'deepspeed/module_inject/containers/bert.py' 2023-12-16T01:22:42,614 adding 'deepspeed/module_inject/containers/bloom.py' 2023-12-16T01:22:42,616 adding 'deepspeed/module_inject/containers/clip.py' 2023-12-16T01:22:42,617 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-12-16T01:22:42,618 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-12-16T01:22:42,619 adding 'deepspeed/module_inject/containers/gptj.py' 2023-12-16T01:22:42,621 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-12-16T01:22:42,622 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-12-16T01:22:42,624 adding 'deepspeed/module_inject/containers/internlm.py' 2023-12-16T01:22:42,625 adding 'deepspeed/module_inject/containers/llama.py' 2023-12-16T01:22:42,627 adding 'deepspeed/module_inject/containers/llama2.py' 2023-12-16T01:22:42,628 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-12-16T01:22:42,630 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-12-16T01:22:42,631 adding 'deepspeed/module_inject/containers/opt.py' 2023-12-16T01:22:42,632 adding 'deepspeed/module_inject/containers/unet.py' 2023-12-16T01:22:42,634 adding 'deepspeed/module_inject/containers/vae.py' 2023-12-16T01:22:42,635 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-12-16T01:22:42,637 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2023-12-16T01:22:42,638 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2023-12-16T01:22:42,640 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2023-12-16T01:22:42,641 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-12-16T01:22:42,642 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-12-16T01:22:42,644 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2023-12-16T01:22:42,646 adding 'deepspeed/moe/__init__.py' 2023-12-16T01:22:42,647 adding 'deepspeed/moe/experts.py' 2023-12-16T01:22:42,649 adding 'deepspeed/moe/layer.py' 2023-12-16T01:22:42,650 adding 'deepspeed/moe/mappings.py' 2023-12-16T01:22:42,653 adding 'deepspeed/moe/sharded_moe.py' 2023-12-16T01:22:42,654 adding 'deepspeed/moe/utils.py' 2023-12-16T01:22:42,656 adding 'deepspeed/monitor/__init__.py' 2023-12-16T01:22:42,657 adding 'deepspeed/monitor/config.py' 2023-12-16T01:22:42,659 adding 'deepspeed/monitor/csv_monitor.py' 2023-12-16T01:22:42,660 adding 'deepspeed/monitor/monitor.py' 2023-12-16T01:22:42,661 adding 'deepspeed/monitor/tensorboard.py' 2023-12-16T01:22:42,663 adding 'deepspeed/monitor/utils.py' 2023-12-16T01:22:42,664 adding 'deepspeed/monitor/wandb.py' 2023-12-16T01:22:42,665 adding 'deepspeed/nebula/__init__.py' 2023-12-16T01:22:42,667 adding 'deepspeed/nebula/config.py' 2023-12-16T01:22:42,668 adding 'deepspeed/nebula/constants.py' 2023-12-16T01:22:42,670 adding 'deepspeed/ops/__init__.py' 2023-12-16T01:22:42,672 adding 'deepspeed/ops/adagrad/__init__.py' 2023-12-16T01:22:42,673 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-12-16T01:22:42,675 adding 'deepspeed/ops/adam/__init__.py' 2023-12-16T01:22:42,676 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-12-16T01:22:42,678 adding 'deepspeed/ops/adam/fused_adam.py' 2023-12-16T01:22:42,679 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-12-16T01:22:42,680 adding 'deepspeed/ops/aio/__init__.py' 2023-12-16T01:22:42,683 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-12-16T01:22:42,685 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-12-16T01:22:42,686 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2023-12-16T01:22:42,688 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-12-16T01:22:42,689 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-12-16T01:22:42,690 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-12-16T01:22:42,693 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-12-16T01:22:42,695 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-12-16T01:22:42,696 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-12-16T01:22:42,697 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-12-16T01:22:42,698 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-12-16T01:22:42,700 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-12-16T01:22:42,702 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-12-16T01:22:42,703 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-12-16T01:22:42,704 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-12-16T01:22:42,705 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-12-16T01:22:42,706 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-12-16T01:22:42,708 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-12-16T01:22:42,709 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-12-16T01:22:42,711 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-12-16T01:22:42,712 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-12-16T01:22:42,713 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-12-16T01:22:42,714 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-12-16T01:22:42,716 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-12-16T01:22:42,718 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-12-16T01:22:42,720 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2023-12-16T01:22:42,723 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2023-12-16T01:22:42,725 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2023-12-16T01:22:42,727 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2023-12-16T01:22:42,729 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2023-12-16T01:22:42,730 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2023-12-16T01:22:42,732 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2023-12-16T01:22:42,740 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2023-12-16T01:22:42,745 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2023-12-16T01:22:42,747 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2023-12-16T01:22:42,750 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2023-12-16T01:22:42,752 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2023-12-16T01:22:42,753 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2023-12-16T01:22:42,755 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2023-12-16T01:22:42,757 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2023-12-16T01:22:42,760 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2023-12-16T01:22:42,762 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2023-12-16T01:22:42,764 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2023-12-16T01:22:42,766 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2023-12-16T01:22:42,773 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2023-12-16T01:22:42,777 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2023-12-16T01:22:42,778 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2023-12-16T01:22:42,782 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2023-12-16T01:22:42,785 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2023-12-16T01:22:42,789 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2023-12-16T01:22:42,791 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2023-12-16T01:22:42,793 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2023-12-16T01:22:42,795 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2023-12-16T01:22:42,796 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2023-12-16T01:22:42,798 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-12-16T01:22:42,800 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-12-16T01:22:42,801 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2023-12-16T01:22:42,802 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-12-16T01:22:42,804 adding 'deepspeed/ops/csrc/includes/context.h' 2023-12-16T01:22:42,805 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-12-16T01:22:42,807 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-12-16T01:22:42,808 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-12-16T01:22:42,810 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2023-12-16T01:22:42,811 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-12-16T01:22:42,813 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-12-16T01:22:42,815 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-12-16T01:22:42,816 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-12-16T01:22:42,817 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-12-16T01:22:42,819 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-12-16T01:22:42,820 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-12-16T01:22:42,821 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-12-16T01:22:42,823 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-12-16T01:22:42,824 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-12-16T01:22:42,826 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-12-16T01:22:42,828 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-12-16T01:22:42,829 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-12-16T01:22:42,831 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-12-16T01:22:42,833 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-12-16T01:22:42,835 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-12-16T01:22:42,837 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-12-16T01:22:42,838 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-12-16T01:22:42,840 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-12-16T01:22:42,841 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-12-16T01:22:42,843 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-12-16T01:22:42,845 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-12-16T01:22:42,847 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2023-12-16T01:22:42,848 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2023-12-16T01:22:42,850 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2023-12-16T01:22:42,851 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2023-12-16T01:22:42,852 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2023-12-16T01:22:42,854 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-12-16T01:22:42,857 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-12-16T01:22:42,858 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-12-16T01:22:42,860 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2023-12-16T01:22:42,862 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-12-16T01:22:42,863 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2023-12-16T01:22:42,865 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2023-12-16T01:22:42,867 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-12-16T01:22:42,868 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-12-16T01:22:42,870 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-12-16T01:22:42,871 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-12-16T01:22:42,873 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-12-16T01:22:42,875 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-12-16T01:22:42,877 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-12-16T01:22:42,878 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-12-16T01:22:42,881 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-12-16T01:22:42,883 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-12-16T01:22:42,887 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-12-16T01:22:42,889 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-12-16T01:22:42,891 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-12-16T01:22:42,895 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-12-16T01:22:42,898 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-12-16T01:22:42,900 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-12-16T01:22:42,903 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-12-16T01:22:42,904 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-12-16T01:22:42,907 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-12-16T01:22:42,909 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-12-16T01:22:42,911 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2023-12-16T01:22:42,916 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-12-16T01:22:42,918 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-12-16T01:22:42,920 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2023-12-16T01:22:42,922 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-12-16T01:22:42,925 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-12-16T01:22:42,928 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-12-16T01:22:42,929 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-12-16T01:22:42,931 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-12-16T01:22:42,933 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-12-16T01:22:42,934 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2023-12-16T01:22:42,936 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2023-12-16T01:22:42,937 adding 'deepspeed/ops/lamb/__init__.py' 2023-12-16T01:22:42,939 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-12-16T01:22:42,941 adding 'deepspeed/ops/lion/__init__.py' 2023-12-16T01:22:42,942 adding 'deepspeed/ops/lion/cpu_lion.py' 2023-12-16T01:22:42,944 adding 'deepspeed/ops/lion/fused_lion.py' 2023-12-16T01:22:42,945 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2023-12-16T01:22:42,947 adding 'deepspeed/ops/op_builder/__init__.py' 2023-12-16T01:22:42,948 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-12-16T01:22:42,949 adding 'deepspeed/ops/op_builder/async_io.py' 2023-12-16T01:22:42,953 adding 'deepspeed/ops/op_builder/builder.py' 2023-12-16T01:22:42,954 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-12-16T01:22:42,955 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-12-16T01:22:42,956 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2023-12-16T01:22:42,958 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2023-12-16T01:22:42,959 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-12-16T01:22:42,960 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-12-16T01:22:42,961 adding 'deepspeed/ops/op_builder/fused_lion.py' 2023-12-16T01:22:42,962 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2023-12-16T01:22:42,964 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2023-12-16T01:22:42,965 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-12-16T01:22:42,966 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2023-12-16T01:22:42,968 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2023-12-16T01:22:42,969 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-12-16T01:22:42,970 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-12-16T01:22:42,971 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-12-16T01:22:42,972 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-12-16T01:22:42,974 adding 'deepspeed/ops/op_builder/transformer.py' 2023-12-16T01:22:42,975 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-12-16T01:22:42,977 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2023-12-16T01:22:42,978 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2023-12-16T01:22:42,979 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2023-12-16T01:22:42,980 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2023-12-16T01:22:42,981 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2023-12-16T01:22:42,983 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2023-12-16T01:22:42,985 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2023-12-16T01:22:42,986 adding 'deepspeed/ops/op_builder/npu/builder.py' 2023-12-16T01:22:42,987 adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py' 2023-12-16T01:22:42,988 adding 'deepspeed/ops/op_builder/npu/cpu_adam.py' 2023-12-16T01:22:42,989 adding 'deepspeed/ops/op_builder/npu/cpu_lion.py' 2023-12-16T01:22:42,991 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2023-12-16T01:22:42,992 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2023-12-16T01:22:42,994 adding 'deepspeed/ops/quantizer/__init__.py' 2023-12-16T01:22:42,995 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-12-16T01:22:42,996 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-12-16T01:22:42,998 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-12-16T01:22:43,000 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-12-16T01:22:43,001 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-12-16T01:22:43,005 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-12-16T01:22:43,007 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-12-16T01:22:43,009 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-12-16T01:22:43,010 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-12-16T01:22:43,013 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-12-16T01:22:43,015 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-12-16T01:22:43,017 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-12-16T01:22:43,018 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-12-16T01:22:43,020 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-12-16T01:22:43,022 adding 'deepspeed/ops/transformer/__init__.py' 2023-12-16T01:22:43,024 adding 'deepspeed/ops/transformer/transformer.py' 2023-12-16T01:22:43,026 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-12-16T01:22:43,027 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-12-16T01:22:43,029 adding 'deepspeed/ops/transformer/inference/config.py' 2023-12-16T01:22:43,030 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-12-16T01:22:43,031 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-12-16T01:22:43,033 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-12-16T01:22:43,035 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-12-16T01:22:43,036 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-12-16T01:22:43,038 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-12-16T01:22:43,040 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-12-16T01:22:43,042 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-12-16T01:22:43,043 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-12-16T01:22:43,044 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-12-16T01:22:43,045 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-12-16T01:22:43,047 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-12-16T01:22:43,048 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-12-16T01:22:43,049 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-12-16T01:22:43,050 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-12-16T01:22:43,052 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-12-16T01:22:43,053 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-12-16T01:22:43,055 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2023-12-16T01:22:43,057 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2023-12-16T01:22:43,058 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2023-12-16T01:22:43,060 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2023-12-16T01:22:43,062 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2023-12-16T01:22:43,063 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2023-12-16T01:22:43,065 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2023-12-16T01:22:43,066 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2023-12-16T01:22:43,067 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2023-12-16T01:22:43,069 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2023-12-16T01:22:43,071 adding 'deepspeed/pipe/__init__.py' 2023-12-16T01:22:43,072 adding 'deepspeed/profiling/__init__.py' 2023-12-16T01:22:43,074 adding 'deepspeed/profiling/config.py' 2023-12-16T01:22:43,075 adding 'deepspeed/profiling/constants.py' 2023-12-16T01:22:43,077 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-12-16T01:22:43,082 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-12-16T01:22:43,084 adding 'deepspeed/runtime/__init__.py' 2023-12-16T01:22:43,087 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-12-16T01:22:43,091 adding 'deepspeed/runtime/config.py' 2023-12-16T01:22:43,093 adding 'deepspeed/runtime/config_utils.py' 2023-12-16T01:22:43,095 adding 'deepspeed/runtime/constants.py' 2023-12-16T01:22:43,096 adding 'deepspeed/runtime/dataloader.py' 2023-12-16T01:22:43,098 adding 'deepspeed/runtime/eigenvalue.py' 2023-12-16T01:22:43,115 adding 'deepspeed/runtime/engine.py' 2023-12-16T01:22:43,119 adding 'deepspeed/runtime/hybrid_engine.py' 2023-12-16T01:22:43,123 adding 'deepspeed/runtime/lr_schedules.py' 2023-12-16T01:22:43,124 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-12-16T01:22:43,126 adding 'deepspeed/runtime/quantize.py' 2023-12-16T01:22:43,127 adding 'deepspeed/runtime/sparse_tensor.py' 2023-12-16T01:22:43,129 adding 'deepspeed/runtime/state_dict_factory.py' 2023-12-16T01:22:43,133 adding 'deepspeed/runtime/utils.py' 2023-12-16T01:22:43,135 adding 'deepspeed/runtime/weight_quantizer.py' 2023-12-16T01:22:43,137 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-12-16T01:22:43,141 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-12-16T01:22:43,143 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-12-16T01:22:43,144 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-12-16T01:22:43,146 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-12-16T01:22:43,147 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-12-16T01:22:43,148 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-12-16T01:22:43,150 adding 'deepspeed/runtime/comm/__init__.py' 2023-12-16T01:22:43,151 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-12-16T01:22:43,153 adding 'deepspeed/runtime/comm/hccl.py' 2023-12-16T01:22:43,155 adding 'deepspeed/runtime/comm/mpi.py' 2023-12-16T01:22:43,157 adding 'deepspeed/runtime/comm/nccl.py' 2023-12-16T01:22:43,158 adding 'deepspeed/runtime/compression/__init__.py' 2023-12-16T01:22:43,160 adding 'deepspeed/runtime/compression/cupy.py' 2023-12-16T01:22:43,161 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-12-16T01:22:43,163 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-12-16T01:22:43,164 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-12-16T01:22:43,166 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-12-16T01:22:43,167 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-12-16T01:22:43,169 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-12-16T01:22:43,170 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-12-16T01:22:43,171 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-12-16T01:22:43,172 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-12-16T01:22:43,174 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-12-16T01:22:43,177 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-12-16T01:22:43,179 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-12-16T01:22:43,182 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-12-16T01:22:43,183 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-12-16T01:22:43,185 adding 'deepspeed/runtime/fp16/__init__.py' 2023-12-16T01:22:43,187 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-12-16T01:22:43,190 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-12-16T01:22:43,192 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-12-16T01:22:43,194 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-12-16T01:22:43,196 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-12-16T01:22:43,199 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-12-16T01:22:43,202 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-12-16T01:22:43,204 adding 'deepspeed/runtime/pipe/__init__.py' 2023-12-16T01:22:43,210 adding 'deepspeed/runtime/pipe/engine.py' 2023-12-16T01:22:43,214 adding 'deepspeed/runtime/pipe/module.py' 2023-12-16T01:22:43,215 adding 'deepspeed/runtime/pipe/p2p.py' 2023-12-16T01:22:43,217 adding 'deepspeed/runtime/pipe/schedule.py' 2023-12-16T01:22:43,220 adding 'deepspeed/runtime/pipe/topology.py' 2023-12-16T01:22:43,222 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-12-16T01:22:43,223 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-12-16T01:22:43,225 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-12-16T01:22:43,226 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-12-16T01:22:43,229 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-12-16T01:22:43,230 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-12-16T01:22:43,233 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-12-16T01:22:43,235 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-12-16T01:22:43,236 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-12-16T01:22:43,238 adding 'deepspeed/runtime/zero/__init__.py' 2023-12-16T01:22:43,240 adding 'deepspeed/runtime/zero/config.py' 2023-12-16T01:22:43,242 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-12-16T01:22:43,243 adding 'deepspeed/runtime/zero/linear.py' 2023-12-16T01:22:43,246 adding 'deepspeed/runtime/zero/mics.py' 2023-12-16T01:22:43,248 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-12-16T01:22:43,249 adding 'deepspeed/runtime/zero/offload_config.py' 2023-12-16T01:22:43,252 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-12-16T01:22:43,263 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-12-16T01:22:43,266 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-12-16T01:22:43,268 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2023-12-16T01:22:43,282 adding 'deepspeed/runtime/zero/stage3.py' 2023-12-16T01:22:43,295 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-12-16T01:22:43,297 adding 'deepspeed/runtime/zero/test.py' 2023-12-16T01:22:43,299 adding 'deepspeed/runtime/zero/tiling.py' 2023-12-16T01:22:43,300 adding 'deepspeed/runtime/zero/utils.py' 2023-12-16T01:22:43,302 adding 'deepspeed/sequence/__init__.py' 2023-12-16T01:22:43,304 adding 'deepspeed/sequence/layer.py' 2023-12-16T01:22:43,305 adding 'deepspeed/utils/__init__.py' 2023-12-16T01:22:43,307 adding 'deepspeed/utils/comms_logging.py' 2023-12-16T01:22:43,309 adding 'deepspeed/utils/debug.py' 2023-12-16T01:22:43,310 adding 'deepspeed/utils/exceptions.py' 2023-12-16T01:22:43,312 adding 'deepspeed/utils/groups.py' 2023-12-16T01:22:43,314 adding 'deepspeed/utils/init_on_device.py' 2023-12-16T01:22:43,315 adding 'deepspeed/utils/logging.py' 2023-12-16T01:22:43,317 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-12-16T01:22:43,318 adding 'deepspeed/utils/numa.py' 2023-12-16T01:22:43,320 adding 'deepspeed/utils/nvtx.py' 2023-12-16T01:22:43,321 adding 'deepspeed/utils/tensor_fragment.py' 2023-12-16T01:22:43,323 adding 'deepspeed/utils/timer.py' 2023-12-16T01:22:43,325 adding 'deepspeed/utils/types.py' 2023-12-16T01:22:43,327 adding 'deepspeed/utils/zero_to_fp32.py' 2023-12-16T01:22:43,330 adding 'deepspeed-0.12.5.data/scripts/deepspeed' 2023-12-16T01:22:43,331 adding 'deepspeed-0.12.5.data/scripts/deepspeed.pt' 2023-12-16T01:22:43,332 adding 'deepspeed-0.12.5.data/scripts/ds' 2023-12-16T01:22:43,333 adding 'deepspeed-0.12.5.data/scripts/ds_bench' 2023-12-16T01:22:43,334 adding 'deepspeed-0.12.5.data/scripts/ds_elastic' 2023-12-16T01:22:43,336 adding 'deepspeed-0.12.5.data/scripts/ds_report' 2023-12-16T01:22:43,337 adding 'deepspeed-0.12.5.data/scripts/ds_ssh' 2023-12-16T01:22:43,338 adding 'deepspeed-0.12.5.data/scripts/dsr' 2023-12-16T01:22:43,343 adding 'deepspeed-0.12.5.dist-info/METADATA' 2023-12-16T01:22:43,345 adding 'deepspeed-0.12.5.dist-info/WHEEL' 2023-12-16T01:22:43,346 adding 'deepspeed-0.12.5.dist-info/entry_points.txt' 2023-12-16T01:22:43,346 adding 'deepspeed-0.12.5.dist-info/top_level.txt' 2023-12-16T01:22:43,359 adding 'deepspeed-0.12.5.dist-info/RECORD' 2023-12-16T01:22:43,397 removing build/bdist.linux-armv7l/wheel 2023-12-16T01:22:43,575 deepspeed build time = 8.964451551437378 secs 2023-12-16T01:22:43,694 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-12-16T01:22:43,709 Created wheel for deepspeed: filename=deepspeed-0.12.5-py3-none-any.whl size=1297407 sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 2023-12-16T01:22:43,711 Stored in directory: /tmp/pip-ephem-wheel-cache-n0a8u651/wheels/83/4b/7c/6f7ce6d268621823fd252b4c88a1c53652af10162a098752d4 2023-12-16T01:22:43,748 Successfully built deepspeed 2023-12-16T01:22:43,780 Removed build tracker: '/tmp/pip-build-tracker-ldre5wgi'