2024-04-15T21:38:13,498 Created temporary directory: /tmp/pip-build-tracker-nayqkish 2024-04-15T21:38:13,499 Initialized build tracking at /tmp/pip-build-tracker-nayqkish 2024-04-15T21:38:13,499 Created build tracker: /tmp/pip-build-tracker-nayqkish 2024-04-15T21:38:13,500 Entered build tracker: /tmp/pip-build-tracker-nayqkish 2024-04-15T21:38:13,501 Created temporary directory: /tmp/pip-wheel-_12bdcvj 2024-04-15T21:38:13,504 Created temporary directory: /tmp/pip-ephem-wheel-cache-c05tsjyy 2024-04-15T21:38:13,528 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2024-04-15T21:38:13,532 2 location(s) to search for versions of deepspeed: 2024-04-15T21:38:13,532 * https://pypi.org/simple/deepspeed/ 2024-04-15T21:38:13,532 * https://www.piwheels.org/simple/deepspeed/ 2024-04-15T21:38:13,533 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2024-04-15T21:38:13,534 Getting page https://pypi.org/simple/deepspeed/ 2024-04-15T21:38:13,536 Found index url https://pypi.org/simple/ 2024-04-15T21:38:13,761 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2024-04-15T21:38:13,778 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2024-04-15T21:38:13,778 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2024-04-15T21:38:13,779 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2024-04-15T21:38:13,780 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2024-04-15T21:38:13,781 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2024-04-15T21:38:13,781 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2024-04-15T21:38:13,782 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2024-04-15T21:38:13,783 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2024-04-15T21:38:13,784 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2024-04-15T21:38:13,785 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2024-04-15T21:38:13,786 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2024-04-15T21:38:13,787 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2024-04-15T21:38:13,821 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2024-04-15T21:38:13,823 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2024-04-15T21:38:13,823 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2024-04-15T21:38:13,824 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2024-04-15T21:38:13,825 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2024-04-15T21:38:13,825 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2024-04-15T21:38:13,826 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2024-04-15T21:38:13,827 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2024-04-15T21:38:13,827 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2024-04-15T21:38:13,828 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2024-04-15T21:38:13,829 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2024-04-15T21:38:13,829 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2024-04-15T21:38:13,830 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2024-04-15T21:38:13,831 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2024-04-15T21:38:13,832 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2024-04-15T21:38:13,833 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2024-04-15T21:38:13,834 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2024-04-15T21:38:13,834 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2024-04-15T21:38:13,835 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2024-04-15T21:38:13,836 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2024-04-15T21:38:13,837 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2024-04-15T21:38:13,838 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2024-04-15T21:38:13,839 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2024-04-15T21:38:13,839 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2024-04-15T21:38:13,840 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2024-04-15T21:38:13,841 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2024-04-15T21:38:13,842 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2024-04-15T21:38:13,842 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2024-04-15T21:38:13,843 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2024-04-15T21:38:13,844 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2024-04-15T21:38:13,845 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2024-04-15T21:38:13,845 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2024-04-15T21:38:13,846 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2024-04-15T21:38:13,847 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2024-04-15T21:38:13,848 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2024-04-15T21:38:13,849 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2024-04-15T21:38:13,850 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2024-04-15T21:38:13,851 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2024-04-15T21:38:13,852 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2024-04-15T21:38:13,853 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2024-04-15T21:38:13,854 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2024-04-15T21:38:13,855 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2024-04-15T21:38:13,856 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2024-04-15T21:38:13,857 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2024-04-15T21:38:13,858 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2024-04-15T21:38:13,858 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2024-04-15T21:38:13,859 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2024-04-15T21:38:13,860 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2024-04-15T21:38:13,860 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2024-04-15T21:38:13,861 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2024-04-15T21:38:13,862 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2024-04-15T21:38:13,863 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2024-04-15T21:38:13,863 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2024-04-15T21:38:13,864 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2024-04-15T21:38:13,865 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2024-04-15T21:38:13,865 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2024-04-15T21:38:13,867 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2024-04-15T21:38:13,867 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2024-04-15T21:38:13,868 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2024-04-15T21:38:13,869 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2024-04-15T21:38:13,869 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2024-04-15T21:38:13,870 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2024-04-15T21:38:13,871 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2024-04-15T21:38:13,871 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2024-04-15T21:38:13,872 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2024-04-15T21:38:13,873 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2024-04-15T21:38:13,873 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2024-04-15T21:38:13,874 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2024-04-15T21:38:13,875 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2024-04-15T21:38:13,876 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2024-04-15T21:38:13,877 Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4 2024-04-15T21:38:13,877 Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5 2024-04-15T21:38:13,878 Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6 2024-04-15T21:38:13,879 Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0 2024-04-15T21:38:13,881 Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1 2024-04-15T21:38:13,882 Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2 2024-04-15T21:38:13,882 Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3 2024-04-15T21:38:13,883 Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4 2024-04-15T21:38:13,884 Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5 2024-04-15T21:38:13,884 Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0 2024-04-15T21:38:13,885 Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1 2024-04-15T21:38:13,886 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2024-04-15T21:38:13,886 Getting page https://www.piwheels.org/simple/deepspeed/ 2024-04-15T21:38:13,888 Found index url https://www.piwheels.org/simple/ 2024-04-15T21:38:14,477 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2024-04-15T21:38:14,508 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,509 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,510 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,511 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,512 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,513 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,513 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,514 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,515 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,516 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,517 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,517 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,518 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,519 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,519 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,520 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,521 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,522 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,523 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,524 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,524 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,525 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,526 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,527 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,528 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,528 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,529 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,530 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,530 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,531 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,532 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,533 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,533 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,534 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,535 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,536 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,536 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,537 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,538 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,539 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,539 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,540 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,541 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,541 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,542 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,543 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,543 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,544 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,545 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,546 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,546 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,547 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,548 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,549 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,550 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,551 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,551 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,552 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,552 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,553 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,554 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,555 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2024-04-15T21:38:14,556 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2024-04-15T21:38:14,556 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2024-04-15T21:38:14,601 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2024-04-15T21:38:14,620 Collecting deepspeed==0.14.1 2024-04-15T21:38:14,625 Created temporary directory: /tmp/pip-unpack-r3thd11q 2024-04-15T21:38:14,844 Downloading deepspeed-0.14.1.tar.gz (1.3 MB) 2024-04-15T21:38:18,069 Added deepspeed==0.14.1 from https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz to build tracker '/tmp/pip-build-tracker-nayqkish' 2024-04-15T21:38:18,072 Running setup.py (path:/tmp/pip-wheel-_12bdcvj/deepspeed_2d14ebe4ca83428780596e79411c3198/setup.py) egg_info for package deepspeed 2024-04-15T21:38:18,074 Created temporary directory: /tmp/pip-pip-egg-info-gjyl07m4 2024-04-15T21:38:18,075 Preparing metadata (setup.py): started 2024-04-15T21:38:18,078 Running command python setup.py egg_info 2024-04-15T21:38:19,234 fatal: not a git repository (or any of the parent directories): .git 2024-04-15T21:38:20,016 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2024-04-15T21:38:20,016  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2024-04-15T21:38:20,017 DS_BUILD_OPS=0 2024-04-15T21:38:20,017  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2024-04-15T21:38:20,018  [WARNING]  async_io: please install the libaio-dev package with apt 2024-04-15T21:38:20,018  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2024-04-15T21:38:20,019  [WARNING]  Please install torch if trying to pre-compile kernels 2024-04-15T21:38:20,019  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:20,020  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:20,020  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:20,021  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:20,022  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:20,022  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:20,023  [WARNING]  unable to import torch, please install it first 2024-04-15T21:38:20,023  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:20,024 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False} 2024-04-15T21:38:20,024 version=0.14.1, git_hash=unknown, git_branch=unknown 2024-04-15T21:38:20,025 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2024-04-15T21:38:20,026 ext_modules=[] 2024-04-15T21:38:20,026 running egg_info 2024-04-15T21:38:20,027 creating /tmp/pip-pip-egg-info-gjyl07m4/deepspeed.egg-info 2024-04-15T21:38:20,049 writing /tmp/pip-pip-egg-info-gjyl07m4/deepspeed.egg-info/PKG-INFO 2024-04-15T21:38:20,083 writing dependency_links to /tmp/pip-pip-egg-info-gjyl07m4/deepspeed.egg-info/dependency_links.txt 2024-04-15T21:38:20,085 writing entry points to /tmp/pip-pip-egg-info-gjyl07m4/deepspeed.egg-info/entry_points.txt 2024-04-15T21:38:20,103 writing requirements to /tmp/pip-pip-egg-info-gjyl07m4/deepspeed.egg-info/requires.txt 2024-04-15T21:38:20,104 writing top-level names to /tmp/pip-pip-egg-info-gjyl07m4/deepspeed.egg-info/top_level.txt 2024-04-15T21:38:20,107 writing manifest file '/tmp/pip-pip-egg-info-gjyl07m4/deepspeed.egg-info/SOURCES.txt' 2024-04-15T21:38:20,333 reading manifest file '/tmp/pip-pip-egg-info-gjyl07m4/deepspeed.egg-info/SOURCES.txt' 2024-04-15T21:38:20,334 reading manifest template 'MANIFEST.in' 2024-04-15T21:38:20,337 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2024-04-15T21:38:20,337 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2024-04-15T21:38:21,574 warning: no files found matching '*.hip' under directory 'deepspeed' 2024-04-15T21:38:22,581 warning: no files found matching '*.cc' under directory 'deepspeed' 2024-04-15T21:38:23,149 warning: no files found matching '*.tr' under directory 'csrc' 2024-04-15T21:38:23,267 warning: no files found matching '*.cc' under directory 'csrc' 2024-04-15T21:38:23,304 warning: no files found matching '*.py' under directory 'benchmarks' 2024-04-15T21:38:23,341 writing manifest file '/tmp/pip-pip-egg-info-gjyl07m4/deepspeed.egg-info/SOURCES.txt' 2024-04-15T21:38:23,344 deepspeed build time = 4.107018947601318 secs 2024-04-15T21:38:23,457 Preparing metadata (setup.py): finished with status 'done' 2024-04-15T21:38:23,464 Source in /tmp/pip-wheel-_12bdcvj/deepspeed_2d14ebe4ca83428780596e79411c3198 has version 0.14.1, which satisfies requirement deepspeed==0.14.1 from https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz 2024-04-15T21:38:23,465 Removed deepspeed==0.14.1 from https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz from build tracker '/tmp/pip-build-tracker-nayqkish' 2024-04-15T21:38:23,474 Created temporary directory: /tmp/pip-unpack-73y80946 2024-04-15T21:38:23,475 Created temporary directory: /tmp/pip-unpack-lqc14exh 2024-04-15T21:38:23,731 Building wheels for collected packages: deepspeed 2024-04-15T21:38:23,735 Created temporary directory: /tmp/pip-wheel-qo9b5j4o 2024-04-15T21:38:23,736 Building wheel for deepspeed (setup.py): started 2024-04-15T21:38:23,737 Destination directory: /tmp/pip-wheel-qo9b5j4o 2024-04-15T21:38:23,738 Running command python setup.py bdist_wheel 2024-04-15T21:38:24,186 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2024-04-15T21:38:24,194  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2024-04-15T21:38:24,271 DS_BUILD_OPS=0 2024-04-15T21:38:24,386  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2024-04-15T21:38:24,444  [WARNING]  async_io: please install the libaio-dev package with apt 2024-04-15T21:38:24,445  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2024-04-15T21:38:24,446  [WARNING]  Please install torch if trying to pre-compile kernels 2024-04-15T21:38:24,446  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:24,447  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:24,447  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:24,448  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:24,448  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:24,449  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:24,450  [WARNING]  unable to import torch, please install it first 2024-04-15T21:38:24,450  [WARNING]  Please install torch if trying to pre-compile inference kernels 2024-04-15T21:38:24,451 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False} 2024-04-15T21:38:24,459 fatal: not a git repository (or any of the parent directories): .git 2024-04-15T21:38:24,461 version=0.14.1, git_hash=unknown, git_branch=unknown 2024-04-15T21:38:24,462 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2024-04-15T21:38:24,462 ext_modules=[] 2024-04-15T21:38:25,356 running bdist_wheel 2024-04-15T21:38:25,691 running build 2024-04-15T21:38:25,692 running build_py 2024-04-15T21:38:25,723 creating build 2024-04-15T21:38:25,724 creating build/lib 2024-04-15T21:38:25,725 creating build/lib/deepspeed 2024-04-15T21:38:25,726 copying deepspeed/__init__.py -> build/lib/deepspeed 2024-04-15T21:38:25,729 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2024-04-15T21:38:25,731 copying deepspeed/env_report.py -> build/lib/deepspeed 2024-04-15T21:38:25,733 copying deepspeed/constants.py -> build/lib/deepspeed 2024-04-15T21:38:25,734 copying deepspeed/pydantic_v1.py -> build/lib/deepspeed 2024-04-15T21:38:25,736 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2024-04-15T21:38:25,738 creating build/lib/deepspeed/nebula 2024-04-15T21:38:25,739 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2024-04-15T21:38:25,741 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2024-04-15T21:38:25,743 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2024-04-15T21:38:25,745 creating build/lib/deepspeed/module_inject 2024-04-15T21:38:25,746 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,748 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,751 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,753 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,755 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,757 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,759 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,762 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,765 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,767 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,769 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,771 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,773 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2024-04-15T21:38:25,777 creating build/lib/deepspeed/runtime 2024-04-15T21:38:25,778 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,780 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,782 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,784 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,793 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,799 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,802 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,804 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,806 copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,808 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,811 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,814 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,817 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,821 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,823 copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,825 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,828 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,832 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2024-04-15T21:38:25,835 creating build/lib/deepspeed/autotuning 2024-04-15T21:38:25,835 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2024-04-15T21:38:25,837 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2024-04-15T21:38:25,840 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2024-04-15T21:38:25,842 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2024-04-15T21:38:25,844 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2024-04-15T21:38:25,847 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2024-04-15T21:38:25,852 creating build/lib/deepspeed/monitor 2024-04-15T21:38:25,853 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2024-04-15T21:38:25,855 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2024-04-15T21:38:25,857 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2024-04-15T21:38:25,859 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2024-04-15T21:38:25,862 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2024-04-15T21:38:25,863 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2024-04-15T21:38:25,866 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2024-04-15T21:38:25,868 creating build/lib/deepspeed/ops 2024-04-15T21:38:25,869 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2024-04-15T21:38:25,872 creating build/lib/deepspeed/launcher 2024-04-15T21:38:25,873 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2024-04-15T21:38:25,874 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2024-04-15T21:38:25,877 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2024-04-15T21:38:25,880 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2024-04-15T21:38:25,883 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2024-04-15T21:38:25,885 copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher 2024-04-15T21:38:25,887 creating build/lib/deepspeed/model_implementations 2024-04-15T21:38:25,888 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2024-04-15T21:38:25,891 creating build/lib/deepspeed/utils 2024-04-15T21:38:25,892 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,894 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,896 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,900 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,902 copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,904 copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,906 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,908 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,910 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,912 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,914 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,918 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,922 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,925 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,928 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,931 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,933 copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils 2024-04-15T21:38:25,935 creating build/lib/deepspeed/elasticity 2024-04-15T21:38:25,936 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2024-04-15T21:38:25,938 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2024-04-15T21:38:25,940 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2024-04-15T21:38:25,941 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2024-04-15T21:38:25,943 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2024-04-15T21:38:25,945 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2024-04-15T21:38:25,949 creating build/lib/deepspeed/profiling 2024-04-15T21:38:25,949 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2024-04-15T21:38:25,951 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2024-04-15T21:38:25,954 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2024-04-15T21:38:25,956 creating build/lib/deepspeed/inference 2024-04-15T21:38:25,957 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2024-04-15T21:38:25,959 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2024-04-15T21:38:25,962 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2024-04-15T21:38:25,965 creating build/lib/deepspeed/accelerator 2024-04-15T21:38:25,966 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2024-04-15T21:38:25,967 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2024-04-15T21:38:25,970 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2024-04-15T21:38:25,972 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2024-04-15T21:38:25,975 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2024-04-15T21:38:25,978 copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator 2024-04-15T21:38:25,980 copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator 2024-04-15T21:38:25,982 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2024-04-15T21:38:25,985 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2024-04-15T21:38:25,988 creating build/lib/deepspeed/comm 2024-04-15T21:38:25,989 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2024-04-15T21:38:25,991 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2024-04-15T21:38:25,994 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2024-04-15T21:38:25,995 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2024-04-15T21:38:25,998 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2024-04-15T21:38:26,000 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2024-04-15T21:38:26,002 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2024-04-15T21:38:26,004 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2024-04-15T21:38:26,006 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2024-04-15T21:38:26,009 creating build/lib/deepspeed/sequence 2024-04-15T21:38:26,010 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2024-04-15T21:38:26,012 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2024-04-15T21:38:26,014 creating build/lib/deepspeed/compression 2024-04-15T21:38:26,015 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2024-04-15T21:38:26,019 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2024-04-15T21:38:26,022 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2024-04-15T21:38:26,024 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2024-04-15T21:38:26,028 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2024-04-15T21:38:26,033 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2024-04-15T21:38:26,036 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2024-04-15T21:38:26,039 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2024-04-15T21:38:26,041 creating build/lib/deepspeed/pipe 2024-04-15T21:38:26,042 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2024-04-15T21:38:26,045 creating build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,046 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,049 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,053 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,058 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,060 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,062 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,064 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,066 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,068 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,070 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2024-04-15T21:38:26,073 creating build/lib/deepspeed/moe 2024-04-15T21:38:26,074 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2024-04-15T21:38:26,075 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2024-04-15T21:38:26,078 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2024-04-15T21:38:26,080 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2024-04-15T21:38:26,082 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2024-04-15T21:38:26,086 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2024-04-15T21:38:26,089 creating build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,090 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,092 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,094 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,096 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,098 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,100 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,102 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,105 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,106 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,108 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,111 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,113 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,115 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,118 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,121 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,124 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,126 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,128 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,130 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2024-04-15T21:38:26,132 creating build/lib/deepspeed/module_inject/containers/features 2024-04-15T21:38:26,134 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2024-04-15T21:38:26,136 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2024-04-15T21:38:26,138 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2024-04-15T21:38:26,141 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2024-04-15T21:38:26,143 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2024-04-15T21:38:26,146 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2024-04-15T21:38:26,148 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2024-04-15T21:38:26,151 creating build/lib/deepspeed/runtime/checkpoint_engine 2024-04-15T21:38:26,152 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2024-04-15T21:38:26,154 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2024-04-15T21:38:26,156 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2024-04-15T21:38:26,159 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2024-04-15T21:38:26,162 creating build/lib/deepspeed/runtime/fp16 2024-04-15T21:38:26,163 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2024-04-15T21:38:26,165 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2024-04-15T21:38:26,168 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2024-04-15T21:38:26,171 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2024-04-15T21:38:26,175 creating build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,176 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,179 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,185 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,188 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,191 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,194 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,197 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,200 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,203 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,205 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,208 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,210 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,213 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,216 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,272 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,274 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2024-04-15T21:38:26,323 creating build/lib/deepspeed/runtime/activation_checkpointing 2024-04-15T21:38:26,324 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2024-04-15T21:38:26,327 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2024-04-15T21:38:26,330 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2024-04-15T21:38:26,334 creating build/lib/deepspeed/runtime/data_pipeline 2024-04-15T21:38:26,335 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2024-04-15T21:38:26,337 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2024-04-15T21:38:26,339 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2024-04-15T21:38:26,342 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2024-04-15T21:38:26,345 creating build/lib/deepspeed/runtime/comm 2024-04-15T21:38:26,346 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2024-04-15T21:38:26,348 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2024-04-15T21:38:26,350 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2024-04-15T21:38:26,353 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2024-04-15T21:38:26,355 copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm 2024-04-15T21:38:26,358 creating build/lib/deepspeed/runtime/swap_tensor 2024-04-15T21:38:26,359 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2024-04-15T21:38:26,362 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2024-04-15T21:38:26,364 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2024-04-15T21:38:26,366 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2024-04-15T21:38:26,369 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2024-04-15T21:38:26,370 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2024-04-15T21:38:26,373 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2024-04-15T21:38:26,376 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2024-04-15T21:38:26,378 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2024-04-15T21:38:26,382 creating build/lib/deepspeed/runtime/compression 2024-04-15T21:38:26,383 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2024-04-15T21:38:26,385 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2024-04-15T21:38:26,387 creating build/lib/deepspeed/runtime/pipe 2024-04-15T21:38:26,388 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2024-04-15T21:38:26,391 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2024-04-15T21:38:26,392 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2024-04-15T21:38:26,397 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2024-04-15T21:38:26,399 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2024-04-15T21:38:26,402 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2024-04-15T21:38:26,406 creating build/lib/deepspeed/runtime/fp16/onebit 2024-04-15T21:38:26,407 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2024-04-15T21:38:26,410 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2024-04-15T21:38:26,413 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2024-04-15T21:38:26,416 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2024-04-15T21:38:26,420 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:26,421 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:26,424 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:26,426 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:26,429 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:26,432 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:26,435 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:26,436 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:26,439 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:26,442 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:26,445 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:26,450 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:26,453 creating build/lib/deepspeed/autotuning/tuner 2024-04-15T21:38:26,455 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2024-04-15T21:38:26,457 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2024-04-15T21:38:26,459 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2024-04-15T21:38:26,462 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2024-04-15T21:38:26,464 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2024-04-15T21:38:26,466 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2024-04-15T21:38:26,469 creating build/lib/deepspeed/ops/aio 2024-04-15T21:38:26,471 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2024-04-15T21:38:26,475 creating build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,476 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,479 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,482 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,484 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,487 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,489 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,492 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,495 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,498 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,500 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,502 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,504 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,506 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,508 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,511 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,513 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,515 copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,517 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,519 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,522 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,524 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,526 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,527 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2024-04-15T21:38:26,530 creating build/lib/deepspeed/ops/deepspeed4science 2024-04-15T21:38:26,531 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2024-04-15T21:38:26,533 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2024-04-15T21:38:26,535 creating build/lib/deepspeed/ops/lamb 2024-04-15T21:38:26,536 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2024-04-15T21:38:26,538 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2024-04-15T21:38:26,541 creating build/lib/deepspeed/ops/fp_quantizer 2024-04-15T21:38:26,542 copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer 2024-04-15T21:38:26,544 copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer 2024-04-15T21:38:26,547 creating build/lib/deepspeed/ops/lion 2024-04-15T21:38:26,548 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2024-04-15T21:38:26,550 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2024-04-15T21:38:26,553 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2024-04-15T21:38:26,555 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2024-04-15T21:38:26,558 creating build/lib/deepspeed/ops/adam 2024-04-15T21:38:26,559 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2024-04-15T21:38:26,561 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2024-04-15T21:38:26,564 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2024-04-15T21:38:26,566 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2024-04-15T21:38:26,568 creating build/lib/deepspeed/ops/transformer 2024-04-15T21:38:26,569 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2024-04-15T21:38:26,571 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2024-04-15T21:38:26,574 creating build/lib/deepspeed/ops/adagrad 2024-04-15T21:38:26,575 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2024-04-15T21:38:26,576 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2024-04-15T21:38:26,579 creating build/lib/deepspeed/ops/sparse_attention 2024-04-15T21:38:26,580 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2024-04-15T21:38:26,582 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2024-04-15T21:38:26,585 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2024-04-15T21:38:26,588 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2024-04-15T21:38:26,591 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2024-04-15T21:38:26,593 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2024-04-15T21:38:26,597 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2024-04-15T21:38:26,600 creating build/lib/deepspeed/ops/quantizer 2024-04-15T21:38:26,601 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2024-04-15T21:38:26,603 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2024-04-15T21:38:26,605 creating build/lib/deepspeed/ops/random_ltd 2024-04-15T21:38:26,606 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2024-04-15T21:38:26,608 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2024-04-15T21:38:26,611 creating build/lib/deepspeed/ops/op_builder/npu 2024-04-15T21:38:26,612 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2024-04-15T21:38:26,614 copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2024-04-15T21:38:26,616 copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu 2024-04-15T21:38:26,618 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2024-04-15T21:38:26,620 copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu 2024-04-15T21:38:26,622 copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu 2024-04-15T21:38:26,624 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2024-04-15T21:38:26,626 copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu 2024-04-15T21:38:26,629 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2024-04-15T21:38:26,632 creating build/lib/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:26,633 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:26,635 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:26,637 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:26,639 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:26,641 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:26,643 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:26,645 creating build/lib/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:26,646 copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:26,648 copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:26,650 copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:26,652 copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:26,654 copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:26,656 copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:26,658 creating build/lib/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:26,659 copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:26,661 copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:26,664 copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:26,665 copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:26,667 copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:26,670 creating build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,670 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,673 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,675 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,676 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,679 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,681 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,684 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,687 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,689 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,691 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2024-04-15T21:38:26,694 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,695 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,697 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,699 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,701 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,703 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,706 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,708 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,710 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,712 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,714 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:26,716 creating build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,717 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,719 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,721 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,723 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,725 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,727 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,729 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,732 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,734 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,736 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:26,738 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2024-04-15T21:38:26,739 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2024-04-15T21:38:26,742 creating build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,743 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,746 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,748 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,750 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,752 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,754 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,757 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,759 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,761 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,763 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2024-04-15T21:38:26,765 creating build/lib/deepspeed/model_implementations/diffusers 2024-04-15T21:38:26,766 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2024-04-15T21:38:26,768 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2024-04-15T21:38:26,770 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2024-04-15T21:38:26,773 creating build/lib/deepspeed/model_implementations/features 2024-04-15T21:38:26,773 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2024-04-15T21:38:26,775 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2024-04-15T21:38:26,778 creating build/lib/deepspeed/profiling/flops_profiler 2024-04-15T21:38:26,778 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2024-04-15T21:38:26,780 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2024-04-15T21:38:26,784 creating build/lib/deepspeed/inference/quantization 2024-04-15T21:38:26,785 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2024-04-15T21:38:26,786 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2024-04-15T21:38:26,789 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2024-04-15T21:38:26,791 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2024-04-15T21:38:26,793 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2024-04-15T21:38:26,796 creating build/lib/deepspeed/inference/v2 2024-04-15T21:38:26,797 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2024-04-15T21:38:26,800 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2024-04-15T21:38:26,803 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2024-04-15T21:38:26,805 copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2 2024-04-15T21:38:26,807 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2024-04-15T21:38:26,810 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2024-04-15T21:38:26,812 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2024-04-15T21:38:26,814 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2024-04-15T21:38:26,816 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2024-04-15T21:38:26,819 creating build/lib/deepspeed/inference/v2/modules 2024-04-15T21:38:26,820 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2024-04-15T21:38:26,823 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2024-04-15T21:38:26,825 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2024-04-15T21:38:26,828 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2024-04-15T21:38:26,830 creating build/lib/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:26,831 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:26,834 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:26,837 copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:26,840 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:26,843 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:26,846 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:26,848 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:26,851 creating build/lib/deepspeed/inference/v2/ragged 2024-04-15T21:38:26,852 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2024-04-15T21:38:26,854 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2024-04-15T21:38:26,856 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2024-04-15T21:38:26,858 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2024-04-15T21:38:26,861 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2024-04-15T21:38:26,863 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2024-04-15T21:38:26,866 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2024-04-15T21:38:26,869 creating build/lib/deepspeed/inference/v2/kernels 2024-04-15T21:38:26,869 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2024-04-15T21:38:26,871 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2024-04-15T21:38:26,874 creating build/lib/deepspeed/inference/v2/checkpoint 2024-04-15T21:38:26,874 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2024-04-15T21:38:26,877 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2024-04-15T21:38:26,879 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2024-04-15T21:38:26,881 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2024-04-15T21:38:26,883 creating build/lib/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:26,884 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:26,886 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:26,888 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:26,890 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:26,893 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:26,895 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:26,896 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:26,899 creating build/lib/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:26,900 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:26,902 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:26,904 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:26,906 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:26,908 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:26,910 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:26,912 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:26,914 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:26,916 creating build/lib/deepspeed/inference/v2/modules/implementations 2024-04-15T21:38:26,917 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2024-04-15T21:38:26,920 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2024-04-15T21:38:26,921 copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2024-04-15T21:38:26,924 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2024-04-15T21:38:26,926 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2024-04-15T21:38:26,929 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2024-04-15T21:38:26,930 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2024-04-15T21:38:26,932 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2024-04-15T21:38:26,934 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2024-04-15T21:38:26,936 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2024-04-15T21:38:26,937 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2024-04-15T21:38:26,939 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2024-04-15T21:38:26,942 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2024-04-15T21:38:26,942 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2024-04-15T21:38:26,945 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2024-04-15T21:38:26,948 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2024-04-15T21:38:26,949 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2024-04-15T21:38:26,951 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2024-04-15T21:38:26,953 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2024-04-15T21:38:26,954 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2024-04-15T21:38:26,957 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2024-04-15T21:38:26,959 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2024-04-15T21:38:26,960 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2024-04-15T21:38:26,962 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2024-04-15T21:38:26,965 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:26,966 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:26,968 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:26,970 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:26,972 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:26,974 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:26,976 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:26,978 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:26,980 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:26,982 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:26,984 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2024-04-15T21:38:26,985 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2024-04-15T21:38:26,987 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2024-04-15T21:38:26,989 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2024-04-15T21:38:26,991 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2024-04-15T21:38:26,993 creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2024-04-15T21:38:26,994 copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2024-04-15T21:38:26,996 copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2024-04-15T21:38:26,999 copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2024-04-15T21:38:27,001 copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2 2024-04-15T21:38:27,003 creating build/lib/deepspeed/inference/v2/model_implementations/phi 2024-04-15T21:38:27,004 copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2024-04-15T21:38:27,006 copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2024-04-15T21:38:27,009 copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2024-04-15T21:38:27,012 copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi 2024-04-15T21:38:27,015 creating build/lib/deepspeed/inference/v2/model_implementations/mixtral 2024-04-15T21:38:27,015 copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2024-04-15T21:38:27,018 copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2024-04-15T21:38:27,020 copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2024-04-15T21:38:27,022 copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral 2024-04-15T21:38:27,025 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2024-04-15T21:38:27,026 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2024-04-15T21:38:27,028 copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2024-04-15T21:38:27,030 copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2024-04-15T21:38:27,033 copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2024-04-15T21:38:27,035 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2024-04-15T21:38:27,036 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2024-04-15T21:38:27,038 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2024-04-15T21:38:27,041 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2024-04-15T21:38:27,043 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2024-04-15T21:38:27,046 creating build/lib/deepspeed/inference/v2/model_implementations/qwen 2024-04-15T21:38:27,047 copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2024-04-15T21:38:27,049 copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2024-04-15T21:38:27,051 copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2024-04-15T21:38:27,053 copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen 2024-04-15T21:38:27,056 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:27,057 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:27,059 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:27,061 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:27,063 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:27,065 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:27,068 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:27,071 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:27,073 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:27,076 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:27,078 creating build/lib/deepspeed/inference/v2/model_implementations/falcon 2024-04-15T21:38:27,079 copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2024-04-15T21:38:27,081 copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2024-04-15T21:38:27,084 copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2024-04-15T21:38:27,086 copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon 2024-04-15T21:38:27,089 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2024-04-15T21:38:27,090 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2024-04-15T21:38:27,092 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2024-04-15T21:38:27,093 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2024-04-15T21:38:27,095 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2024-04-15T21:38:27,096 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2024-04-15T21:38:27,099 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:27,099 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:27,101 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:27,104 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:27,105 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:27,106 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:27,108 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:27,111 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:27,112 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:27,114 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:27,117 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:27,118 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:27,119 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:27,122 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:27,123 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:27,125 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:27,127 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:27,129 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:27,131 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:27,132 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:27,134 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:27,136 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:27,137 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:27,139 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:27,142 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-04-15T21:38:27,142 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-04-15T21:38:27,144 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-04-15T21:38:27,147 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:27,148 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:27,150 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:27,152 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:27,153 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:27,155 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:27,157 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:27,158 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:27,161 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:27,163 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:27,164 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:27,166 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:27,169 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:27,170 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:27,172 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:27,174 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:27,176 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:27,178 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:27,180 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:27,181 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:27,183 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:27,185 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-04-15T21:38:27,186 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-04-15T21:38:27,188 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-04-15T21:38:27,190 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:27,191 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:27,193 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:27,195 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:27,197 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:27,199 running egg_info 2024-04-15T21:38:27,264 writing deepspeed.egg-info/PKG-INFO 2024-04-15T21:38:27,313 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2024-04-15T21:38:27,315 writing entry points to deepspeed.egg-info/entry_points.txt 2024-04-15T21:38:27,332 writing requirements to deepspeed.egg-info/requires.txt 2024-04-15T21:38:27,334 writing top-level names to deepspeed.egg-info/top_level.txt 2024-04-15T21:38:27,448 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2024-04-15T21:38:27,477 reading manifest template 'MANIFEST.in' 2024-04-15T21:38:27,480 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2024-04-15T21:38:27,480 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2024-04-15T21:38:29,012 warning: no files found matching '*.hip' under directory 'deepspeed' 2024-04-15T21:38:29,974 warning: no files found matching '*.cc' under directory 'deepspeed' 2024-04-15T21:38:30,963 warning: no files found matching '*.tr' under directory 'csrc' 2024-04-15T21:38:31,126 warning: no files found matching '*.cc' under directory 'csrc' 2024-04-15T21:38:31,166 warning: no files found matching '*.py' under directory 'benchmarks' 2024-04-15T21:38:31,214 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2024-04-15T21:38:31,224 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2024-04-15T21:38:31,225 !! 2024-04-15T21:38:31,227 ******************************************************************************** 2024-04-15T21:38:31,227 ############################ 2024-04-15T21:38:31,228 # Package would be ignored # 2024-04-15T21:38:31,229 ############################ 2024-04-15T21:38:31,229 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2024-04-15T21:38:31,229 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,230 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,231 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2024-04-15T21:38:31,232 to the `packages` configuration field. 2024-04-15T21:38:31,233 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,233 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,234 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,235 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,235 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,236 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2024-04-15T21:38:31,237 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2024-04-15T21:38:31,237 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,238 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,239 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,240 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,241 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,243 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,243 even if it does not contain any `.py` files. 2024-04-15T21:38:31,244 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,244 directory, all directories are treated like packages. 2024-04-15T21:38:31,245 ******************************************************************************** 2024-04-15T21:38:31,246 !! 2024-04-15T21:38:31,247 check.warn(importable) 2024-04-15T21:38:31,248 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration. 2024-04-15T21:38:31,249 !! 2024-04-15T21:38:31,250 ******************************************************************************** 2024-04-15T21:38:31,251 ############################ 2024-04-15T21:38:31,251 # Package would be ignored # 2024-04-15T21:38:31,252 ############################ 2024-04-15T21:38:31,252 Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1], 2024-04-15T21:38:31,253 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,254 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,255 package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added 2024-04-15T21:38:31,255 to the `packages` configuration field. 2024-04-15T21:38:31,257 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,257 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,258 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,259 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,260 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,261 If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are 2024-04-15T21:38:31,262 already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via 2024-04-15T21:38:31,262 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,262 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,263 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,264 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,265 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,266 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,266 even if it does not contain any `.py` files. 2024-04-15T21:38:31,266 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,267 directory, all directories are treated like packages. 2024-04-15T21:38:31,267 ******************************************************************************** 2024-04-15T21:38:31,268 !! 2024-04-15T21:38:31,268 check.warn(importable) 2024-04-15T21:38:31,269 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2024-04-15T21:38:31,269 !! 2024-04-15T21:38:31,270 ******************************************************************************** 2024-04-15T21:38:31,270 ############################ 2024-04-15T21:38:31,271 # Package would be ignored # 2024-04-15T21:38:31,271 ############################ 2024-04-15T21:38:31,272 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2024-04-15T21:38:31,272 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,273 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,274 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2024-04-15T21:38:31,274 to the `packages` configuration field. 2024-04-15T21:38:31,275 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,276 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,276 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,277 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,278 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,279 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2024-04-15T21:38:31,279 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2024-04-15T21:38:31,280 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,280 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,281 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,282 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,283 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,285 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,285 even if it does not contain any `.py` files. 2024-04-15T21:38:31,286 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,287 directory, all directories are treated like packages. 2024-04-15T21:38:31,287 ******************************************************************************** 2024-04-15T21:38:31,288 !! 2024-04-15T21:38:31,288 check.warn(importable) 2024-04-15T21:38:31,288 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2024-04-15T21:38:31,289 !! 2024-04-15T21:38:31,290 ******************************************************************************** 2024-04-15T21:38:31,290 ############################ 2024-04-15T21:38:31,290 # Package would be ignored # 2024-04-15T21:38:31,291 ############################ 2024-04-15T21:38:31,291 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2024-04-15T21:38:31,292 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,292 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,293 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2024-04-15T21:38:31,293 to the `packages` configuration field. 2024-04-15T21:38:31,294 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,295 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,295 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,296 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,297 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,298 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2024-04-15T21:38:31,298 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2024-04-15T21:38:31,299 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,299 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,300 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,301 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,302 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,303 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,304 even if it does not contain any `.py` files. 2024-04-15T21:38:31,304 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,305 directory, all directories are treated like packages. 2024-04-15T21:38:31,305 ******************************************************************************** 2024-04-15T21:38:31,306 !! 2024-04-15T21:38:31,307 check.warn(importable) 2024-04-15T21:38:31,307 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration. 2024-04-15T21:38:31,308 !! 2024-04-15T21:38:31,309 ******************************************************************************** 2024-04-15T21:38:31,310 ############################ 2024-04-15T21:38:31,310 # Package would be ignored # 2024-04-15T21:38:31,311 ############################ 2024-04-15T21:38:31,311 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1], 2024-04-15T21:38:31,312 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,313 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,314 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added 2024-04-15T21:38:31,314 to the `packages` configuration field. 2024-04-15T21:38:31,315 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,315 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,315 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,316 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,317 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,318 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are 2024-04-15T21:38:31,318 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via 2024-04-15T21:38:31,318 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,320 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,321 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,322 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,323 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,324 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,324 even if it does not contain any `.py` files. 2024-04-15T21:38:31,325 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,325 directory, all directories are treated like packages. 2024-04-15T21:38:31,326 ******************************************************************************** 2024-04-15T21:38:31,327 !! 2024-04-15T21:38:31,327 check.warn(importable) 2024-04-15T21:38:31,328 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2024-04-15T21:38:31,328 !! 2024-04-15T21:38:31,329 ******************************************************************************** 2024-04-15T21:38:31,330 ############################ 2024-04-15T21:38:31,331 # Package would be ignored # 2024-04-15T21:38:31,331 ############################ 2024-04-15T21:38:31,332 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2024-04-15T21:38:31,332 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,333 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,334 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2024-04-15T21:38:31,334 to the `packages` configuration field. 2024-04-15T21:38:31,335 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,336 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,336 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,337 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,338 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,339 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2024-04-15T21:38:31,340 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2024-04-15T21:38:31,341 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,342 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,342 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,343 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,343 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,345 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,345 even if it does not contain any `.py` files. 2024-04-15T21:38:31,345 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,346 directory, all directories are treated like packages. 2024-04-15T21:38:31,346 ******************************************************************************** 2024-04-15T21:38:31,347 !! 2024-04-15T21:38:31,347 check.warn(importable) 2024-04-15T21:38:31,348 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2024-04-15T21:38:31,348 !! 2024-04-15T21:38:31,349 ******************************************************************************** 2024-04-15T21:38:31,349 ############################ 2024-04-15T21:38:31,350 # Package would be ignored # 2024-04-15T21:38:31,350 ############################ 2024-04-15T21:38:31,351 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2024-04-15T21:38:31,351 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,352 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,352 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2024-04-15T21:38:31,353 to the `packages` configuration field. 2024-04-15T21:38:31,354 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,354 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,355 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,356 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,357 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,358 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2024-04-15T21:38:31,359 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2024-04-15T21:38:31,359 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,360 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,360 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,361 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,362 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,364 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,364 even if it does not contain any `.py` files. 2024-04-15T21:38:31,365 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,365 directory, all directories are treated like packages. 2024-04-15T21:38:31,366 ******************************************************************************** 2024-04-15T21:38:31,367 !! 2024-04-15T21:38:31,368 check.warn(importable) 2024-04-15T21:38:31,368 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2024-04-15T21:38:31,369 !! 2024-04-15T21:38:31,370 ******************************************************************************** 2024-04-15T21:38:31,370 ############################ 2024-04-15T21:38:31,370 # Package would be ignored # 2024-04-15T21:38:31,371 ############################ 2024-04-15T21:38:31,371 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2024-04-15T21:38:31,371 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,372 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,372 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2024-04-15T21:38:31,373 to the `packages` configuration field. 2024-04-15T21:38:31,373 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,374 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,374 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,375 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,376 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,376 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2024-04-15T21:38:31,377 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2024-04-15T21:38:31,377 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,378 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,378 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,379 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,380 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,382 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,382 even if it does not contain any `.py` files. 2024-04-15T21:38:31,383 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,383 directory, all directories are treated like packages. 2024-04-15T21:38:31,384 ******************************************************************************** 2024-04-15T21:38:31,385 !! 2024-04-15T21:38:31,385 check.warn(importable) 2024-04-15T21:38:31,386 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2024-04-15T21:38:31,386 !! 2024-04-15T21:38:31,387 ******************************************************************************** 2024-04-15T21:38:31,388 ############################ 2024-04-15T21:38:31,388 # Package would be ignored # 2024-04-15T21:38:31,389 ############################ 2024-04-15T21:38:31,389 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2024-04-15T21:38:31,390 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,391 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,391 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2024-04-15T21:38:31,392 to the `packages` configuration field. 2024-04-15T21:38:31,393 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,394 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,395 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,395 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,396 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,397 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2024-04-15T21:38:31,397 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2024-04-15T21:38:31,398 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,398 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,399 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,400 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,400 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,402 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,402 even if it does not contain any `.py` files. 2024-04-15T21:38:31,402 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,403 directory, all directories are treated like packages. 2024-04-15T21:38:31,403 ******************************************************************************** 2024-04-15T21:38:31,404 !! 2024-04-15T21:38:31,404 check.warn(importable) 2024-04-15T21:38:31,405 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2024-04-15T21:38:31,405 !! 2024-04-15T21:38:31,406 ******************************************************************************** 2024-04-15T21:38:31,407 ############################ 2024-04-15T21:38:31,407 # Package would be ignored # 2024-04-15T21:38:31,408 ############################ 2024-04-15T21:38:31,408 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2024-04-15T21:38:31,409 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,410 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,410 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2024-04-15T21:38:31,411 to the `packages` configuration field. 2024-04-15T21:38:31,412 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,413 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,413 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,414 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,415 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,416 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2024-04-15T21:38:31,417 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2024-04-15T21:38:31,418 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,418 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,419 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,420 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,421 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,423 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,423 even if it does not contain any `.py` files. 2024-04-15T21:38:31,424 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,424 directory, all directories are treated like packages. 2024-04-15T21:38:31,425 ******************************************************************************** 2024-04-15T21:38:31,425 !! 2024-04-15T21:38:31,426 check.warn(importable) 2024-04-15T21:38:31,426 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2024-04-15T21:38:31,427 !! 2024-04-15T21:38:31,428 ******************************************************************************** 2024-04-15T21:38:31,428 ############################ 2024-04-15T21:38:31,428 # Package would be ignored # 2024-04-15T21:38:31,429 ############################ 2024-04-15T21:38:31,429 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2024-04-15T21:38:31,430 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,431 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,431 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2024-04-15T21:38:31,432 to the `packages` configuration field. 2024-04-15T21:38:31,433 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,433 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,434 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,435 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,436 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,437 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2024-04-15T21:38:31,437 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2024-04-15T21:38:31,437 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,438 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,439 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,440 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,441 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,442 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,443 even if it does not contain any `.py` files. 2024-04-15T21:38:31,443 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,444 directory, all directories are treated like packages. 2024-04-15T21:38:31,444 ******************************************************************************** 2024-04-15T21:38:31,445 !! 2024-04-15T21:38:31,446 check.warn(importable) 2024-04-15T21:38:31,446 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2024-04-15T21:38:31,447 !! 2024-04-15T21:38:31,448 ******************************************************************************** 2024-04-15T21:38:31,448 ############################ 2024-04-15T21:38:31,449 # Package would be ignored # 2024-04-15T21:38:31,449 ############################ 2024-04-15T21:38:31,450 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2024-04-15T21:38:31,451 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,452 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,452 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2024-04-15T21:38:31,453 to the `packages` configuration field. 2024-04-15T21:38:31,453 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,454 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,454 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,455 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,456 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,457 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2024-04-15T21:38:31,457 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2024-04-15T21:38:31,457 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,458 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,458 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,459 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,460 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,462 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,463 even if it does not contain any `.py` files. 2024-04-15T21:38:31,463 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,463 directory, all directories are treated like packages. 2024-04-15T21:38:31,464 ******************************************************************************** 2024-04-15T21:38:31,465 !! 2024-04-15T21:38:31,465 check.warn(importable) 2024-04-15T21:38:31,466 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2024-04-15T21:38:31,466 !! 2024-04-15T21:38:31,467 ******************************************************************************** 2024-04-15T21:38:31,468 ############################ 2024-04-15T21:38:31,468 # Package would be ignored # 2024-04-15T21:38:31,469 ############################ 2024-04-15T21:38:31,469 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2024-04-15T21:38:31,470 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,471 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,471 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2024-04-15T21:38:31,472 to the `packages` configuration field. 2024-04-15T21:38:31,473 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,473 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,474 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,476 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,478 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,479 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2024-04-15T21:38:31,480 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2024-04-15T21:38:31,481 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,481 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,482 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,483 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,492 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,494 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,495 even if it does not contain any `.py` files. 2024-04-15T21:38:31,495 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,496 directory, all directories are treated like packages. 2024-04-15T21:38:31,496 ******************************************************************************** 2024-04-15T21:38:31,497 !! 2024-04-15T21:38:31,497 check.warn(importable) 2024-04-15T21:38:31,498 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2024-04-15T21:38:31,498 !! 2024-04-15T21:38:31,500 ******************************************************************************** 2024-04-15T21:38:31,500 ############################ 2024-04-15T21:38:31,501 # Package would be ignored # 2024-04-15T21:38:31,501 ############################ 2024-04-15T21:38:31,502 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2024-04-15T21:38:31,502 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,504 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,504 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2024-04-15T21:38:31,505 to the `packages` configuration field. 2024-04-15T21:38:31,505 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,506 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,506 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,507 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,508 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,509 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2024-04-15T21:38:31,510 already explicitly excluding 'deepspeed.ops.csrc.common' via 2024-04-15T21:38:31,510 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,511 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,511 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,513 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,514 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,515 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,516 even if it does not contain any `.py` files. 2024-04-15T21:38:31,516 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,517 directory, all directories are treated like packages. 2024-04-15T21:38:31,517 ******************************************************************************** 2024-04-15T21:38:31,518 !! 2024-04-15T21:38:31,519 check.warn(importable) 2024-04-15T21:38:31,520 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2024-04-15T21:38:31,520 !! 2024-04-15T21:38:31,521 ******************************************************************************** 2024-04-15T21:38:31,522 ############################ 2024-04-15T21:38:31,523 # Package would be ignored # 2024-04-15T21:38:31,523 ############################ 2024-04-15T21:38:31,523 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2024-04-15T21:38:31,524 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,524 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,525 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2024-04-15T21:38:31,525 to the `packages` configuration field. 2024-04-15T21:38:31,526 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,526 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,527 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,527 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,528 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,529 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2024-04-15T21:38:31,530 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2024-04-15T21:38:31,530 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,531 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,531 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,532 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,533 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,535 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,535 even if it does not contain any `.py` files. 2024-04-15T21:38:31,536 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,536 directory, all directories are treated like packages. 2024-04-15T21:38:31,537 ******************************************************************************** 2024-04-15T21:38:31,538 !! 2024-04-15T21:38:31,538 check.warn(importable) 2024-04-15T21:38:31,539 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2024-04-15T21:38:31,539 !! 2024-04-15T21:38:31,540 ******************************************************************************** 2024-04-15T21:38:31,541 ############################ 2024-04-15T21:38:31,541 # Package would be ignored # 2024-04-15T21:38:31,542 ############################ 2024-04-15T21:38:31,542 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2024-04-15T21:38:31,543 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,544 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,544 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2024-04-15T21:38:31,545 to the `packages` configuration field. 2024-04-15T21:38:31,546 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,546 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,547 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,548 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,549 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,551 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2024-04-15T21:38:31,551 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2024-04-15T21:38:31,551 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,552 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,552 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,553 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,553 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,554 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,555 even if it does not contain any `.py` files. 2024-04-15T21:38:31,555 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,556 directory, all directories are treated like packages. 2024-04-15T21:38:31,556 ******************************************************************************** 2024-04-15T21:38:31,557 !! 2024-04-15T21:38:31,557 check.warn(importable) 2024-04-15T21:38:31,557 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2024-04-15T21:38:31,558 !! 2024-04-15T21:38:31,559 ******************************************************************************** 2024-04-15T21:38:31,559 ############################ 2024-04-15T21:38:31,559 # Package would be ignored # 2024-04-15T21:38:31,560 ############################ 2024-04-15T21:38:31,560 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2024-04-15T21:38:31,561 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,562 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,562 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2024-04-15T21:38:31,563 to the `packages` configuration field. 2024-04-15T21:38:31,564 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,565 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,566 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,567 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,568 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,569 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2024-04-15T21:38:31,569 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2024-04-15T21:38:31,570 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,570 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,571 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,572 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,573 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,574 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,575 even if it does not contain any `.py` files. 2024-04-15T21:38:31,575 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,576 directory, all directories are treated like packages. 2024-04-15T21:38:31,576 ******************************************************************************** 2024-04-15T21:38:31,578 !! 2024-04-15T21:38:31,578 check.warn(importable) 2024-04-15T21:38:31,578 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2024-04-15T21:38:31,579 !! 2024-04-15T21:38:31,579 ******************************************************************************** 2024-04-15T21:38:31,580 ############################ 2024-04-15T21:38:31,580 # Package would be ignored # 2024-04-15T21:38:31,580 ############################ 2024-04-15T21:38:31,581 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2024-04-15T21:38:31,581 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,582 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,583 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2024-04-15T21:38:31,583 to the `packages` configuration field. 2024-04-15T21:38:31,584 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,584 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,584 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,585 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,586 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,587 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2024-04-15T21:38:31,587 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2024-04-15T21:38:31,588 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,588 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,589 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,590 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,591 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,593 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,593 even if it does not contain any `.py` files. 2024-04-15T21:38:31,594 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,595 directory, all directories are treated like packages. 2024-04-15T21:38:31,595 ******************************************************************************** 2024-04-15T21:38:31,596 !! 2024-04-15T21:38:31,597 check.warn(importable) 2024-04-15T21:38:31,597 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2024-04-15T21:38:31,598 !! 2024-04-15T21:38:31,599 ******************************************************************************** 2024-04-15T21:38:31,599 ############################ 2024-04-15T21:38:31,600 # Package would be ignored # 2024-04-15T21:38:31,600 ############################ 2024-04-15T21:38:31,601 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2024-04-15T21:38:31,601 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,603 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,603 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2024-04-15T21:38:31,604 to the `packages` configuration field. 2024-04-15T21:38:31,605 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,605 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,606 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,606 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,607 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,608 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2024-04-15T21:38:31,608 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2024-04-15T21:38:31,608 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,609 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,609 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,610 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,610 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,612 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,612 even if it does not contain any `.py` files. 2024-04-15T21:38:31,612 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,613 directory, all directories are treated like packages. 2024-04-15T21:38:31,613 ******************************************************************************** 2024-04-15T21:38:31,614 !! 2024-04-15T21:38:31,615 check.warn(importable) 2024-04-15T21:38:31,615 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2024-04-15T21:38:31,616 !! 2024-04-15T21:38:31,617 ******************************************************************************** 2024-04-15T21:38:31,617 ############################ 2024-04-15T21:38:31,618 # Package would be ignored # 2024-04-15T21:38:31,619 ############################ 2024-04-15T21:38:31,619 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2024-04-15T21:38:31,620 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,621 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,621 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2024-04-15T21:38:31,622 to the `packages` configuration field. 2024-04-15T21:38:31,623 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,623 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,623 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,624 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,625 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,626 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2024-04-15T21:38:31,627 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2024-04-15T21:38:31,627 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,628 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,628 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,629 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,630 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,631 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,632 even if it does not contain any `.py` files. 2024-04-15T21:38:31,632 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,632 directory, all directories are treated like packages. 2024-04-15T21:38:31,633 ******************************************************************************** 2024-04-15T21:38:31,633 !! 2024-04-15T21:38:31,634 check.warn(importable) 2024-04-15T21:38:31,634 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2024-04-15T21:38:31,635 !! 2024-04-15T21:38:31,636 ******************************************************************************** 2024-04-15T21:38:31,636 ############################ 2024-04-15T21:38:31,637 # Package would be ignored # 2024-04-15T21:38:31,637 ############################ 2024-04-15T21:38:31,638 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2024-04-15T21:38:31,638 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,639 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,640 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2024-04-15T21:38:31,640 to the `packages` configuration field. 2024-04-15T21:38:31,641 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,642 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,642 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,643 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,644 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,645 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2024-04-15T21:38:31,646 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2024-04-15T21:38:31,646 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,647 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,648 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,649 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,650 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,652 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,653 even if it does not contain any `.py` files. 2024-04-15T21:38:31,653 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,654 directory, all directories are treated like packages. 2024-04-15T21:38:31,654 ******************************************************************************** 2024-04-15T21:38:31,655 !! 2024-04-15T21:38:31,656 check.warn(importable) 2024-04-15T21:38:31,656 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2024-04-15T21:38:31,657 !! 2024-04-15T21:38:31,658 ******************************************************************************** 2024-04-15T21:38:31,659 ############################ 2024-04-15T21:38:31,659 # Package would be ignored # 2024-04-15T21:38:31,659 ############################ 2024-04-15T21:38:31,660 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2024-04-15T21:38:31,660 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,661 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,661 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2024-04-15T21:38:31,662 to the `packages` configuration field. 2024-04-15T21:38:31,662 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,663 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,663 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,664 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,665 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,665 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2024-04-15T21:38:31,666 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2024-04-15T21:38:31,666 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,667 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,668 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,668 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,669 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,671 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,671 even if it does not contain any `.py` files. 2024-04-15T21:38:31,672 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,672 directory, all directories are treated like packages. 2024-04-15T21:38:31,673 ******************************************************************************** 2024-04-15T21:38:31,674 !! 2024-04-15T21:38:31,674 check.warn(importable) 2024-04-15T21:38:31,675 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration. 2024-04-15T21:38:31,675 !! 2024-04-15T21:38:31,676 ******************************************************************************** 2024-04-15T21:38:31,677 ############################ 2024-04-15T21:38:31,677 # Package would be ignored # 2024-04-15T21:38:31,678 ############################ 2024-04-15T21:38:31,678 Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1], 2024-04-15T21:38:31,679 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,680 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,680 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added 2024-04-15T21:38:31,681 to the `packages` configuration field. 2024-04-15T21:38:31,682 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,683 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,683 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,684 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,685 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,685 If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are 2024-04-15T21:38:31,686 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via 2024-04-15T21:38:31,686 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,686 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,687 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,688 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,688 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,690 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,690 even if it does not contain any `.py` files. 2024-04-15T21:38:31,691 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,691 directory, all directories are treated like packages. 2024-04-15T21:38:31,691 ******************************************************************************** 2024-04-15T21:38:31,692 !! 2024-04-15T21:38:31,693 check.warn(importable) 2024-04-15T21:38:31,693 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration. 2024-04-15T21:38:31,694 !! 2024-04-15T21:38:31,695 ******************************************************************************** 2024-04-15T21:38:31,696 ############################ 2024-04-15T21:38:31,696 # Package would be ignored # 2024-04-15T21:38:31,697 ############################ 2024-04-15T21:38:31,698 Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1], 2024-04-15T21:38:31,698 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,699 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,700 package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added 2024-04-15T21:38:31,700 to the `packages` configuration field. 2024-04-15T21:38:31,701 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,702 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,702 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,703 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,704 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,705 If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are 2024-04-15T21:38:31,706 already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via 2024-04-15T21:38:31,706 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,707 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,707 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,710 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,712 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,715 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,715 even if it does not contain any `.py` files. 2024-04-15T21:38:31,715 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,716 directory, all directories are treated like packages. 2024-04-15T21:38:31,716 ******************************************************************************** 2024-04-15T21:38:31,717 !! 2024-04-15T21:38:31,718 check.warn(importable) 2024-04-15T21:38:31,718 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2024-04-15T21:38:31,719 !! 2024-04-15T21:38:31,719 ******************************************************************************** 2024-04-15T21:38:31,720 ############################ 2024-04-15T21:38:31,720 # Package would be ignored # 2024-04-15T21:38:31,721 ############################ 2024-04-15T21:38:31,721 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2024-04-15T21:38:31,721 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,722 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,723 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2024-04-15T21:38:31,723 to the `packages` configuration field. 2024-04-15T21:38:31,724 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,724 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,725 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,726 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,727 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,728 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2024-04-15T21:38:31,728 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2024-04-15T21:38:31,729 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,730 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,730 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,732 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,733 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,734 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,735 even if it does not contain any `.py` files. 2024-04-15T21:38:31,736 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,736 directory, all directories are treated like packages. 2024-04-15T21:38:31,737 ******************************************************************************** 2024-04-15T21:38:31,738 !! 2024-04-15T21:38:31,739 check.warn(importable) 2024-04-15T21:38:31,739 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2024-04-15T21:38:31,740 !! 2024-04-15T21:38:31,741 ******************************************************************************** 2024-04-15T21:38:31,742 ############################ 2024-04-15T21:38:31,742 # Package would be ignored # 2024-04-15T21:38:31,743 ############################ 2024-04-15T21:38:31,744 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2024-04-15T21:38:31,744 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,746 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,746 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2024-04-15T21:38:31,747 to the `packages` configuration field. 2024-04-15T21:38:31,748 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,748 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,749 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,750 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,751 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,752 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2024-04-15T21:38:31,752 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2024-04-15T21:38:31,753 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,753 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,754 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,755 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,756 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,757 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,758 even if it does not contain any `.py` files. 2024-04-15T21:38:31,759 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,759 directory, all directories are treated like packages. 2024-04-15T21:38:31,760 ******************************************************************************** 2024-04-15T21:38:31,762 !! 2024-04-15T21:38:31,762 check.warn(importable) 2024-04-15T21:38:31,763 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2024-04-15T21:38:31,764 !! 2024-04-15T21:38:31,765 ******************************************************************************** 2024-04-15T21:38:31,766 ############################ 2024-04-15T21:38:31,767 # Package would be ignored # 2024-04-15T21:38:31,768 ############################ 2024-04-15T21:38:31,769 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2024-04-15T21:38:31,769 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,771 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,772 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2024-04-15T21:38:31,773 to the `packages` configuration field. 2024-04-15T21:38:31,774 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,775 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,776 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,778 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,779 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,781 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2024-04-15T21:38:31,782 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2024-04-15T21:38:31,783 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,783 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,784 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,786 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,787 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,789 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,790 even if it does not contain any `.py` files. 2024-04-15T21:38:31,791 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,791 directory, all directories are treated like packages. 2024-04-15T21:38:31,792 ******************************************************************************** 2024-04-15T21:38:31,793 !! 2024-04-15T21:38:31,794 check.warn(importable) 2024-04-15T21:38:31,795 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2024-04-15T21:38:31,795 !! 2024-04-15T21:38:31,797 ******************************************************************************** 2024-04-15T21:38:31,798 ############################ 2024-04-15T21:38:31,798 # Package would be ignored # 2024-04-15T21:38:31,799 ############################ 2024-04-15T21:38:31,800 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2024-04-15T21:38:31,800 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,802 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,803 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2024-04-15T21:38:31,804 to the `packages` configuration field. 2024-04-15T21:38:31,806 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,807 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,807 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,809 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,811 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,812 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2024-04-15T21:38:31,813 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2024-04-15T21:38:31,814 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,815 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,815 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,817 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,819 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,821 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,822 even if it does not contain any `.py` files. 2024-04-15T21:38:31,823 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,823 directory, all directories are treated like packages. 2024-04-15T21:38:31,824 ******************************************************************************** 2024-04-15T21:38:31,825 !! 2024-04-15T21:38:31,826 check.warn(importable) 2024-04-15T21:38:31,827 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2024-04-15T21:38:31,828 !! 2024-04-15T21:38:31,830 ******************************************************************************** 2024-04-15T21:38:31,830 ############################ 2024-04-15T21:38:31,831 # Package would be ignored # 2024-04-15T21:38:31,832 ############################ 2024-04-15T21:38:31,833 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2024-04-15T21:38:31,833 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,835 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,836 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2024-04-15T21:38:31,836 to the `packages` configuration field. 2024-04-15T21:38:31,837 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,838 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,839 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,841 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,842 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,844 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2024-04-15T21:38:31,844 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2024-04-15T21:38:31,845 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,846 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,846 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,848 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,849 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,852 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,853 even if it does not contain any `.py` files. 2024-04-15T21:38:31,854 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,854 directory, all directories are treated like packages. 2024-04-15T21:38:31,855 ******************************************************************************** 2024-04-15T21:38:31,857 !! 2024-04-15T21:38:31,858 check.warn(importable) 2024-04-15T21:38:31,858 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2024-04-15T21:38:31,859 !! 2024-04-15T21:38:31,860 ******************************************************************************** 2024-04-15T21:38:31,861 ############################ 2024-04-15T21:38:31,861 # Package would be ignored # 2024-04-15T21:38:31,862 ############################ 2024-04-15T21:38:31,862 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2024-04-15T21:38:31,863 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,864 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,864 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2024-04-15T21:38:31,865 to the `packages` configuration field. 2024-04-15T21:38:31,866 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,867 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,867 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,869 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,870 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,871 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2024-04-15T21:38:31,872 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2024-04-15T21:38:31,872 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,873 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,873 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,874 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,875 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,877 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,877 even if it does not contain any `.py` files. 2024-04-15T21:38:31,878 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,878 directory, all directories are treated like packages. 2024-04-15T21:38:31,879 ******************************************************************************** 2024-04-15T21:38:31,880 !! 2024-04-15T21:38:31,880 check.warn(importable) 2024-04-15T21:38:31,881 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2024-04-15T21:38:31,881 !! 2024-04-15T21:38:31,883 ******************************************************************************** 2024-04-15T21:38:31,883 ############################ 2024-04-15T21:38:31,884 # Package would be ignored # 2024-04-15T21:38:31,884 ############################ 2024-04-15T21:38:31,885 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2024-04-15T21:38:31,885 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,886 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,887 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2024-04-15T21:38:31,888 to the `packages` configuration field. 2024-04-15T21:38:31,889 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,889 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,890 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,891 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,892 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,894 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2024-04-15T21:38:31,895 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2024-04-15T21:38:31,895 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,896 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,896 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,897 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,898 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,900 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,901 even if it does not contain any `.py` files. 2024-04-15T21:38:31,901 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,902 directory, all directories are treated like packages. 2024-04-15T21:38:31,902 ******************************************************************************** 2024-04-15T21:38:31,904 !! 2024-04-15T21:38:31,904 check.warn(importable) 2024-04-15T21:38:31,905 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2024-04-15T21:38:31,905 !! 2024-04-15T21:38:31,906 ******************************************************************************** 2024-04-15T21:38:31,907 ############################ 2024-04-15T21:38:31,907 # Package would be ignored # 2024-04-15T21:38:31,908 ############################ 2024-04-15T21:38:31,908 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2024-04-15T21:38:31,909 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,910 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,910 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2024-04-15T21:38:31,911 to the `packages` configuration field. 2024-04-15T21:38:31,912 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,912 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,913 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,914 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,915 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,916 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2024-04-15T21:38:31,919 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2024-04-15T21:38:31,919 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,920 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,920 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,922 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,924 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,926 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,927 even if it does not contain any `.py` files. 2024-04-15T21:38:31,928 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,928 directory, all directories are treated like packages. 2024-04-15T21:38:31,929 ******************************************************************************** 2024-04-15T21:38:31,930 !! 2024-04-15T21:38:31,931 check.warn(importable) 2024-04-15T21:38:31,931 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2024-04-15T21:38:31,932 !! 2024-04-15T21:38:31,933 ******************************************************************************** 2024-04-15T21:38:31,934 ############################ 2024-04-15T21:38:31,935 # Package would be ignored # 2024-04-15T21:38:31,936 ############################ 2024-04-15T21:38:31,936 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2024-04-15T21:38:31,937 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,938 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,939 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2024-04-15T21:38:31,940 to the `packages` configuration field. 2024-04-15T21:38:31,941 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,942 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,942 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,943 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,944 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,945 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2024-04-15T21:38:31,946 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2024-04-15T21:38:31,946 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,947 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,947 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,948 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,950 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,951 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,952 even if it does not contain any `.py` files. 2024-04-15T21:38:31,953 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,953 directory, all directories are treated like packages. 2024-04-15T21:38:31,954 ******************************************************************************** 2024-04-15T21:38:31,955 !! 2024-04-15T21:38:31,956 check.warn(importable) 2024-04-15T21:38:31,957 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2024-04-15T21:38:31,957 !! 2024-04-15T21:38:31,959 ******************************************************************************** 2024-04-15T21:38:31,960 ############################ 2024-04-15T21:38:31,961 # Package would be ignored # 2024-04-15T21:38:31,961 ############################ 2024-04-15T21:38:31,962 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2024-04-15T21:38:31,963 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:31,964 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:31,965 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2024-04-15T21:38:31,966 to the `packages` configuration field. 2024-04-15T21:38:31,968 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:31,969 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:31,969 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:31,972 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:31,976 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:31,978 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2024-04-15T21:38:31,979 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2024-04-15T21:38:31,979 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:31,981 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:31,982 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:31,992 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:31,993 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:31,995 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:31,995 even if it does not contain any `.py` files. 2024-04-15T21:38:31,996 On the other hand, currently there is no concept of package data 2024-04-15T21:38:31,997 directory, all directories are treated like packages. 2024-04-15T21:38:31,999 ******************************************************************************** 2024-04-15T21:38:32,001 !! 2024-04-15T21:38:32,001 check.warn(importable) 2024-04-15T21:38:32,002 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2024-04-15T21:38:32,002 !! 2024-04-15T21:38:32,003 ******************************************************************************** 2024-04-15T21:38:32,004 ############################ 2024-04-15T21:38:32,005 # Package would be ignored # 2024-04-15T21:38:32,005 ############################ 2024-04-15T21:38:32,006 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2024-04-15T21:38:32,007 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:32,008 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:32,008 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2024-04-15T21:38:32,009 to the `packages` configuration field. 2024-04-15T21:38:32,011 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:32,012 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:32,013 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:32,014 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:32,016 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:32,017 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2024-04-15T21:38:32,018 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2024-04-15T21:38:32,019 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:32,019 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:32,020 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:32,021 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:32,022 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:32,024 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:32,025 even if it does not contain any `.py` files. 2024-04-15T21:38:32,025 On the other hand, currently there is no concept of package data 2024-04-15T21:38:32,026 directory, all directories are treated like packages. 2024-04-15T21:38:32,027 ******************************************************************************** 2024-04-15T21:38:32,028 !! 2024-04-15T21:38:32,028 check.warn(importable) 2024-04-15T21:38:32,029 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2024-04-15T21:38:32,030 !! 2024-04-15T21:38:32,031 ******************************************************************************** 2024-04-15T21:38:32,032 ############################ 2024-04-15T21:38:32,033 # Package would be ignored # 2024-04-15T21:38:32,034 ############################ 2024-04-15T21:38:32,035 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2024-04-15T21:38:32,036 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:32,038 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:32,039 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2024-04-15T21:38:32,039 to the `packages` configuration field. 2024-04-15T21:38:32,041 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:32,041 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:32,042 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:32,043 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:32,044 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:32,045 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2024-04-15T21:38:32,045 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2024-04-15T21:38:32,046 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:32,046 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:32,047 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:32,048 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:32,049 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:32,051 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:32,051 even if it does not contain any `.py` files. 2024-04-15T21:38:32,051 On the other hand, currently there is no concept of package data 2024-04-15T21:38:32,052 directory, all directories are treated like packages. 2024-04-15T21:38:32,052 ******************************************************************************** 2024-04-15T21:38:32,053 !! 2024-04-15T21:38:32,054 check.warn(importable) 2024-04-15T21:38:32,054 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration. 2024-04-15T21:38:32,055 !! 2024-04-15T21:38:32,056 ******************************************************************************** 2024-04-15T21:38:32,056 ############################ 2024-04-15T21:38:32,057 # Package would be ignored # 2024-04-15T21:38:32,057 ############################ 2024-04-15T21:38:32,058 Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1], 2024-04-15T21:38:32,059 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:32,063 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:32,064 package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added 2024-04-15T21:38:32,065 to the `packages` configuration field. 2024-04-15T21:38:32,066 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:32,066 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:32,067 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:32,069 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:32,071 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:32,072 If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are 2024-04-15T21:38:32,073 already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via 2024-04-15T21:38:32,073 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:32,074 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:32,074 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:32,075 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:32,076 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:32,078 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:32,079 even if it does not contain any `.py` files. 2024-04-15T21:38:32,079 On the other hand, currently there is no concept of package data 2024-04-15T21:38:32,080 directory, all directories are treated like packages. 2024-04-15T21:38:32,080 ******************************************************************************** 2024-04-15T21:38:32,081 !! 2024-04-15T21:38:32,082 check.warn(importable) 2024-04-15T21:38:32,082 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration. 2024-04-15T21:38:32,083 !! 2024-04-15T21:38:32,084 ******************************************************************************** 2024-04-15T21:38:32,084 ############################ 2024-04-15T21:38:32,085 # Package would be ignored # 2024-04-15T21:38:32,085 ############################ 2024-04-15T21:38:32,086 Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1], 2024-04-15T21:38:32,086 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:32,087 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:32,088 package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added 2024-04-15T21:38:32,088 to the `packages` configuration field. 2024-04-15T21:38:32,089 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:32,090 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:32,091 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:32,092 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:32,094 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:32,095 If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are 2024-04-15T21:38:32,095 already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via 2024-04-15T21:38:32,096 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:32,096 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:32,097 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:32,098 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:32,100 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:32,102 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:32,102 even if it does not contain any `.py` files. 2024-04-15T21:38:32,103 On the other hand, currently there is no concept of package data 2024-04-15T21:38:32,104 directory, all directories are treated like packages. 2024-04-15T21:38:32,104 ******************************************************************************** 2024-04-15T21:38:32,106 !! 2024-04-15T21:38:32,106 check.warn(importable) 2024-04-15T21:38:32,107 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration. 2024-04-15T21:38:32,108 !! 2024-04-15T21:38:32,109 ******************************************************************************** 2024-04-15T21:38:32,109 ############################ 2024-04-15T21:38:32,110 # Package would be ignored # 2024-04-15T21:38:32,111 ############################ 2024-04-15T21:38:32,111 Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1], 2024-04-15T21:38:32,112 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:32,113 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:32,115 package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added 2024-04-15T21:38:32,115 to the `packages` configuration field. 2024-04-15T21:38:32,117 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:32,117 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:32,118 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:32,119 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:32,121 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:32,122 If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are 2024-04-15T21:38:32,123 already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via 2024-04-15T21:38:32,123 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:32,124 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:32,125 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:32,127 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:32,128 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:32,130 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:32,131 even if it does not contain any `.py` files. 2024-04-15T21:38:32,131 On the other hand, currently there is no concept of package data 2024-04-15T21:38:32,132 directory, all directories are treated like packages. 2024-04-15T21:38:32,133 ******************************************************************************** 2024-04-15T21:38:32,134 !! 2024-04-15T21:38:32,135 check.warn(importable) 2024-04-15T21:38:32,135 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration. 2024-04-15T21:38:32,136 !! 2024-04-15T21:38:32,138 ******************************************************************************** 2024-04-15T21:38:32,138 ############################ 2024-04-15T21:38:32,139 # Package would be ignored # 2024-04-15T21:38:32,140 ############################ 2024-04-15T21:38:32,140 Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1], 2024-04-15T21:38:32,141 but it is absent from setuptools' `packages` configuration. 2024-04-15T21:38:32,143 This leads to an ambiguous overall configuration. If you want to distribute this 2024-04-15T21:38:32,143 package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added 2024-04-15T21:38:32,144 to the `packages` configuration field. 2024-04-15T21:38:32,146 Alternatively, you can also rely on setuptools' discovery methods 2024-04-15T21:38:32,147 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2024-04-15T21:38:32,148 instead of `find_packages(...)`/`find:`). 2024-04-15T21:38:32,149 You can read more about "package discovery" on setuptools documentation page: 2024-04-15T21:38:32,151 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2024-04-15T21:38:32,153 If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are 2024-04-15T21:38:32,154 already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via 2024-04-15T21:38:32,155 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2024-04-15T21:38:32,155 you can try to use `exclude_package_data`, or `include-package-data=False` in 2024-04-15T21:38:32,157 combination with a more fine grained `package-data` configuration. 2024-04-15T21:38:32,158 You can read more about "package data files" on setuptools documentation page: 2024-04-15T21:38:32,159 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2024-04-15T21:38:32,161 [^1]: For Python, any directory (with suitable naming) can be imported, 2024-04-15T21:38:32,162 even if it does not contain any `.py` files. 2024-04-15T21:38:32,162 On the other hand, currently there is no concept of package data 2024-04-15T21:38:32,163 directory, all directories are treated like packages. 2024-04-15T21:38:32,163 ******************************************************************************** 2024-04-15T21:38:32,165 !! 2024-04-15T21:38:32,165 check.warn(importable) 2024-04-15T21:38:32,165 creating build/lib/deepspeed/autotuning/config_templates 2024-04-15T21:38:32,166 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2024-04-15T21:38:32,166 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2024-04-15T21:38:32,167 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2024-04-15T21:38:32,167 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2024-04-15T21:38:32,168 creating build/lib/deepspeed/ops/csrc 2024-04-15T21:38:32,168 creating build/lib/deepspeed/ops/csrc/adagrad 2024-04-15T21:38:32,169 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2024-04-15T21:38:32,169 creating build/lib/deepspeed/ops/csrc/adam 2024-04-15T21:38:32,170 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2024-04-15T21:38:32,171 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2024-04-15T21:38:32,171 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2024-04-15T21:38:32,172 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2024-04-15T21:38:32,173 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2024-04-15T21:38:32,173 creating build/lib/deepspeed/ops/csrc/aio 2024-04-15T21:38:32,174 creating build/lib/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:32,175 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:32,175 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:32,176 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:32,177 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:32,177 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:32,178 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:32,179 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,179 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,180 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,180 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,181 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,181 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,182 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,182 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,182 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,183 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,184 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,184 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:32,185 creating build/lib/deepspeed/ops/csrc/aio/py_test 2024-04-15T21:38:32,185 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2024-04-15T21:38:32,186 creating build/lib/deepspeed/ops/csrc/common 2024-04-15T21:38:32,186 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2024-04-15T21:38:32,187 creating build/lib/deepspeed/ops/csrc/cpu 2024-04-15T21:38:32,187 creating build/lib/deepspeed/ops/csrc/cpu/adam 2024-04-15T21:38:32,188 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2024-04-15T21:38:32,188 creating build/lib/deepspeed/ops/csrc/cpu/comm 2024-04-15T21:38:32,189 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2024-04-15T21:38:32,189 copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2024-04-15T21:38:32,190 copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm 2024-04-15T21:38:32,190 creating build/lib/deepspeed/ops/csrc/cpu/lion 2024-04-15T21:38:32,191 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2024-04-15T21:38:32,192 creating build/lib/deepspeed/ops/csrc/deepspeed4science 2024-04-15T21:38:32,192 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:32,193 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:32,193 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:32,194 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:32,194 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:32,195 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:32,195 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:32,196 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-04-15T21:38:32,197 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-04-15T21:38:32,197 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-04-15T21:38:32,198 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-04-15T21:38:32,198 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-04-15T21:38:32,199 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:32,199 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:32,200 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:32,200 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:32,201 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:32,201 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:32,202 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:32,202 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:32,203 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:32,203 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:32,204 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:32,204 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:32,205 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:32,205 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:32,206 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:32,206 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:32,207 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-04-15T21:38:32,207 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-04-15T21:38:32,208 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-04-15T21:38:32,208 creating build/lib/deepspeed/ops/csrc/fp_quantizer 2024-04-15T21:38:32,209 copying deepspeed/ops/csrc/fp_quantizer/quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer 2024-04-15T21:38:32,209 copying deepspeed/ops/csrc/fp_quantizer/quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer 2024-04-15T21:38:32,210 creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2024-04-15T21:38:32,210 copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2024-04-15T21:38:32,210 copying deepspeed/ops/csrc/fp_quantizer/includes/quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes 2024-04-15T21:38:32,211 creating build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,211 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,212 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,212 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,213 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,213 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,214 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,214 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,214 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,215 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,215 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,216 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,216 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,217 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,217 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,218 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,218 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,219 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,219 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,220 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,220 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,221 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,221 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,222 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,222 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,223 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,223 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,224 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,224 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,225 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2024-04-15T21:38:32,226 creating build/lib/deepspeed/ops/csrc/lamb 2024-04-15T21:38:32,226 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2024-04-15T21:38:32,227 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2024-04-15T21:38:32,227 creating build/lib/deepspeed/ops/csrc/lion 2024-04-15T21:38:32,228 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2024-04-15T21:38:32,228 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2024-04-15T21:38:32,229 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2024-04-15T21:38:32,229 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2024-04-15T21:38:32,230 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2024-04-15T21:38:32,230 creating build/lib/deepspeed/ops/csrc/quantization 2024-04-15T21:38:32,231 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-04-15T21:38:32,231 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-04-15T21:38:32,232 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2024-04-15T21:38:32,233 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-04-15T21:38:32,233 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-04-15T21:38:32,234 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-04-15T21:38:32,234 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2024-04-15T21:38:32,235 creating build/lib/deepspeed/ops/csrc/random_ltd 2024-04-15T21:38:32,236 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2024-04-15T21:38:32,236 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2024-04-15T21:38:32,237 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2024-04-15T21:38:32,238 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2024-04-15T21:38:32,239 creating build/lib/deepspeed/ops/csrc/sparse_attention 2024-04-15T21:38:32,240 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2024-04-15T21:38:32,241 creating build/lib/deepspeed/ops/csrc/spatial 2024-04-15T21:38:32,241 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2024-04-15T21:38:32,242 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2024-04-15T21:38:32,242 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2024-04-15T21:38:32,243 creating build/lib/deepspeed/ops/csrc/spatial/includes 2024-04-15T21:38:32,244 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2024-04-15T21:38:32,244 creating build/lib/deepspeed/ops/csrc/transformer 2024-04-15T21:38:32,247 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-04-15T21:38:32,248 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-04-15T21:38:32,249 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2024-04-15T21:38:32,251 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-04-15T21:38:32,252 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-04-15T21:38:32,253 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-04-15T21:38:32,254 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-04-15T21:38:32,256 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2024-04-15T21:38:32,260 creating build/lib/deepspeed/ops/csrc/transformer/inference 2024-04-15T21:38:32,262 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,263 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,265 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,267 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,271 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,274 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,276 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,284 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,287 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,291 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,295 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:32,299 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2024-04-15T21:38:32,300 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2024-04-15T21:38:32,303 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2024-04-15T21:38:32,307 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2024-04-15T21:38:32,311 creating build/lib/deepspeed/ops/csrc/utils 2024-04-15T21:38:32,312 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2024-04-15T21:38:32,315 creating build/lib/deepspeed/ops/csrc/xpu 2024-04-15T21:38:32,315 creating build/lib/deepspeed/ops/csrc/xpu/adagrad 2024-04-15T21:38:32,317 copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad 2024-04-15T21:38:32,321 creating build/lib/deepspeed/ops/csrc/xpu/adam 2024-04-15T21:38:32,322 copying deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2024-04-15T21:38:32,325 copying deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2024-04-15T21:38:32,328 copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2024-04-15T21:38:32,330 copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam 2024-04-15T21:38:32,333 creating build/lib/deepspeed/ops/csrc/xpu/common 2024-04-15T21:38:32,334 copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common 2024-04-15T21:38:32,337 creating build/lib/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:32,338 copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:32,341 copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:32,343 copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:32,346 copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:32,349 copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:32,352 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2024-04-15T21:38:32,355 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2024-04-15T21:38:32,357 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2024-04-15T21:38:32,360 creating build/lib/deepspeed/inference/v2/ragged/csrc 2024-04-15T21:38:32,361 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2024-04-15T21:38:32,363 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2024-04-15T21:38:32,366 creating build/lib/deepspeed/inference/v2/ragged/includes 2024-04-15T21:38:32,367 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2024-04-15T21:38:32,370 creating build/lib/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:32,371 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:32,374 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:32,377 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:32,380 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:32,384 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:32,387 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2024-04-15T21:38:32,389 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2024-04-15T21:38:32,390 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2024-04-15T21:38:32,393 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2024-04-15T21:38:32,395 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2024-04-15T21:38:32,396 copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes 2024-04-15T21:38:32,398 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-04-15T21:38:32,399 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-04-15T21:38:32,401 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-04-15T21:38:32,403 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-04-15T21:38:32,405 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2024-04-15T21:38:32,407 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:32,410 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:32,411 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:32,413 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:32,416 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:32,418 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:32,420 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:32,422 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:32,424 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:32,426 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:32,429 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:32,431 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:32,433 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:32,436 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:32,439 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:32,442 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:32,445 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:32,448 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:32,451 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:32,454 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:32,457 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:32,459 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:32,463 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:32,466 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:32,469 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:32,472 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:32,475 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-04-15T21:38:32,478 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-04-15T21:38:32,480 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:32,482 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:32,485 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:32,487 copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:32,490 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:32,492 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:32,494 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:32,497 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:32,500 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:32,502 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:32,504 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:32,507 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:32,510 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:32,512 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:32,514 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:32,517 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:32,519 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:32,523 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:32,526 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:32,528 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:32,531 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:32,533 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:32,534 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:32,536 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:32,541 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:32,563 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:32,566 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:32,569 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:32,572 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:32,575 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:32,578 copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:32,581 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-04-15T21:38:32,584 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-04-15T21:38:32,588 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:32,591 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:32,594 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:32,672 running build_scripts 2024-04-15T21:38:32,673 creating build/scripts-3.11 2024-04-15T21:38:32,674 copying and adjusting bin/deepspeed -> build/scripts-3.11 2024-04-15T21:38:32,676 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2024-04-15T21:38:32,677 copying and adjusting bin/ds -> build/scripts-3.11 2024-04-15T21:38:32,679 copying bin/ds_ssh -> build/scripts-3.11 2024-04-15T21:38:32,681 copying and adjusting bin/ds_report -> build/scripts-3.11 2024-04-15T21:38:32,682 copying and adjusting bin/ds_bench -> build/scripts-3.11 2024-04-15T21:38:32,684 copying and adjusting bin/dsr -> build/scripts-3.11 2024-04-15T21:38:32,685 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2024-04-15T21:38:32,687 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2024-04-15T21:38:32,687 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2024-04-15T21:38:32,688 changing mode of build/scripts-3.11/ds from 644 to 755 2024-04-15T21:38:32,688 changing mode of build/scripts-3.11/ds_report from 644 to 755 2024-04-15T21:38:32,689 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2024-04-15T21:38:32,690 changing mode of build/scripts-3.11/dsr from 644 to 755 2024-04-15T21:38:32,690 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2024-04-15T21:38:32,716 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2024-04-15T21:38:32,717 !! 2024-04-15T21:38:32,718 ******************************************************************************** 2024-04-15T21:38:32,718 Please avoid running ``setup.py`` directly. 2024-04-15T21:38:32,719 Instead, use pypa/build, pypa/installer or other 2024-04-15T21:38:32,719 standards-based tools. 2024-04-15T21:38:32,720 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2024-04-15T21:38:32,721 ******************************************************************************** 2024-04-15T21:38:32,722 !! 2024-04-15T21:38:32,722 self.initialize_options() 2024-04-15T21:38:32,742 installing to build/bdist.linux-armv7l/wheel 2024-04-15T21:38:32,743 running install 2024-04-15T21:38:32,766 running install_lib 2024-04-15T21:38:32,794 creating build/bdist.linux-armv7l 2024-04-15T21:38:32,794 creating build/bdist.linux-armv7l/wheel 2024-04-15T21:38:32,796 creating build/bdist.linux-armv7l/wheel/deepspeed 2024-04-15T21:38:32,797 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-04-15T21:38:32,799 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-04-15T21:38:32,801 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-04-15T21:38:32,805 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2024-04-15T21:38:32,806 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2024-04-15T21:38:32,808 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2024-04-15T21:38:32,810 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2024-04-15T21:38:32,812 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,813 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,815 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,818 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,820 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,823 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,824 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,826 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,828 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,830 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,833 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,835 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,837 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,840 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,842 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,845 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,847 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,849 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,851 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,853 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,856 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,859 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,861 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,863 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-04-15T21:38:32,864 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-04-15T21:38:32,866 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-04-15T21:38:32,868 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-04-15T21:38:32,871 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-04-15T21:38:32,874 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-04-15T21:38:32,877 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-04-15T21:38:32,879 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2024-04-15T21:38:32,881 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,883 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2024-04-15T21:38:32,886 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,889 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,891 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,894 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,897 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,899 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,902 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,904 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,906 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2024-04-15T21:38:32,910 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:32,911 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:32,913 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:32,916 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:32,918 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:32,926 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:32,930 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2024-04-15T21:38:32,932 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2024-04-15T21:38:32,934 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2024-04-15T21:38:32,937 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2024-04-15T21:38:32,938 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2024-04-15T21:38:32,941 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2024-04-15T21:38:32,942 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2024-04-15T21:38:32,944 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2024-04-15T21:38:32,947 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2024-04-15T21:38:32,948 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2024-04-15T21:38:32,950 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2024-04-15T21:38:32,953 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2024-04-15T21:38:32,956 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2024-04-15T21:38:32,959 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2024-04-15T21:38:32,962 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2024-04-15T21:38:32,966 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:32,969 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:32,973 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:32,976 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:32,977 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:32,981 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:32,987 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:32,990 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:32,993 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:32,996 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:32,998 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:33,001 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:33,004 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:33,006 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:33,009 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:33,011 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:33,014 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:33,017 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:33,024 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:33,027 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2024-04-15T21:38:33,035 copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:33,038 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:33,041 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:33,045 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:33,048 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:33,052 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2024-04-15T21:38:33,053 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2024-04-15T21:38:33,055 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2024-04-15T21:38:33,057 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2024-04-15T21:38:33,062 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2024-04-15T21:38:33,063 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2024-04-15T21:38:33,066 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2024-04-15T21:38:33,069 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2024-04-15T21:38:33,071 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:33,073 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:33,076 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:33,078 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:33,080 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:33,082 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2024-04-15T21:38:33,085 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:33,086 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:33,089 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:33,091 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:33,093 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:33,097 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2024-04-15T21:38:33,099 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2024-04-15T21:38:33,104 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:33,106 copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:33,109 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-04-15T21:38:33,111 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-04-15T21:38:33,114 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-04-15T21:38:33,117 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-04-15T21:38:33,121 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-04-15T21:38:33,124 copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2024-04-15T21:38:33,127 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:33,133 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-04-15T21:38:33,135 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-04-15T21:38:33,141 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-04-15T21:38:33,144 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-04-15T21:38:33,148 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-04-15T21:38:33,151 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-04-15T21:38:33,156 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-04-15T21:38:33,161 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-04-15T21:38:33,165 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-04-15T21:38:33,172 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2024-04-15T21:38:33,175 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2024-04-15T21:38:33,176 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2024-04-15T21:38:33,179 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2024-04-15T21:38:33,182 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:33,186 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-04-15T21:38:33,188 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-04-15T21:38:33,191 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-04-15T21:38:33,193 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-04-15T21:38:33,202 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-04-15T21:38:33,208 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-04-15T21:38:33,212 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2024-04-15T21:38:33,215 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2024-04-15T21:38:33,219 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-04-15T21:38:33,221 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-04-15T21:38:33,224 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-04-15T21:38:33,228 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-04-15T21:38:33,229 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-04-15T21:38:33,232 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-04-15T21:38:33,234 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-04-15T21:38:33,237 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-04-15T21:38:33,239 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-04-15T21:38:33,241 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2024-04-15T21:38:33,244 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-04-15T21:38:33,247 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-04-15T21:38:33,251 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-04-15T21:38:33,257 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2024-04-15T21:38:33,259 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2024-04-15T21:38:33,263 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2024-04-15T21:38:33,267 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2024-04-15T21:38:33,269 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2024-04-15T21:38:33,271 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2024-04-15T21:38:33,275 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-04-15T21:38:33,276 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-04-15T21:38:33,278 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-04-15T21:38:33,280 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-04-15T21:38:33,283 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-04-15T21:38:33,285 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-04-15T21:38:33,287 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-04-15T21:38:33,289 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2024-04-15T21:38:33,292 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2024-04-15T21:38:33,293 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2024-04-15T21:38:33,294 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2024-04-15T21:38:33,297 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2024-04-15T21:38:33,300 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,301 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,303 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,305 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,307 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,310 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-04-15T21:38:33,311 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-04-15T21:38:33,314 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-04-15T21:38:33,316 copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-04-15T21:38:33,318 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-04-15T21:38:33,321 copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-04-15T21:38:33,324 copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-04-15T21:38:33,327 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-04-15T21:38:33,329 copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-04-15T21:38:33,332 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2024-04-15T21:38:33,334 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,336 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,338 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,340 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,343 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,345 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,347 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,349 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,352 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,353 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,357 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:33,359 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:33,361 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:33,363 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:33,366 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:33,368 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:33,370 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2024-04-15T21:38:33,372 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,375 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:33,376 copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:33,379 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:33,381 copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:33,385 copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:33,388 copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:33,391 copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu 2024-04-15T21:38:33,394 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,396 copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,399 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,402 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,405 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,409 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,411 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,414 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:33,416 copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:33,419 copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:33,422 copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:33,425 copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:33,428 copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu 2024-04-15T21:38:33,430 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2024-04-15T21:38:33,434 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2024-04-15T21:38:33,435 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2024-04-15T21:38:33,438 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2024-04-15T21:38:33,442 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2024-04-15T21:38:33,443 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2024-04-15T21:38:33,446 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2024-04-15T21:38:33,451 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer 2024-04-15T21:38:33,453 copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer 2024-04-15T21:38:33,456 copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer 2024-04-15T21:38:33,459 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2024-04-15T21:38:33,461 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2024-04-15T21:38:33,463 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,465 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,469 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,472 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,475 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,478 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,480 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,482 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,485 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,487 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,489 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,492 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2024-04-15T21:38:33,494 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:33,495 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:33,501 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:33,503 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:33,506 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:33,508 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:33,510 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2024-04-15T21:38:33,512 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2024-04-15T21:38:33,514 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2024-04-15T21:38:33,516 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2024-04-15T21:38:33,518 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:33,520 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-04-15T21:38:33,522 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-04-15T21:38:33,524 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2024-04-15T21:38:33,527 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:33,530 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:33,531 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:33,535 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:33,538 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:33,542 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:33,545 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:33,548 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:33,553 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2024-04-15T21:38:33,565 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:33,567 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:33,574 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:33,580 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:33,583 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:33,586 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:33,589 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:33,592 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2024-04-15T21:38:33,597 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-04-15T21:38:33,598 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-04-15T21:38:33,601 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-04-15T21:38:33,604 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-04-15T21:38:33,606 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2024-04-15T21:38:33,609 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:33,611 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:33,618 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:33,620 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:33,624 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2024-04-15T21:38:33,628 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,630 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,632 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,635 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,636 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,639 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,641 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,643 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,647 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,651 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,657 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,661 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,665 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,667 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,669 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,671 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,674 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,678 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,681 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,683 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,685 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,687 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,689 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,692 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,697 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:33,912 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:34,131 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:34,135 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:34,139 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:34,143 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2024-04-15T21:38:34,149 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2024-04-15T21:38:34,151 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2024-04-15T21:38:34,156 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2024-04-15T21:38:34,161 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer 2024-04-15T21:38:34,163 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes 2024-04-15T21:38:34,165 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/quantize.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes 2024-04-15T21:38:34,167 copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes 2024-04-15T21:38:34,169 copying build/lib/deepspeed/ops/csrc/fp_quantizer/quantize.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer 2024-04-15T21:38:34,171 copying build/lib/deepspeed/ops/csrc/fp_quantizer/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer 2024-04-15T21:38:34,175 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2024-04-15T21:38:34,177 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2024-04-15T21:38:34,178 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2024-04-15T21:38:34,180 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2024-04-15T21:38:34,181 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2024-04-15T21:38:34,184 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2024-04-15T21:38:34,189 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-04-15T21:38:34,190 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-04-15T21:38:34,195 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-04-15T21:38:34,201 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-04-15T21:38:34,205 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-04-15T21:38:34,211 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-04-15T21:38:34,216 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-04-15T21:38:34,220 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2024-04-15T21:38:34,225 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-04-15T21:38:34,226 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-04-15T21:38:34,230 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-04-15T21:38:34,233 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-04-15T21:38:34,236 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-04-15T21:38:34,241 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2024-04-15T21:38:34,244 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-04-15T21:38:34,246 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-04-15T21:38:34,249 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-04-15T21:38:34,252 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-04-15T21:38:34,254 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-04-15T21:38:34,258 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2024-04-15T21:38:34,263 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2024-04-15T21:38:34,264 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2024-04-15T21:38:34,268 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2024-04-15T21:38:34,270 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2024-04-15T21:38:34,273 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-04-15T21:38:34,275 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-04-15T21:38:34,279 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-04-15T21:38:34,284 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-04-15T21:38:34,287 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-04-15T21:38:34,290 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-04-15T21:38:34,294 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-04-15T21:38:34,298 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-04-15T21:38:34,303 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2024-04-15T21:38:34,306 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2024-04-15T21:38:34,310 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2024-04-15T21:38:34,317 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2024-04-15T21:38:34,322 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2024-04-15T21:38:34,326 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,327 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,333 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,335 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,339 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,342 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,345 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,347 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,351 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,355 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,358 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2024-04-15T21:38:34,360 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2024-04-15T21:38:34,363 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2024-04-15T21:38:34,363 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2024-04-15T21:38:34,366 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2024-04-15T21:38:34,368 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2024-04-15T21:38:34,368 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2024-04-15T21:38:34,371 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2024-04-15T21:38:34,372 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2024-04-15T21:38:34,374 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2024-04-15T21:38:34,375 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2024-04-15T21:38:34,377 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2024-04-15T21:38:34,380 copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2024-04-15T21:38:34,383 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2024-04-15T21:38:34,384 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2024-04-15T21:38:34,387 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu 2024-04-15T21:38:34,388 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:34,389 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:34,392 copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:34,394 copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:34,396 copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:34,398 copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes 2024-04-15T21:38:34,401 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2024-04-15T21:38:34,402 copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2024-04-15T21:38:34,404 copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2024-04-15T21:38:34,406 copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2024-04-15T21:38:34,408 copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam 2024-04-15T21:38:34,411 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common 2024-04-15T21:38:34,412 copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common 2024-04-15T21:38:34,415 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad 2024-04-15T21:38:34,416 copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad 2024-04-15T21:38:34,419 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2024-04-15T21:38:34,421 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2024-04-15T21:38:34,423 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2024-04-15T21:38:34,425 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2024-04-15T21:38:34,428 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2024-04-15T21:38:34,430 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2024-04-15T21:38:34,431 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2024-04-15T21:38:34,433 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2024-04-15T21:38:34,436 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2024-04-15T21:38:34,438 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2024-04-15T21:38:34,441 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2024-04-15T21:38:34,443 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2024-04-15T21:38:34,447 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2024-04-15T21:38:34,449 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2024-04-15T21:38:34,452 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2024-04-15T21:38:34,454 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2024-04-15T21:38:34,455 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2024-04-15T21:38:34,457 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2024-04-15T21:38:34,461 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,462 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,465 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,467 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,469 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,472 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,475 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,476 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,477 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,479 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,481 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,483 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,485 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,487 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,489 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,491 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,493 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2024-04-15T21:38:34,495 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,498 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,499 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,502 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,504 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,507 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,509 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,511 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,514 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,516 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,518 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,521 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2024-04-15T21:38:34,523 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,526 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,528 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,530 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2024-04-15T21:38:34,533 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2024-04-15T21:38:34,534 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2024-04-15T21:38:34,536 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2024-04-15T21:38:34,538 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-04-15T21:38:34,540 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-04-15T21:38:34,545 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-04-15T21:38:34,549 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-04-15T21:38:34,552 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-04-15T21:38:34,555 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-04-15T21:38:34,558 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-04-15T21:38:34,563 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2024-04-15T21:38:34,563 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2024-04-15T21:38:34,565 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2024-04-15T21:38:34,567 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2024-04-15T21:38:34,570 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2024-04-15T21:38:34,572 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2024-04-15T21:38:34,574 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2024-04-15T21:38:34,575 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2024-04-15T21:38:34,577 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2024-04-15T21:38:34,579 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2024-04-15T21:38:34,580 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2024-04-15T21:38:34,582 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2024-04-15T21:38:34,585 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-04-15T21:38:34,586 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-04-15T21:38:34,588 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-04-15T21:38:34,590 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-04-15T21:38:34,593 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-04-15T21:38:34,596 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-04-15T21:38:34,598 copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2024-04-15T21:38:34,601 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2024-04-15T21:38:34,602 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2024-04-15T21:38:34,605 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,606 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,608 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,609 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,611 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,613 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,615 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,617 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,619 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,621 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,622 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2024-04-15T21:38:34,625 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2024-04-15T21:38:34,626 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2024-04-15T21:38:34,627 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2024-04-15T21:38:34,629 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2024-04-15T21:38:34,632 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2024-04-15T21:38:34,633 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2024-04-15T21:38:34,635 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2024-04-15T21:38:34,638 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,639 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,641 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,642 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,645 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,648 copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,650 copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,651 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,653 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,654 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,656 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,658 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,661 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,664 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,665 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,667 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,670 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,672 copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2024-04-15T21:38:34,675 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-04-15T21:38:34,676 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-04-15T21:38:34,678 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-04-15T21:38:34,680 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-04-15T21:38:34,682 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-04-15T21:38:34,684 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-04-15T21:38:34,687 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2024-04-15T21:38:34,690 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-04-15T21:38:34,692 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2024-04-15T21:38:34,693 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2024-04-15T21:38:34,695 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2024-04-15T21:38:34,698 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2024-04-15T21:38:34,699 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2024-04-15T21:38:34,702 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2024-04-15T21:38:34,706 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2024-04-15T21:38:34,708 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2024-04-15T21:38:34,709 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2024-04-15T21:38:34,711 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2024-04-15T21:38:34,714 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2024-04-15T21:38:34,717 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-04-15T21:38:34,718 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-04-15T21:38:34,720 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-04-15T21:38:34,722 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-04-15T21:38:34,726 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-04-15T21:38:34,729 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2024-04-15T21:38:34,732 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-04-15T21:38:34,733 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2024-04-15T21:38:34,734 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2024-04-15T21:38:34,736 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2024-04-15T21:38:34,738 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2024-04-15T21:38:34,741 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:34,742 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:34,743 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:34,745 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:34,747 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:34,749 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:34,752 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:34,754 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2024-04-15T21:38:34,756 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:34,757 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:34,760 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:34,762 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:34,764 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:34,766 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:34,768 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:34,770 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:34,772 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2024-04-15T21:38:34,773 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2024-04-15T21:38:34,776 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2024-04-15T21:38:34,777 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2024-04-15T21:38:34,778 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2024-04-15T21:38:34,780 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2024-04-15T21:38:34,782 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2024-04-15T21:38:34,784 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2024-04-15T21:38:34,787 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2024-04-15T21:38:34,788 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2024-04-15T21:38:34,790 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2024-04-15T21:38:34,792 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2024-04-15T21:38:34,794 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2024-04-15T21:38:34,795 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2024-04-15T21:38:34,797 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2024-04-15T21:38:34,799 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2024-04-15T21:38:34,801 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2024-04-15T21:38:34,802 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2024-04-15T21:38:34,805 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2024-04-15T21:38:34,806 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2024-04-15T21:38:34,808 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2024-04-15T21:38:34,811 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2024-04-15T21:38:34,811 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2024-04-15T21:38:34,814 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2024-04-15T21:38:34,816 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2024-04-15T21:38:34,817 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2024-04-15T21:38:34,819 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2024-04-15T21:38:34,821 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-04-15T21:38:34,823 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-04-15T21:38:34,824 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-04-15T21:38:34,827 copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-04-15T21:38:34,830 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-04-15T21:38:34,835 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:34,836 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:34,837 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:34,839 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:34,841 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:34,844 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:34,846 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:34,847 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:34,849 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:34,851 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:34,853 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2024-04-15T21:38:34,855 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:34,857 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2024-04-15T21:38:34,858 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2024-04-15T21:38:34,860 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2024-04-15T21:38:34,862 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2024-04-15T21:38:34,864 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2024-04-15T21:38:34,866 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2024-04-15T21:38:34,867 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2024-04-15T21:38:34,869 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2024-04-15T21:38:34,871 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2024-04-15T21:38:34,873 copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2 2024-04-15T21:38:34,875 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:34,877 copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:34,880 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2024-04-15T21:38:34,881 copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2024-04-15T21:38:34,882 copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2024-04-15T21:38:34,885 copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2024-04-15T21:38:34,886 copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi 2024-04-15T21:38:34,889 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2024-04-15T21:38:34,890 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2024-04-15T21:38:34,892 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2024-04-15T21:38:34,895 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2024-04-15T21:38:34,897 copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral 2024-04-15T21:38:34,899 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2024-04-15T21:38:34,900 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2024-04-15T21:38:34,901 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2024-04-15T21:38:34,904 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2024-04-15T21:38:34,905 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2024-04-15T21:38:34,908 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2024-04-15T21:38:34,908 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2024-04-15T21:38:34,910 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2024-04-15T21:38:34,913 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2024-04-15T21:38:34,915 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2024-04-15T21:38:34,917 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2024-04-15T21:38:34,918 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2024-04-15T21:38:34,920 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2024-04-15T21:38:34,922 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2024-04-15T21:38:34,924 copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen 2024-04-15T21:38:34,927 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:34,933 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:34,941 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:34,942 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:34,945 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:34,947 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:34,949 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:34,952 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:34,955 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:34,957 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:34,959 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:34,962 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2024-04-15T21:38:34,964 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:34,967 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2024-04-15T21:38:34,968 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2024-04-15T21:38:34,970 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2024-04-15T21:38:34,973 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2024-04-15T21:38:34,975 copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon 2024-04-15T21:38:34,978 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2024-04-15T21:38:34,982 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-04-15T21:38:34,983 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-04-15T21:38:34,986 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-04-15T21:38:34,989 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2024-04-15T21:38:34,990 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2024-04-15T21:38:34,992 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-04-15T21:38:34,994 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-04-15T21:38:34,997 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2024-04-15T21:38:34,998 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2024-04-15T21:38:35,001 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2024-04-15T21:38:35,003 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-04-15T21:38:35,006 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-04-15T21:38:35,008 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2024-04-15T21:38:35,012 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2024-04-15T21:38:35,013 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2024-04-15T21:38:35,015 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2024-04-15T21:38:35,018 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2024-04-15T21:38:35,019 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:35,021 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:35,023 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:35,025 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:35,027 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:35,029 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2024-04-15T21:38:35,031 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2024-04-15T21:38:35,034 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2024-04-15T21:38:35,035 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2024-04-15T21:38:35,037 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2024-04-15T21:38:35,041 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:35,042 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:35,045 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:35,047 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:35,049 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:35,052 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:35,054 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2024-04-15T21:38:35,057 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2024-04-15T21:38:35,059 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2024-04-15T21:38:35,065 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:35,066 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:35,068 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:35,070 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:35,073 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:35,075 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:35,077 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2024-04-15T21:38:35,080 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2024-04-15T21:38:35,082 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:35,083 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:35,085 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:35,087 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:35,090 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:35,092 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:35,094 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2024-04-15T21:38:35,097 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:35,098 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:35,101 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:35,103 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:35,105 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:35,108 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:35,110 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:35,112 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:35,115 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2024-04-15T21:38:35,118 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes 2024-04-15T21:38:35,119 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes 2024-04-15T21:38:35,122 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:35,123 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:35,126 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:35,128 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:35,130 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:35,132 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:35,134 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2024-04-15T21:38:35,137 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:35,138 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:35,140 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:35,143 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:35,145 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:35,147 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:35,149 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2024-04-15T21:38:35,152 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-04-15T21:38:35,153 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-04-15T21:38:35,155 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-04-15T21:38:35,158 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-04-15T21:38:35,160 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2024-04-15T21:38:35,163 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:35,164 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:35,167 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:35,169 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:35,172 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:35,174 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:35,178 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating 2024-04-15T21:38:35,180 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-04-15T21:38:35,182 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-04-15T21:38:35,184 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-04-15T21:38:35,186 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2024-04-15T21:38:35,189 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:35,190 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:35,193 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:35,195 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:35,197 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:35,200 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:35,202 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2024-04-15T21:38:35,204 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:35,206 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:35,208 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:35,213 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:35,216 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:35,218 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2024-04-15T21:38:35,222 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2024-04-15T21:38:35,223 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2024-04-15T21:38:35,226 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:35,228 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:35,231 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:35,234 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:35,236 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:35,239 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2024-04-15T21:38:35,242 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:35,244 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:35,247 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:35,251 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:35,255 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:35,258 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2024-04-15T21:38:35,260 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:35,262 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:35,265 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:35,268 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:35,271 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:35,273 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:35,275 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:35,277 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:35,280 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2024-04-15T21:38:35,282 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2024-04-15T21:38:35,284 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:35,285 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:35,287 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:35,289 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:35,292 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:35,294 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:35,297 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear 2024-04-15T21:38:35,300 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:35,302 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:35,304 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:35,307 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:35,309 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:35,312 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:35,314 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:35,316 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:35,319 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:35,321 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include 2024-04-15T21:38:35,324 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-04-15T21:38:35,325 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-04-15T21:38:35,327 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-04-15T21:38:35,330 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-04-15T21:38:35,335 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2024-04-15T21:38:35,338 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:35,338 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:35,341 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:35,342 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:35,344 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:35,346 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:35,348 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:35,350 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2024-04-15T21:38:35,353 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-04-15T21:38:35,354 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-04-15T21:38:35,356 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2024-04-15T21:38:35,358 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2024-04-15T21:38:35,359 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2024-04-15T21:38:35,362 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2024-04-15T21:38:35,363 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2024-04-15T21:38:35,365 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-04-15T21:38:35,367 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2024-04-15T21:38:35,370 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-04-15T21:38:35,371 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-04-15T21:38:35,374 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-04-15T21:38:35,376 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-04-15T21:38:35,379 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-04-15T21:38:35,381 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-04-15T21:38:35,384 copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-04-15T21:38:35,386 copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-04-15T21:38:35,389 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-04-15T21:38:35,391 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2024-04-15T21:38:35,394 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-04-15T21:38:35,395 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-04-15T21:38:35,396 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-04-15T21:38:35,399 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-04-15T21:38:35,401 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-04-15T21:38:35,404 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-04-15T21:38:35,406 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-04-15T21:38:35,408 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-04-15T21:38:35,410 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-04-15T21:38:35,412 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2024-04-15T21:38:35,414 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2024-04-15T21:38:35,415 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2024-04-15T21:38:35,417 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2024-04-15T21:38:35,419 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-04-15T21:38:35,420 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-04-15T21:38:35,423 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-04-15T21:38:35,425 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-04-15T21:38:35,427 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-04-15T21:38:35,430 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-04-15T21:38:35,432 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-04-15T21:38:35,434 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-04-15T21:38:35,436 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2024-04-15T21:38:35,438 copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-04-15T21:38:35,441 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2024-04-15T21:38:35,442 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2024-04-15T21:38:35,444 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,445 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,447 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,449 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,451 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,453 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,455 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,458 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,459 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,462 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,464 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2024-04-15T21:38:35,467 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-04-15T21:38:35,467 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-04-15T21:38:35,469 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-04-15T21:38:35,471 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-04-15T21:38:35,473 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-04-15T21:38:35,475 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-04-15T21:38:35,478 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2024-04-15T21:38:35,481 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2024-04-15T21:38:35,482 running install_egg_info 2024-04-15T21:38:35,514 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.14.1-py3.11.egg-info 2024-04-15T21:38:35,529 running install_scripts 2024-04-15T21:38:35,530 creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data 2024-04-15T21:38:35,531 creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts 2024-04-15T21:38:35,532 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts 2024-04-15T21:38:35,534 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts 2024-04-15T21:38:35,536 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts 2024-04-15T21:38:35,539 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts 2024-04-15T21:38:35,541 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts 2024-04-15T21:38:35,543 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts 2024-04-15T21:38:35,545 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts 2024-04-15T21:38:35,547 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts 2024-04-15T21:38:35,549 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts/ds_bench to 755 2024-04-15T21:38:35,549 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts/ds_report to 755 2024-04-15T21:38:35,550 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts/ds to 755 2024-04-15T21:38:35,550 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts/ds_ssh to 755 2024-04-15T21:38:35,551 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts/ds_elastic to 755 2024-04-15T21:38:35,551 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts/dsr to 755 2024-04-15T21:38:35,552 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts/deepspeed.pt to 755 2024-04-15T21:38:35,552 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.data/scripts/deepspeed to 755 2024-04-15T21:38:35,598 creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.1.dist-info/WHEEL 2024-04-15T21:38:35,601 creating '/tmp/pip-wheel-qo9b5j4o/deepspeed-0.14.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2024-04-15T21:38:35,605 adding 'deepspeed/__init__.py' 2024-04-15T21:38:35,607 adding 'deepspeed/constants.py' 2024-04-15T21:38:35,609 adding 'deepspeed/env_report.py' 2024-04-15T21:38:35,610 adding 'deepspeed/git_version_info.py' 2024-04-15T21:38:35,611 adding 'deepspeed/git_version_info_installed.py' 2024-04-15T21:38:35,613 adding 'deepspeed/pydantic_v1.py' 2024-04-15T21:38:35,615 adding 'deepspeed/accelerator/__init__.py' 2024-04-15T21:38:35,616 adding 'deepspeed/accelerator/abstract_accelerator.py' 2024-04-15T21:38:35,618 adding 'deepspeed/accelerator/cpu_accelerator.py' 2024-04-15T21:38:35,620 adding 'deepspeed/accelerator/cuda_accelerator.py' 2024-04-15T21:38:35,622 adding 'deepspeed/accelerator/hpu_accelerator.py' 2024-04-15T21:38:35,623 adding 'deepspeed/accelerator/mps_accelerator.py' 2024-04-15T21:38:35,625 adding 'deepspeed/accelerator/npu_accelerator.py' 2024-04-15T21:38:35,626 adding 'deepspeed/accelerator/real_accelerator.py' 2024-04-15T21:38:35,628 adding 'deepspeed/accelerator/xpu_accelerator.py' 2024-04-15T21:38:35,630 adding 'deepspeed/autotuning/__init__.py' 2024-04-15T21:38:35,635 adding 'deepspeed/autotuning/autotuner.py' 2024-04-15T21:38:35,636 adding 'deepspeed/autotuning/config.py' 2024-04-15T21:38:35,638 adding 'deepspeed/autotuning/constants.py' 2024-04-15T21:38:35,640 adding 'deepspeed/autotuning/scheduler.py' 2024-04-15T21:38:35,643 adding 'deepspeed/autotuning/utils.py' 2024-04-15T21:38:35,644 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2024-04-15T21:38:35,645 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2024-04-15T21:38:35,647 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2024-04-15T21:38:35,648 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2024-04-15T21:38:35,650 adding 'deepspeed/autotuning/tuner/__init__.py' 2024-04-15T21:38:35,651 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2024-04-15T21:38:35,652 adding 'deepspeed/autotuning/tuner/cost_model.py' 2024-04-15T21:38:35,654 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2024-04-15T21:38:35,655 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2024-04-15T21:38:35,657 adding 'deepspeed/autotuning/tuner/utils.py' 2024-04-15T21:38:35,659 adding 'deepspeed/checkpoint/__init__.py' 2024-04-15T21:38:35,660 adding 'deepspeed/checkpoint/constants.py' 2024-04-15T21:38:35,662 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2024-04-15T21:38:35,665 adding 'deepspeed/checkpoint/ds_to_universal.py' 2024-04-15T21:38:35,666 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2024-04-15T21:38:35,668 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2024-04-15T21:38:35,670 adding 'deepspeed/checkpoint/reshape_utils.py' 2024-04-15T21:38:35,671 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2024-04-15T21:38:35,673 adding 'deepspeed/checkpoint/utils.py' 2024-04-15T21:38:35,674 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2024-04-15T21:38:35,676 adding 'deepspeed/comm/__init__.py' 2024-04-15T21:38:35,677 adding 'deepspeed/comm/backend.py' 2024-04-15T21:38:35,679 adding 'deepspeed/comm/ccl.py' 2024-04-15T21:38:35,682 adding 'deepspeed/comm/comm.py' 2024-04-15T21:38:35,684 adding 'deepspeed/comm/config.py' 2024-04-15T21:38:35,685 adding 'deepspeed/comm/constants.py' 2024-04-15T21:38:35,686 adding 'deepspeed/comm/reduce_op.py' 2024-04-15T21:38:35,688 adding 'deepspeed/comm/torch.py' 2024-04-15T21:38:35,689 adding 'deepspeed/comm/utils.py' 2024-04-15T21:38:35,691 adding 'deepspeed/compression/__init__.py' 2024-04-15T21:38:35,695 adding 'deepspeed/compression/basic_layer.py' 2024-04-15T21:38:35,698 adding 'deepspeed/compression/compress.py' 2024-04-15T21:38:35,701 adding 'deepspeed/compression/config.py' 2024-04-15T21:38:35,703 adding 'deepspeed/compression/constants.py' 2024-04-15T21:38:35,705 adding 'deepspeed/compression/helper.py' 2024-04-15T21:38:35,707 adding 'deepspeed/compression/scheduler.py' 2024-04-15T21:38:35,709 adding 'deepspeed/compression/utils.py' 2024-04-15T21:38:35,712 adding 'deepspeed/elasticity/__init__.py' 2024-04-15T21:38:35,713 adding 'deepspeed/elasticity/config.py' 2024-04-15T21:38:35,715 adding 'deepspeed/elasticity/constants.py' 2024-04-15T21:38:35,717 adding 'deepspeed/elasticity/elastic_agent.py' 2024-04-15T21:38:35,720 adding 'deepspeed/elasticity/elasticity.py' 2024-04-15T21:38:35,722 adding 'deepspeed/elasticity/utils.py' 2024-04-15T21:38:35,724 adding 'deepspeed/inference/__init__.py' 2024-04-15T21:38:35,726 adding 'deepspeed/inference/config.py' 2024-04-15T21:38:35,732 adding 'deepspeed/inference/engine.py' 2024-04-15T21:38:35,734 adding 'deepspeed/inference/quantization/__init__.py' 2024-04-15T21:38:35,736 adding 'deepspeed/inference/quantization/layers.py' 2024-04-15T21:38:35,738 adding 'deepspeed/inference/quantization/quantization.py' 2024-04-15T21:38:35,739 adding 'deepspeed/inference/quantization/quantization_context.py' 2024-04-15T21:38:35,742 adding 'deepspeed/inference/quantization/utils.py' 2024-04-15T21:38:35,744 adding 'deepspeed/inference/v2/__init__.py' 2024-04-15T21:38:35,746 adding 'deepspeed/inference/v2/allocator.py' 2024-04-15T21:38:35,748 adding 'deepspeed/inference/v2/config_v2.py' 2024-04-15T21:38:35,750 adding 'deepspeed/inference/v2/engine_factory.py' 2024-04-15T21:38:35,752 adding 'deepspeed/inference/v2/engine_v2.py' 2024-04-15T21:38:35,754 adding 'deepspeed/inference/v2/inference_parameter.py' 2024-04-15T21:38:35,756 adding 'deepspeed/inference/v2/inference_utils.py' 2024-04-15T21:38:35,757 adding 'deepspeed/inference/v2/logging.py' 2024-04-15T21:38:35,759 adding 'deepspeed/inference/v2/scheduling_utils.py' 2024-04-15T21:38:35,761 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2024-04-15T21:38:35,763 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2024-04-15T21:38:35,765 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2024-04-15T21:38:35,767 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2024-04-15T21:38:35,769 adding 'deepspeed/inference/v2/kernels/__init__.py' 2024-04-15T21:38:35,771 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2024-04-15T21:38:35,773 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2024-04-15T21:38:35,775 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2024-04-15T21:38:35,777 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2024-04-15T21:38:35,779 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2024-04-15T21:38:35,780 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2024-04-15T21:38:35,782 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2024-04-15T21:38:35,784 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu' 2024-04-15T21:38:35,786 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2024-04-15T21:38:35,788 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2024-04-15T21:38:35,790 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2024-04-15T21:38:35,792 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2024-04-15T21:38:35,795 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2024-04-15T21:38:35,796 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2024-04-15T21:38:35,797 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2024-04-15T21:38:35,798 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2024-04-15T21:38:35,799 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2024-04-15T21:38:35,801 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2024-04-15T21:38:35,802 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2024-04-15T21:38:35,804 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu' 2024-04-15T21:38:35,806 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py' 2024-04-15T21:38:35,808 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py' 2024-04-15T21:38:35,813 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp' 2024-04-15T21:38:35,814 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h' 2024-04-15T21:38:35,816 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu' 2024-04-15T21:38:35,817 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h' 2024-04-15T21:38:35,819 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h' 2024-04-15T21:38:35,821 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh' 2024-04-15T21:38:35,822 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh' 2024-04-15T21:38:35,824 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh' 2024-04-15T21:38:35,825 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh' 2024-04-15T21:38:35,827 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh' 2024-04-15T21:38:35,828 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh' 2024-04-15T21:38:35,829 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh' 2024-04-15T21:38:35,831 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h' 2024-04-15T21:38:35,833 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2024-04-15T21:38:35,834 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2024-04-15T21:38:35,835 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2024-04-15T21:38:35,837 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2024-04-15T21:38:35,838 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2024-04-15T21:38:35,840 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu' 2024-04-15T21:38:35,841 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2024-04-15T21:38:35,843 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2024-04-15T21:38:35,845 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2024-04-15T21:38:35,846 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2024-04-15T21:38:35,847 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2024-04-15T21:38:35,849 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu' 2024-04-15T21:38:35,851 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2024-04-15T21:38:35,852 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2024-04-15T21:38:35,854 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2024-04-15T21:38:35,855 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2024-04-15T21:38:35,856 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2024-04-15T21:38:35,858 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2024-04-15T21:38:35,859 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2024-04-15T21:38:35,860 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2024-04-15T21:38:35,862 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2024-04-15T21:38:35,863 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2024-04-15T21:38:35,864 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2024-04-15T21:38:35,866 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2024-04-15T21:38:35,867 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2024-04-15T21:38:35,869 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2024-04-15T21:38:35,870 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2024-04-15T21:38:35,872 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2024-04-15T21:38:35,873 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2024-04-15T21:38:35,876 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2024-04-15T21:38:35,878 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2024-04-15T21:38:35,880 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2024-04-15T21:38:35,881 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2024-04-15T21:38:35,883 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2024-04-15T21:38:35,884 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2024-04-15T21:38:35,885 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2024-04-15T21:38:35,887 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2024-04-15T21:38:35,888 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2024-04-15T21:38:35,889 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2024-04-15T21:38:35,891 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2024-04-15T21:38:35,892 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2024-04-15T21:38:35,894 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2024-04-15T21:38:35,895 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2024-04-15T21:38:35,897 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2024-04-15T21:38:35,899 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2024-04-15T21:38:35,900 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2024-04-15T21:38:35,902 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2024-04-15T21:38:35,903 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2024-04-15T21:38:35,905 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu' 2024-04-15T21:38:35,907 adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h' 2024-04-15T21:38:35,908 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2024-04-15T21:38:35,910 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2024-04-15T21:38:35,911 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2024-04-15T21:38:35,913 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2024-04-15T21:38:35,914 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2024-04-15T21:38:35,916 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu' 2024-04-15T21:38:35,917 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2024-04-15T21:38:35,918 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2024-04-15T21:38:35,920 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2024-04-15T21:38:35,921 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2024-04-15T21:38:35,922 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2024-04-15T21:38:35,923 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2024-04-15T21:38:35,925 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2024-04-15T21:38:35,926 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu' 2024-04-15T21:38:35,928 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2024-04-15T21:38:35,929 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2024-04-15T21:38:35,930 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2024-04-15T21:38:35,931 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2024-04-15T21:38:35,933 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2024-04-15T21:38:35,934 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu' 2024-04-15T21:38:35,936 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2024-04-15T21:38:35,937 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2024-04-15T21:38:35,938 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2024-04-15T21:38:35,939 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2024-04-15T21:38:35,941 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2024-04-15T21:38:35,942 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu' 2024-04-15T21:38:35,944 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2024-04-15T21:38:35,945 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2024-04-15T21:38:35,947 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2024-04-15T21:38:35,948 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py' 2024-04-15T21:38:35,950 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp' 2024-04-15T21:38:35,951 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh' 2024-04-15T21:38:35,952 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h' 2024-04-15T21:38:35,953 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py' 2024-04-15T21:38:35,955 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu' 2024-04-15T21:38:35,957 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2024-04-15T21:38:35,958 adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py' 2024-04-15T21:38:35,960 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2024-04-15T21:38:35,962 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2024-04-15T21:38:35,965 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2024-04-15T21:38:35,968 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2024-04-15T21:38:35,971 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2024-04-15T21:38:35,973 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2024-04-15T21:38:35,975 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2024-04-15T21:38:35,977 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2024-04-15T21:38:35,978 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2024-04-15T21:38:35,979 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2024-04-15T21:38:35,982 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2024-04-15T21:38:35,983 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2024-04-15T21:38:35,984 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2024-04-15T21:38:35,986 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2024-04-15T21:38:35,987 adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py' 2024-04-15T21:38:35,988 adding 'deepspeed/inference/v2/model_implementations/falcon/container.py' 2024-04-15T21:38:35,990 adding 'deepspeed/inference/v2/model_implementations/falcon/model.py' 2024-04-15T21:38:35,991 adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py' 2024-04-15T21:38:35,993 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2024-04-15T21:38:35,994 adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py' 2024-04-15T21:38:35,996 adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py' 2024-04-15T21:38:35,997 adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py' 2024-04-15T21:38:35,999 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2024-04-15T21:38:36,000 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2024-04-15T21:38:36,002 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2024-04-15T21:38:36,003 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2024-04-15T21:38:36,005 adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py' 2024-04-15T21:38:36,006 adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py' 2024-04-15T21:38:36,008 adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py' 2024-04-15T21:38:36,009 adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py' 2024-04-15T21:38:36,011 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2024-04-15T21:38:36,012 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2024-04-15T21:38:36,014 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2024-04-15T21:38:36,015 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2024-04-15T21:38:36,017 adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py' 2024-04-15T21:38:36,019 adding 'deepspeed/inference/v2/model_implementations/phi/containers.py' 2024-04-15T21:38:36,021 adding 'deepspeed/inference/v2/model_implementations/phi/model.py' 2024-04-15T21:38:36,022 adding 'deepspeed/inference/v2/model_implementations/phi/policy.py' 2024-04-15T21:38:36,024 adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py' 2024-04-15T21:38:36,026 adding 'deepspeed/inference/v2/model_implementations/qwen/container.py' 2024-04-15T21:38:36,027 adding 'deepspeed/inference/v2/model_implementations/qwen/model.py' 2024-04-15T21:38:36,028 adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py' 2024-04-15T21:38:36,030 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py' 2024-04-15T21:38:36,031 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py' 2024-04-15T21:38:36,033 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py' 2024-04-15T21:38:36,034 adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py' 2024-04-15T21:38:36,036 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2024-04-15T21:38:36,037 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2024-04-15T21:38:36,038 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2024-04-15T21:38:36,039 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2024-04-15T21:38:36,041 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2024-04-15T21:38:36,042 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2024-04-15T21:38:36,043 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2024-04-15T21:38:36,045 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2024-04-15T21:38:36,046 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2024-04-15T21:38:36,048 adding 'deepspeed/inference/v2/modules/__init__.py' 2024-04-15T21:38:36,049 adding 'deepspeed/inference/v2/modules/ds_module.py' 2024-04-15T21:38:36,050 adding 'deepspeed/inference/v2/modules/heuristics.py' 2024-04-15T21:38:36,052 adding 'deepspeed/inference/v2/modules/module_registry.py' 2024-04-15T21:38:36,053 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2024-04-15T21:38:36,055 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2024-04-15T21:38:36,056 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2024-04-15T21:38:36,057 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2024-04-15T21:38:36,059 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2024-04-15T21:38:36,060 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2024-04-15T21:38:36,061 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2024-04-15T21:38:36,063 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2024-04-15T21:38:36,065 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2024-04-15T21:38:36,066 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2024-04-15T21:38:36,068 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2024-04-15T21:38:36,069 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2024-04-15T21:38:36,071 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2024-04-15T21:38:36,073 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2024-04-15T21:38:36,074 adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py' 2024-04-15T21:38:36,076 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2024-04-15T21:38:36,078 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2024-04-15T21:38:36,080 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2024-04-15T21:38:36,081 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2024-04-15T21:38:36,083 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2024-04-15T21:38:36,084 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2024-04-15T21:38:36,085 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2024-04-15T21:38:36,087 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2024-04-15T21:38:36,088 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2024-04-15T21:38:36,090 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2024-04-15T21:38:36,092 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2024-04-15T21:38:36,093 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2024-04-15T21:38:36,094 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2024-04-15T21:38:36,095 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2024-04-15T21:38:36,097 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2024-04-15T21:38:36,098 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2024-04-15T21:38:36,099 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2024-04-15T21:38:36,101 adding 'deepspeed/inference/v2/ragged/__init__.py' 2024-04-15T21:38:36,102 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2024-04-15T21:38:36,104 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2024-04-15T21:38:36,106 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2024-04-15T21:38:36,107 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2024-04-15T21:38:36,109 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2024-04-15T21:38:36,111 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2024-04-15T21:38:36,113 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2024-04-15T21:38:36,115 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2024-04-15T21:38:36,117 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2024-04-15T21:38:36,118 adding 'deepspeed/launcher/__init__.py' 2024-04-15T21:38:36,120 adding 'deepspeed/launcher/constants.py' 2024-04-15T21:38:36,122 adding 'deepspeed/launcher/launch.py' 2024-04-15T21:38:36,124 adding 'deepspeed/launcher/launcher_helper.py' 2024-04-15T21:38:36,126 adding 'deepspeed/launcher/multinode_runner.py' 2024-04-15T21:38:36,129 adding 'deepspeed/launcher/runner.py' 2024-04-15T21:38:36,131 adding 'deepspeed/model_implementations/__init__.py' 2024-04-15T21:38:36,133 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2024-04-15T21:38:36,134 adding 'deepspeed/model_implementations/diffusers/unet.py' 2024-04-15T21:38:36,135 adding 'deepspeed/model_implementations/diffusers/vae.py' 2024-04-15T21:38:36,137 adding 'deepspeed/model_implementations/features/__init__.py' 2024-04-15T21:38:36,138 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2024-04-15T21:38:36,140 adding 'deepspeed/model_implementations/transformers/__init__.py' 2024-04-15T21:38:36,141 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2024-04-15T21:38:36,142 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2024-04-15T21:38:36,143 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2024-04-15T21:38:36,145 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2024-04-15T21:38:36,146 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2024-04-15T21:38:36,147 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2024-04-15T21:38:36,149 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2024-04-15T21:38:36,150 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2024-04-15T21:38:36,151 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2024-04-15T21:38:36,153 adding 'deepspeed/module_inject/__init__.py' 2024-04-15T21:38:36,156 adding 'deepspeed/module_inject/auto_tp.py' 2024-04-15T21:38:36,158 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2024-04-15T21:38:36,159 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2024-04-15T21:38:36,161 adding 'deepspeed/module_inject/inject.py' 2024-04-15T21:38:36,162 adding 'deepspeed/module_inject/layers.py' 2024-04-15T21:38:36,164 adding 'deepspeed/module_inject/load_checkpoint.py' 2024-04-15T21:38:36,165 adding 'deepspeed/module_inject/module_quantize.py' 2024-04-15T21:38:36,167 adding 'deepspeed/module_inject/policy.py' 2024-04-15T21:38:36,170 adding 'deepspeed/module_inject/replace_module.py' 2024-04-15T21:38:36,172 adding 'deepspeed/module_inject/replace_policy.py' 2024-04-15T21:38:36,173 adding 'deepspeed/module_inject/tp_shard.py' 2024-04-15T21:38:36,174 adding 'deepspeed/module_inject/utils.py' 2024-04-15T21:38:36,176 adding 'deepspeed/module_inject/containers/__init__.py' 2024-04-15T21:38:36,178 adding 'deepspeed/module_inject/containers/base.py' 2024-04-15T21:38:36,179 adding 'deepspeed/module_inject/containers/base_moe.py' 2024-04-15T21:38:36,181 adding 'deepspeed/module_inject/containers/bert.py' 2024-04-15T21:38:36,182 adding 'deepspeed/module_inject/containers/bloom.py' 2024-04-15T21:38:36,183 adding 'deepspeed/module_inject/containers/clip.py' 2024-04-15T21:38:36,185 adding 'deepspeed/module_inject/containers/distil_bert.py' 2024-04-15T21:38:36,186 adding 'deepspeed/module_inject/containers/gpt2.py' 2024-04-15T21:38:36,187 adding 'deepspeed/module_inject/containers/gptj.py' 2024-04-15T21:38:36,189 adding 'deepspeed/module_inject/containers/gptneo.py' 2024-04-15T21:38:36,190 adding 'deepspeed/module_inject/containers/gptneox.py' 2024-04-15T21:38:36,192 adding 'deepspeed/module_inject/containers/internlm.py' 2024-04-15T21:38:36,193 adding 'deepspeed/module_inject/containers/llama.py' 2024-04-15T21:38:36,195 adding 'deepspeed/module_inject/containers/llama2.py' 2024-04-15T21:38:36,196 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2024-04-15T21:38:36,197 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2024-04-15T21:38:36,199 adding 'deepspeed/module_inject/containers/opt.py' 2024-04-15T21:38:36,200 adding 'deepspeed/module_inject/containers/unet.py' 2024-04-15T21:38:36,201 adding 'deepspeed/module_inject/containers/vae.py' 2024-04-15T21:38:36,203 adding 'deepspeed/module_inject/containers/features/__init__.py' 2024-04-15T21:38:36,205 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2024-04-15T21:38:36,206 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2024-04-15T21:38:36,208 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2024-04-15T21:38:36,209 adding 'deepspeed/module_inject/containers/features/megatron.py' 2024-04-15T21:38:36,210 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2024-04-15T21:38:36,212 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2024-04-15T21:38:36,214 adding 'deepspeed/moe/__init__.py' 2024-04-15T21:38:36,216 adding 'deepspeed/moe/experts.py' 2024-04-15T21:38:36,218 adding 'deepspeed/moe/layer.py' 2024-04-15T21:38:36,219 adding 'deepspeed/moe/mappings.py' 2024-04-15T21:38:36,222 adding 'deepspeed/moe/sharded_moe.py' 2024-04-15T21:38:36,224 adding 'deepspeed/moe/utils.py' 2024-04-15T21:38:36,225 adding 'deepspeed/monitor/__init__.py' 2024-04-15T21:38:36,227 adding 'deepspeed/monitor/config.py' 2024-04-15T21:38:36,228 adding 'deepspeed/monitor/csv_monitor.py' 2024-04-15T21:38:36,229 adding 'deepspeed/monitor/monitor.py' 2024-04-15T21:38:36,231 adding 'deepspeed/monitor/tensorboard.py' 2024-04-15T21:38:36,232 adding 'deepspeed/monitor/utils.py' 2024-04-15T21:38:36,233 adding 'deepspeed/monitor/wandb.py' 2024-04-15T21:38:36,235 adding 'deepspeed/nebula/__init__.py' 2024-04-15T21:38:36,236 adding 'deepspeed/nebula/config.py' 2024-04-15T21:38:36,237 adding 'deepspeed/nebula/constants.py' 2024-04-15T21:38:36,239 adding 'deepspeed/ops/__init__.py' 2024-04-15T21:38:36,241 adding 'deepspeed/ops/adagrad/__init__.py' 2024-04-15T21:38:36,242 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2024-04-15T21:38:36,244 adding 'deepspeed/ops/adam/__init__.py' 2024-04-15T21:38:36,246 adding 'deepspeed/ops/adam/cpu_adam.py' 2024-04-15T21:38:36,247 adding 'deepspeed/ops/adam/fused_adam.py' 2024-04-15T21:38:36,249 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2024-04-15T21:38:36,250 adding 'deepspeed/ops/aio/__init__.py' 2024-04-15T21:38:36,253 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2024-04-15T21:38:36,255 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2024-04-15T21:38:36,256 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2024-04-15T21:38:36,258 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2024-04-15T21:38:36,259 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2024-04-15T21:38:36,261 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2024-04-15T21:38:36,264 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2024-04-15T21:38:36,265 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2024-04-15T21:38:36,266 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2024-04-15T21:38:36,267 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2024-04-15T21:38:36,269 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2024-04-15T21:38:36,270 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2024-04-15T21:38:36,272 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2024-04-15T21:38:36,273 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2024-04-15T21:38:36,275 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2024-04-15T21:38:36,276 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2024-04-15T21:38:36,277 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2024-04-15T21:38:36,278 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2024-04-15T21:38:36,280 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2024-04-15T21:38:36,281 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2024-04-15T21:38:36,283 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2024-04-15T21:38:36,284 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2024-04-15T21:38:36,285 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2024-04-15T21:38:36,287 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2024-04-15T21:38:36,289 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2024-04-15T21:38:36,291 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2024-04-15T21:38:36,345 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2024-04-15T21:38:36,348 adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp' 2024-04-15T21:38:36,349 adding 'deepspeed/ops/csrc/cpu/comm/shm.h' 2024-04-15T21:38:36,351 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2024-04-15T21:38:36,354 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2024-04-15T21:38:36,356 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2024-04-15T21:38:36,358 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2024-04-15T21:38:36,360 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2024-04-15T21:38:36,369 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2024-04-15T21:38:36,374 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2024-04-15T21:38:36,377 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2024-04-15T21:38:36,380 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2024-04-15T21:38:36,383 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2024-04-15T21:38:36,385 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2024-04-15T21:38:36,387 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2024-04-15T21:38:36,389 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2024-04-15T21:38:36,393 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2024-04-15T21:38:36,396 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2024-04-15T21:38:36,398 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2024-04-15T21:38:36,400 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2024-04-15T21:38:36,408 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2024-04-15T21:38:36,412 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2024-04-15T21:38:36,414 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2024-04-15T21:38:36,419 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2024-04-15T21:38:36,423 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2024-04-15T21:38:36,427 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2024-04-15T21:38:36,429 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2024-04-15T21:38:36,432 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2024-04-15T21:38:36,434 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2024-04-15T21:38:36,436 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2024-04-15T21:38:36,439 adding 'deepspeed/ops/csrc/fp_quantizer/quantize.cpp' 2024-04-15T21:38:36,441 adding 'deepspeed/ops/csrc/fp_quantizer/quantize.cu' 2024-04-15T21:38:36,444 adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h' 2024-04-15T21:38:36,445 adding 'deepspeed/ops/csrc/fp_quantizer/includes/quantize.h' 2024-04-15T21:38:36,447 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2024-04-15T21:38:36,449 adding 'deepspeed/ops/csrc/includes/Timer.h' 2024-04-15T21:38:36,450 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2024-04-15T21:38:36,451 adding 'deepspeed/ops/csrc/includes/compat.h' 2024-04-15T21:38:36,453 adding 'deepspeed/ops/csrc/includes/context.h' 2024-04-15T21:38:36,455 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2024-04-15T21:38:36,457 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2024-04-15T21:38:36,459 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2024-04-15T21:38:36,461 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2024-04-15T21:38:36,463 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2024-04-15T21:38:36,464 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2024-04-15T21:38:36,466 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2024-04-15T21:38:36,468 adding 'deepspeed/ops/csrc/includes/dropout.h' 2024-04-15T21:38:36,469 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2024-04-15T21:38:36,471 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2024-04-15T21:38:36,473 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2024-04-15T21:38:36,475 adding 'deepspeed/ops/csrc/includes/gelu.h' 2024-04-15T21:38:36,514 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2024-04-15T21:38:36,515 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2024-04-15T21:38:36,520 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2024-04-15T21:38:36,523 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2024-04-15T21:38:36,525 adding 'deepspeed/ops/csrc/includes/quantization.h' 2024-04-15T21:38:36,530 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2024-04-15T21:38:36,532 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2024-04-15T21:38:36,536 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2024-04-15T21:38:36,538 adding 'deepspeed/ops/csrc/includes/simd.h' 2024-04-15T21:38:36,541 adding 'deepspeed/ops/csrc/includes/softmax.h' 2024-04-15T21:38:36,543 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2024-04-15T21:38:36,546 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2024-04-15T21:38:36,773 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2024-04-15T21:38:36,778 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2024-04-15T21:38:36,782 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2024-04-15T21:38:36,786 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2024-04-15T21:38:36,788 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2024-04-15T21:38:36,792 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2024-04-15T21:38:36,795 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2024-04-15T21:38:36,803 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2024-04-15T21:38:36,807 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2024-04-15T21:38:36,816 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2024-04-15T21:38:36,819 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2024-04-15T21:38:36,821 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2024-04-15T21:38:36,824 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2024-04-15T21:38:36,826 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2024-04-15T21:38:36,829 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2024-04-15T21:38:36,832 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2024-04-15T21:38:36,834 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2024-04-15T21:38:36,836 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2024-04-15T21:38:36,839 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2024-04-15T21:38:36,843 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2024-04-15T21:38:36,845 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2024-04-15T21:38:36,848 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2024-04-15T21:38:36,851 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2024-04-15T21:38:36,855 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2024-04-15T21:38:36,861 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2024-04-15T21:38:36,864 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2024-04-15T21:38:36,866 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2024-04-15T21:38:36,873 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2024-04-15T21:38:36,877 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2024-04-15T21:38:36,881 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2024-04-15T21:38:36,885 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2024-04-15T21:38:36,887 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2024-04-15T21:38:36,891 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2024-04-15T21:38:36,894 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2024-04-15T21:38:36,897 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2024-04-15T21:38:36,906 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2024-04-15T21:38:36,908 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2024-04-15T21:38:36,910 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2024-04-15T21:38:36,913 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2024-04-15T21:38:36,916 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2024-04-15T21:38:36,918 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2024-04-15T21:38:36,920 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2024-04-15T21:38:36,922 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2024-04-15T21:38:36,924 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2024-04-15T21:38:36,926 adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp' 2024-04-15T21:38:36,929 adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp' 2024-04-15T21:38:36,930 adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp' 2024-04-15T21:38:36,931 adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp' 2024-04-15T21:38:36,933 adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp' 2024-04-15T21:38:36,935 adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp' 2024-04-15T21:38:36,937 adding 'deepspeed/ops/csrc/xpu/includes/compat.h' 2024-04-15T21:38:36,938 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h' 2024-04-15T21:38:36,940 adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h' 2024-04-15T21:38:36,941 adding 'deepspeed/ops/csrc/xpu/includes/simd.h' 2024-04-15T21:38:36,943 adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h' 2024-04-15T21:38:36,945 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2024-04-15T21:38:36,946 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2024-04-15T21:38:36,948 adding 'deepspeed/ops/fp_quantizer/__init__.py' 2024-04-15T21:38:36,949 adding 'deepspeed/ops/fp_quantizer/quantize.py' 2024-04-15T21:38:36,950 adding 'deepspeed/ops/lamb/__init__.py' 2024-04-15T21:38:36,952 adding 'deepspeed/ops/lamb/fused_lamb.py' 2024-04-15T21:38:36,954 adding 'deepspeed/ops/lion/__init__.py' 2024-04-15T21:38:36,956 adding 'deepspeed/ops/lion/cpu_lion.py' 2024-04-15T21:38:36,957 adding 'deepspeed/ops/lion/fused_lion.py' 2024-04-15T21:38:36,958 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2024-04-15T21:38:36,961 adding 'deepspeed/ops/op_builder/__init__.py' 2024-04-15T21:38:36,962 adding 'deepspeed/ops/op_builder/all_ops.py' 2024-04-15T21:38:36,963 adding 'deepspeed/ops/op_builder/async_io.py' 2024-04-15T21:38:36,967 adding 'deepspeed/ops/op_builder/builder.py' 2024-04-15T21:38:36,968 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2024-04-15T21:38:36,969 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2024-04-15T21:38:36,970 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2024-04-15T21:38:36,972 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2024-04-15T21:38:36,973 adding 'deepspeed/ops/op_builder/fp_quantizer.py' 2024-04-15T21:38:36,974 adding 'deepspeed/ops/op_builder/fused_adam.py' 2024-04-15T21:38:36,975 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2024-04-15T21:38:36,977 adding 'deepspeed/ops/op_builder/fused_lion.py' 2024-04-15T21:38:36,978 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2024-04-15T21:38:36,979 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2024-04-15T21:38:36,981 adding 'deepspeed/ops/op_builder/quantizer.py' 2024-04-15T21:38:36,982 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2024-04-15T21:38:36,983 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2024-04-15T21:38:36,985 adding 'deepspeed/ops/op_builder/random_ltd.py' 2024-04-15T21:38:36,986 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2024-04-15T21:38:36,988 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2024-04-15T21:38:36,989 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2024-04-15T21:38:36,990 adding 'deepspeed/ops/op_builder/transformer.py' 2024-04-15T21:38:36,991 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2024-04-15T21:38:36,993 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2024-04-15T21:38:36,994 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2024-04-15T21:38:36,996 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2024-04-15T21:38:36,997 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2024-04-15T21:38:36,998 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2024-04-15T21:38:36,999 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2024-04-15T21:38:37,001 adding 'deepspeed/ops/op_builder/hpu/__init__.py' 2024-04-15T21:38:37,002 adding 'deepspeed/ops/op_builder/hpu/builder.py' 2024-04-15T21:38:37,004 adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py' 2024-04-15T21:38:37,005 adding 'deepspeed/ops/op_builder/hpu/fused_adam.py' 2024-04-15T21:38:37,006 adding 'deepspeed/ops/op_builder/hpu/no_impl.py' 2024-04-15T21:38:37,008 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2024-04-15T21:38:37,009 adding 'deepspeed/ops/op_builder/npu/async_io.py' 2024-04-15T21:38:37,011 adding 'deepspeed/ops/op_builder/npu/builder.py' 2024-04-15T21:38:37,012 adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py' 2024-04-15T21:38:37,013 adding 'deepspeed/ops/op_builder/npu/cpu_adam.py' 2024-04-15T21:38:37,015 adding 'deepspeed/ops/op_builder/npu/cpu_lion.py' 2024-04-15T21:38:37,016 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2024-04-15T21:38:37,018 adding 'deepspeed/ops/op_builder/npu/inference.py' 2024-04-15T21:38:37,019 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2024-04-15T21:38:37,020 adding 'deepspeed/ops/op_builder/xpu/__init__.py' 2024-04-15T21:38:37,022 adding 'deepspeed/ops/op_builder/xpu/async_io.py' 2024-04-15T21:38:37,023 adding 'deepspeed/ops/op_builder/xpu/builder.py' 2024-04-15T21:38:37,024 adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py' 2024-04-15T21:38:37,025 adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py' 2024-04-15T21:38:37,026 adding 'deepspeed/ops/op_builder/xpu/fused_adam.py' 2024-04-15T21:38:37,028 adding 'deepspeed/ops/quantizer/__init__.py' 2024-04-15T21:38:37,029 adding 'deepspeed/ops/quantizer/quantizer.py' 2024-04-15T21:38:37,031 adding 'deepspeed/ops/random_ltd/__init__.py' 2024-04-15T21:38:37,033 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2024-04-15T21:38:37,034 adding 'deepspeed/ops/sparse_attention/__init__.py' 2024-04-15T21:38:37,036 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2024-04-15T21:38:37,040 adding 'deepspeed/ops/sparse_attention/matmul.py' 2024-04-15T21:38:37,042 adding 'deepspeed/ops/sparse_attention/softmax.py' 2024-04-15T21:38:37,043 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2024-04-15T21:38:37,045 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2024-04-15T21:38:37,049 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2024-04-15T21:38:37,051 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2024-04-15T21:38:37,053 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2024-04-15T21:38:37,054 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2024-04-15T21:38:37,056 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2024-04-15T21:38:37,057 adding 'deepspeed/ops/transformer/__init__.py' 2024-04-15T21:38:37,060 adding 'deepspeed/ops/transformer/transformer.py' 2024-04-15T21:38:37,062 adding 'deepspeed/ops/transformer/inference/__init__.py' 2024-04-15T21:38:37,063 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2024-04-15T21:38:37,065 adding 'deepspeed/ops/transformer/inference/config.py' 2024-04-15T21:38:37,066 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2024-04-15T21:38:37,067 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2024-04-15T21:38:37,069 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2024-04-15T21:38:37,071 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2024-04-15T21:38:37,073 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2024-04-15T21:38:37,075 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2024-04-15T21:38:37,077 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2024-04-15T21:38:37,078 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2024-04-15T21:38:37,080 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2024-04-15T21:38:37,081 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2024-04-15T21:38:37,082 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2024-04-15T21:38:37,084 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2024-04-15T21:38:37,086 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2024-04-15T21:38:37,087 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2024-04-15T21:38:37,088 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2024-04-15T21:38:37,090 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2024-04-15T21:38:37,091 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2024-04-15T21:38:37,093 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2024-04-15T21:38:37,096 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2024-04-15T21:38:37,097 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2024-04-15T21:38:37,099 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2024-04-15T21:38:37,101 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2024-04-15T21:38:37,102 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2024-04-15T21:38:37,104 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2024-04-15T21:38:37,105 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2024-04-15T21:38:37,106 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2024-04-15T21:38:37,108 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2024-04-15T21:38:37,110 adding 'deepspeed/pipe/__init__.py' 2024-04-15T21:38:37,112 adding 'deepspeed/profiling/__init__.py' 2024-04-15T21:38:37,113 adding 'deepspeed/profiling/config.py' 2024-04-15T21:38:37,114 adding 'deepspeed/profiling/constants.py' 2024-04-15T21:38:37,116 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2024-04-15T21:38:37,121 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2024-04-15T21:38:37,124 adding 'deepspeed/runtime/__init__.py' 2024-04-15T21:38:37,125 adding 'deepspeed/runtime/base_optimizer.py' 2024-04-15T21:38:37,128 adding 'deepspeed/runtime/bf16_optimizer.py' 2024-04-15T21:38:37,130 adding 'deepspeed/runtime/compiler.py' 2024-04-15T21:38:37,134 adding 'deepspeed/runtime/config.py' 2024-04-15T21:38:37,136 adding 'deepspeed/runtime/config_utils.py' 2024-04-15T21:38:37,138 adding 'deepspeed/runtime/constants.py' 2024-04-15T21:38:37,140 adding 'deepspeed/runtime/dataloader.py' 2024-04-15T21:38:37,141 adding 'deepspeed/runtime/eigenvalue.py' 2024-04-15T21:38:37,159 adding 'deepspeed/runtime/engine.py' 2024-04-15T21:38:37,163 adding 'deepspeed/runtime/hybrid_engine.py' 2024-04-15T21:38:37,167 adding 'deepspeed/runtime/lr_schedules.py' 2024-04-15T21:38:37,168 adding 'deepspeed/runtime/progressive_layer_drop.py' 2024-04-15T21:38:37,170 adding 'deepspeed/runtime/quantize.py' 2024-04-15T21:38:37,171 adding 'deepspeed/runtime/sparse_tensor.py' 2024-04-15T21:38:37,173 adding 'deepspeed/runtime/state_dict_factory.py' 2024-04-15T21:38:37,178 adding 'deepspeed/runtime/utils.py' 2024-04-15T21:38:37,180 adding 'deepspeed/runtime/weight_quantizer.py' 2024-04-15T21:38:37,182 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2024-04-15T21:38:37,188 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2024-04-15T21:38:37,190 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2024-04-15T21:38:37,192 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2024-04-15T21:38:37,193 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2024-04-15T21:38:37,194 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2024-04-15T21:38:37,196 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2024-04-15T21:38:37,197 adding 'deepspeed/runtime/comm/__init__.py' 2024-04-15T21:38:37,199 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2024-04-15T21:38:37,200 adding 'deepspeed/runtime/comm/hccl.py' 2024-04-15T21:38:37,202 adding 'deepspeed/runtime/comm/mpi.py' 2024-04-15T21:38:37,204 adding 'deepspeed/runtime/comm/nccl.py' 2024-04-15T21:38:37,206 adding 'deepspeed/runtime/compression/__init__.py' 2024-04-15T21:38:37,207 adding 'deepspeed/runtime/compression/cupy.py' 2024-04-15T21:38:37,209 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2024-04-15T21:38:37,211 adding 'deepspeed/runtime/data_pipeline/config.py' 2024-04-15T21:38:37,213 adding 'deepspeed/runtime/data_pipeline/constants.py' 2024-04-15T21:38:37,215 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2024-04-15T21:38:37,217 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2024-04-15T21:38:37,218 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2024-04-15T21:38:37,220 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2024-04-15T21:38:37,221 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2024-04-15T21:38:37,223 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2024-04-15T21:38:37,225 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2024-04-15T21:38:37,229 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2024-04-15T21:38:37,232 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2024-04-15T21:38:37,234 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2024-04-15T21:38:37,236 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2024-04-15T21:38:37,238 adding 'deepspeed/runtime/fp16/__init__.py' 2024-04-15T21:38:37,240 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2024-04-15T21:38:37,242 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2024-04-15T21:38:37,244 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2024-04-15T21:38:37,246 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2024-04-15T21:38:37,248 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2024-04-15T21:38:37,251 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2024-04-15T21:38:37,254 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2024-04-15T21:38:37,255 adding 'deepspeed/runtime/pipe/__init__.py' 2024-04-15T21:38:37,262 adding 'deepspeed/runtime/pipe/engine.py' 2024-04-15T21:38:37,266 adding 'deepspeed/runtime/pipe/module.py' 2024-04-15T21:38:37,271 adding 'deepspeed/runtime/pipe/p2p.py' 2024-04-15T21:38:37,273 adding 'deepspeed/runtime/pipe/schedule.py' 2024-04-15T21:38:37,275 adding 'deepspeed/runtime/pipe/topology.py' 2024-04-15T21:38:37,277 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2024-04-15T21:38:37,278 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2024-04-15T21:38:37,280 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2024-04-15T21:38:37,281 adding 'deepspeed/runtime/swap_tensor/constants.py' 2024-04-15T21:38:37,284 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2024-04-15T21:38:37,285 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2024-04-15T21:38:37,288 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2024-04-15T21:38:37,290 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2024-04-15T21:38:37,292 adding 'deepspeed/runtime/swap_tensor/utils.py' 2024-04-15T21:38:37,294 adding 'deepspeed/runtime/zero/__init__.py' 2024-04-15T21:38:37,297 adding 'deepspeed/runtime/zero/config.py' 2024-04-15T21:38:37,512 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2024-04-15T21:38:37,514 adding 'deepspeed/runtime/zero/linear.py' 2024-04-15T21:38:37,516 adding 'deepspeed/runtime/zero/mics.py' 2024-04-15T21:38:37,518 adding 'deepspeed/runtime/zero/mics_utils.py' 2024-04-15T21:38:37,520 adding 'deepspeed/runtime/zero/offload_config.py' 2024-04-15T21:38:37,523 adding 'deepspeed/runtime/zero/parameter_offload.py' 2024-04-15T21:38:37,534 adding 'deepspeed/runtime/zero/partition_parameters.py' 2024-04-15T21:38:37,538 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2024-04-15T21:38:37,539 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2024-04-15T21:38:37,554 adding 'deepspeed/runtime/zero/stage3.py' 2024-04-15T21:38:37,567 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2024-04-15T21:38:37,569 adding 'deepspeed/runtime/zero/test.py' 2024-04-15T21:38:37,571 adding 'deepspeed/runtime/zero/tiling.py' 2024-04-15T21:38:37,573 adding 'deepspeed/runtime/zero/utils.py' 2024-04-15T21:38:37,575 adding 'deepspeed/sequence/__init__.py' 2024-04-15T21:38:37,576 adding 'deepspeed/sequence/layer.py' 2024-04-15T21:38:37,578 adding 'deepspeed/utils/__init__.py' 2024-04-15T21:38:37,580 adding 'deepspeed/utils/bwc.py' 2024-04-15T21:38:37,581 adding 'deepspeed/utils/comms_logging.py' 2024-04-15T21:38:37,583 adding 'deepspeed/utils/debug.py' 2024-04-15T21:38:37,584 adding 'deepspeed/utils/exceptions.py' 2024-04-15T21:38:37,587 adding 'deepspeed/utils/groups.py' 2024-04-15T21:38:37,588 adding 'deepspeed/utils/init_on_device.py' 2024-04-15T21:38:37,590 adding 'deepspeed/utils/logging.py' 2024-04-15T21:38:37,591 adding 'deepspeed/utils/mixed_precision_linkage.py' 2024-04-15T21:38:37,593 adding 'deepspeed/utils/numa.py' 2024-04-15T21:38:37,594 adding 'deepspeed/utils/nvtx.py' 2024-04-15T21:38:37,596 adding 'deepspeed/utils/tensor_fragment.py' 2024-04-15T21:38:37,598 adding 'deepspeed/utils/timer.py' 2024-04-15T21:38:37,599 adding 'deepspeed/utils/torch.py' 2024-04-15T21:38:37,600 adding 'deepspeed/utils/types.py' 2024-04-15T21:38:37,602 adding 'deepspeed/utils/z3_leaf_module.py' 2024-04-15T21:38:37,605 adding 'deepspeed/utils/zero_to_fp32.py' 2024-04-15T21:38:37,608 adding 'deepspeed-0.14.1.data/scripts/deepspeed' 2024-04-15T21:38:37,609 adding 'deepspeed-0.14.1.data/scripts/deepspeed.pt' 2024-04-15T21:38:37,610 adding 'deepspeed-0.14.1.data/scripts/ds' 2024-04-15T21:38:37,612 adding 'deepspeed-0.14.1.data/scripts/ds_bench' 2024-04-15T21:38:37,613 adding 'deepspeed-0.14.1.data/scripts/ds_elastic' 2024-04-15T21:38:37,615 adding 'deepspeed-0.14.1.data/scripts/ds_report' 2024-04-15T21:38:37,616 adding 'deepspeed-0.14.1.data/scripts/ds_ssh' 2024-04-15T21:38:37,618 adding 'deepspeed-0.14.1.data/scripts/dsr' 2024-04-15T21:38:37,626 adding 'deepspeed-0.14.1.dist-info/METADATA' 2024-04-15T21:38:37,628 adding 'deepspeed-0.14.1.dist-info/WHEEL' 2024-04-15T21:38:37,629 adding 'deepspeed-0.14.1.dist-info/entry_points.txt' 2024-04-15T21:38:37,631 adding 'deepspeed-0.14.1.dist-info/top_level.txt' 2024-04-15T21:38:37,651 adding 'deepspeed-0.14.1.dist-info/RECORD' 2024-04-15T21:38:37,708 removing build/bdist.linux-armv7l/wheel 2024-04-15T21:38:37,922 deepspeed build time = 13.459374904632568 secs 2024-04-15T21:38:38,045 Building wheel for deepspeed (setup.py): finished with status 'done' 2024-04-15T21:38:38,062 Created wheel for deepspeed: filename=deepspeed-0.14.1-py3-none-any.whl size=1421767 sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b 2024-04-15T21:38:38,063 Stored in directory: /tmp/pip-ephem-wheel-cache-c05tsjyy/wheels/de/06/2a/dd493bf723d4accb1a8d1c53177eb057ecc10b0ae0f135db44 2024-04-15T21:38:38,109 Successfully built deepspeed 2024-04-15T21:38:38,229 Removed build tracker: '/tmp/pip-build-tracker-nayqkish'