2024-02-24T00:01:15,266 Created temporary directory: /tmp/pip-build-tracker-dkleobj2
2024-02-24T00:01:15,267 Initialized build tracking at /tmp/pip-build-tracker-dkleobj2
2024-02-24T00:01:15,268 Created build tracker: /tmp/pip-build-tracker-dkleobj2
2024-02-24T00:01:15,268 Entered build tracker: /tmp/pip-build-tracker-dkleobj2
2024-02-24T00:01:15,270 Created temporary directory: /tmp/pip-wheel-m5x2mg5r
2024-02-24T00:01:15,273 Created temporary directory: /tmp/pip-ephem-wheel-cache-xqm968ux
2024-02-24T00:01:15,299 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-02-24T00:01:15,302 2 location(s) to search for versions of deepspeed:
2024-02-24T00:01:15,302 * https://pypi.org/simple/deepspeed/
2024-02-24T00:01:15,302 * https://www.piwheels.org/simple/deepspeed/
2024-02-24T00:01:15,303 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-02-24T00:01:15,304 Getting page https://pypi.org/simple/deepspeed/
2024-02-24T00:01:15,305 Found index url https://pypi.org/simple/
2024-02-24T00:01:15,521 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-02-24T00:01:15,536   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-24T00:01:15,537   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-02-24T00:01:15,538   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-24T00:01:15,539   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-02-24T00:01:15,540   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-24T00:01:15,541   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-02-24T00:01:15,541   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-24T00:01:15,542   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-02-24T00:01:15,543   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-24T00:01:15,544   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-02-24T00:01:15,544   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-02-24T00:01:15,545   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-02-24T00:01:15,546   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-02-24T00:01:15,547   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-02-24T00:01:15,548   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-02-24T00:01:15,549   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-02-24T00:01:15,549   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-02-24T00:01:15,550   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-02-24T00:01:15,551   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-02-24T00:01:15,552   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-02-24T00:01:15,552   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-02-24T00:01:15,553   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-02-24T00:01:15,554   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-02-24T00:01:15,555   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-02-24T00:01:15,555   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-02-24T00:01:15,556   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-02-24T00:01:15,557   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-02-24T00:01:15,558   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-02-24T00:01:15,558   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-02-24T00:01:15,559   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-02-24T00:01:15,560   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-02-24T00:01:15,561   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-02-24T00:01:15,562   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-02-24T00:01:15,562   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-02-24T00:01:15,563   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-02-24T00:01:15,564   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-02-24T00:01:15,564   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-02-24T00:01:15,565   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-02-24T00:01:15,566   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-02-24T00:01:15,567   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-02-24T00:01:15,567   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-02-24T00:01:15,568   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-02-24T00:01:15,569   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-02-24T00:01:15,570   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-02-24T00:01:15,571   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-02-24T00:01:15,571   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-02-24T00:01:15,573   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-02-24T00:01:15,574   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-02-24T00:01:15,575   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-02-24T00:01:15,576   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-02-24T00:01:15,577   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-02-24T00:01:15,578   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-02-24T00:01:15,579   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-02-24T00:01:15,581   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-02-24T00:01:15,582   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-02-24T00:01:15,582   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-02-24T00:01:15,583   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-02-24T00:01:15,584   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-02-24T00:01:15,585   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-02-24T00:01:15,586   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-02-24T00:01:15,587   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-02-24T00:01:15,588   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-02-24T00:01:15,589   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-02-24T00:01:15,590   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-02-24T00:01:15,592   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-02-24T00:01:15,593   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-02-24T00:01:15,594   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-02-24T00:01:15,595   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-02-24T00:01:15,597   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-02-24T00:01:15,597   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-02-24T00:01:15,598   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-02-24T00:01:15,599   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-02-24T00:01:15,600   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-02-24T00:01:15,601   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-02-24T00:01:15,601   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-02-24T00:01:15,602   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-02-24T00:01:15,603   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-02-24T00:01:15,604   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-02-24T00:01:15,605   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-02-24T00:01:15,606   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-02-24T00:01:15,607   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-02-24T00:01:15,608   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-02-24T00:01:15,608   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-02-24T00:01:15,609   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-02-24T00:01:15,610   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-02-24T00:01:15,611   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-02-24T00:01:15,612   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-02-24T00:01:15,613   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-02-24T00:01:15,614   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-02-24T00:01:15,614 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-02-24T00:01:15,615 Getting page https://www.piwheels.org/simple/deepspeed/
2024-02-24T00:01:15,621 Found index url https://www.piwheels.org/simple/
2024-02-24T00:01:29,223 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-02-24T00:01:29,260   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,261   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,262   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,263   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,264   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,265   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,266   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,268   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,269   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,270   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,271   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,272   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,273   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,273   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,274   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,275   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,276   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,276   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,277   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,278   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,279   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,280   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,281   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,282   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,282   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,283   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,284   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,285   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,286   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,286   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,287   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,288   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,289   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,289   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,290   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,291   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,292   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,292   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,293   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,294   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,294   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,295   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,296   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,297   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,298   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,298   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,299   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,300   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,301   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,301   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,302   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,303   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,304   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,304   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,305   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,306   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,307   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,308   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-02-24T00:01:29,309 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-02-24T00:01:29,309 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-02-24T00:01:29,351 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-02-24T00:01:29,375 Collecting deepspeed==0.13.3
2024-02-24T00:01:29,378   Created temporary directory: /tmp/pip-unpack-l28qsibw
2024-02-24T00:01:29,624   Downloading deepspeed-0.13.3.tar.gz (1.3 MB)
2024-02-24T00:01:35,573   Added deepspeed==0.13.3 from https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz to build tracker '/tmp/pip-build-tracker-dkleobj2'
2024-02-24T00:01:35,577   Running setup.py (path:/tmp/pip-wheel-m5x2mg5r/deepspeed_d69a65439c8d435d9da649b430200431/setup.py) egg_info for package deepspeed
2024-02-24T00:01:35,578   Created temporary directory: /tmp/pip-pip-egg-info-v1etb3nz
2024-02-24T00:01:35,579   Preparing metadata (setup.py): started
2024-02-24T00:01:35,580   Running command python setup.py egg_info
2024-02-24T00:01:37,613   fatal: not a git repository (or any of the parent directories): .git
2024-02-24T00:01:38,482   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-02-24T00:01:38,483    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-02-24T00:01:38,484   DS_BUILD_OPS=0
2024-02-24T00:01:38,485    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-02-24T00:01:38,485    [WARNING]  async_io: please install the libaio-dev package with apt
2024-02-24T00:01:38,486    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-02-24T00:01:38,487    [WARNING]  Please install torch if trying to pre-compile kernels
2024-02-24T00:01:38,487    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:38,488    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:38,489    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:38,489    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:38,490    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:38,490    [WARNING]  unable to import torch, please install it first
2024-02-24T00:01:38,491    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:38,499   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-02-24T00:01:38,499   version=0.13.3, git_hash=unknown, git_branch=unknown
2024-02-24T00:01:38,500   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-02-24T00:01:38,501   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False}
2024-02-24T00:01:38,501   ext_modules=[]
2024-02-24T00:01:38,502   running egg_info
2024-02-24T00:01:38,502   creating /tmp/pip-pip-egg-info-v1etb3nz/deepspeed.egg-info
2024-02-24T00:01:38,519   writing /tmp/pip-pip-egg-info-v1etb3nz/deepspeed.egg-info/PKG-INFO
2024-02-24T00:01:38,552   writing dependency_links to /tmp/pip-pip-egg-info-v1etb3nz/deepspeed.egg-info/dependency_links.txt
2024-02-24T00:01:38,554   writing entry points to /tmp/pip-pip-egg-info-v1etb3nz/deepspeed.egg-info/entry_points.txt
2024-02-24T00:01:38,570   writing requirements to /tmp/pip-pip-egg-info-v1etb3nz/deepspeed.egg-info/requires.txt
2024-02-24T00:01:38,572   writing top-level names to /tmp/pip-pip-egg-info-v1etb3nz/deepspeed.egg-info/top_level.txt
2024-02-24T00:01:38,573   writing manifest file '/tmp/pip-pip-egg-info-v1etb3nz/deepspeed.egg-info/SOURCES.txt'
2024-02-24T00:01:38,805   reading manifest file '/tmp/pip-pip-egg-info-v1etb3nz/deepspeed.egg-info/SOURCES.txt'
2024-02-24T00:01:38,807   reading manifest template 'MANIFEST.in'
2024-02-24T00:01:38,810   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-02-24T00:01:38,810   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-02-24T00:01:49,492   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-02-24T00:01:51,168   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-02-24T00:01:52,037   warning: no files found matching '*.tr' under directory 'csrc'
2024-02-24T00:01:52,181   warning: no files found matching '*.cc' under directory 'csrc'
2024-02-24T00:01:52,229   warning: no files found matching '*.py' under directory 'benchmarks'
2024-02-24T00:01:52,273   writing manifest file '/tmp/pip-pip-egg-info-v1etb3nz/deepspeed.egg-info/SOURCES.txt'
2024-02-24T00:01:52,275   deepspeed build time = 14.648748636245728 secs
2024-02-24T00:01:52,389   Preparing metadata (setup.py): finished with status 'done'
2024-02-24T00:01:52,395   Source in /tmp/pip-wheel-m5x2mg5r/deepspeed_d69a65439c8d435d9da649b430200431 has version 0.13.3, which satisfies requirement deepspeed==0.13.3 from https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz
2024-02-24T00:01:52,397   Removed deepspeed==0.13.3 from https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz from build tracker '/tmp/pip-build-tracker-dkleobj2'
2024-02-24T00:01:52,405 Created temporary directory: /tmp/pip-unpack-15gd7zz0
2024-02-24T00:01:52,407 Created temporary directory: /tmp/pip-unpack-hcj_b_rj
2024-02-24T00:01:52,681 Building wheels for collected packages: deepspeed
2024-02-24T00:01:52,687   Created temporary directory: /tmp/pip-wheel-ynk33sb7
2024-02-24T00:01:52,688   Building wheel for deepspeed (setup.py): started
2024-02-24T00:01:52,690   Destination directory: /tmp/pip-wheel-ynk33sb7
2024-02-24T00:01:52,691   Running command python setup.py bdist_wheel
2024-02-24T00:01:53,131   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-02-24T00:01:53,139    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-02-24T00:01:53,224   DS_BUILD_OPS=0
2024-02-24T00:01:53,341    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-02-24T00:01:53,400    [WARNING]  async_io: please install the libaio-dev package with apt
2024-02-24T00:01:53,400    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-02-24T00:01:53,401    [WARNING]  Please install torch if trying to pre-compile kernels
2024-02-24T00:01:53,401    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:53,402    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:53,402    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:53,403    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:53,403    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:53,404    [WARNING]  unable to import torch, please install it first
2024-02-24T00:01:53,404    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-24T00:01:53,405   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-02-24T00:01:53,414   fatal: not a git repository (or any of the parent directories): .git
2024-02-24T00:01:53,416   version=0.13.3, git_hash=unknown, git_branch=unknown
2024-02-24T00:01:53,417   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-02-24T00:01:53,417   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False}
2024-02-24T00:01:53,418   ext_modules=[]
2024-02-24T00:01:54,077   running bdist_wheel
2024-02-24T00:01:54,179   running build
2024-02-24T00:01:54,180   running build_py
2024-02-24T00:01:54,207   creating build
2024-02-24T00:01:54,208   creating build/lib
2024-02-24T00:01:54,209   creating build/lib/deepspeed
2024-02-24T00:01:54,211   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-02-24T00:01:54,213   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2024-02-24T00:01:54,215   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-02-24T00:01:54,218   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-02-24T00:01:54,221   copying deepspeed/constants.py -> build/lib/deepspeed
2024-02-24T00:01:54,223   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-02-24T00:01:54,226   creating build/lib/deepspeed/module_inject
2024-02-24T00:01:54,227   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,229   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,232   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,234   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,236   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,239   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,241   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,244   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,247   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,249   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,250   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,253   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,255   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-02-24T00:01:54,259   creating build/lib/deepspeed/pipe
2024-02-24T00:01:54,260   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-02-24T00:01:54,263   creating build/lib/deepspeed/elasticity
2024-02-24T00:01:54,264   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-02-24T00:01:54,268   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-02-24T00:01:54,271   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-02-24T00:01:54,273   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-02-24T00:01:54,276   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-02-24T00:01:54,278   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-02-24T00:01:54,282   creating build/lib/deepspeed/runtime
2024-02-24T00:01:54,283   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,287   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,289   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,293   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,296   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,297   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,301   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,304   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,307   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,310   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,312   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,317   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,319   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,322   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,327   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,331   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,334   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-02-24T00:01:54,337   creating build/lib/deepspeed/model_implementations
2024-02-24T00:01:54,337   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-02-24T00:01:54,340   creating build/lib/deepspeed/nebula
2024-02-24T00:01:54,341   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-02-24T00:01:54,344   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-02-24T00:01:54,348   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-02-24T00:01:54,352   creating build/lib/deepspeed/accelerator
2024-02-24T00:01:54,353   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-24T00:01:54,356   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-24T00:01:54,359   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-24T00:01:54,362   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-02-24T00:01:54,364   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-24T00:01:54,366   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-24T00:01:54,369   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-24T00:01:54,371   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-24T00:01:54,373   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-24T00:01:54,376   creating build/lib/deepspeed/profiling
2024-02-24T00:01:54,377   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-02-24T00:01:54,380   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-02-24T00:01:54,382   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-02-24T00:01:54,384   creating build/lib/deepspeed/monitor
2024-02-24T00:01:54,385   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-02-24T00:01:54,387   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-02-24T00:01:54,390   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-02-24T00:01:54,392   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-02-24T00:01:54,394   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-02-24T00:01:54,395   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-02-24T00:01:54,398   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-02-24T00:01:54,401   creating build/lib/deepspeed/compression
2024-02-24T00:01:54,402   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-02-24T00:01:54,404   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-02-24T00:01:54,407   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-02-24T00:01:54,410   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-02-24T00:01:54,413   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-02-24T00:01:54,415   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-02-24T00:01:54,418   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-02-24T00:01:54,420   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-02-24T00:01:54,423   creating build/lib/deepspeed/ops
2024-02-24T00:01:54,424   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-02-24T00:01:54,427   creating build/lib/deepspeed/autotuning
2024-02-24T00:01:54,428   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-02-24T00:01:54,432   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-02-24T00:01:54,435   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-02-24T00:01:54,438   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-02-24T00:01:54,440   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-02-24T00:01:54,442   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-02-24T00:01:54,445   creating build/lib/deepspeed/launcher
2024-02-24T00:01:54,446   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-02-24T00:01:54,448   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-02-24T00:01:54,451   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-02-24T00:01:54,453   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-02-24T00:01:54,454   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-02-24T00:01:54,457   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-02-24T00:01:54,460   creating build/lib/deepspeed/comm
2024-02-24T00:01:54,460   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-02-24T00:01:54,463   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-02-24T00:01:54,465   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-02-24T00:01:54,466   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-02-24T00:01:54,468   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-02-24T00:01:54,470   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-02-24T00:01:54,473   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-02-24T00:01:54,474   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-02-24T00:01:54,476   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-02-24T00:01:54,479   creating build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,480   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,482   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,484   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,486   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,488   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,491   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,501   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,503   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,505   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,507   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-02-24T00:01:54,510   creating build/lib/deepspeed/inference
2024-02-24T00:01:54,511   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-02-24T00:01:54,513   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-02-24T00:01:54,515   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-02-24T00:01:54,518   creating build/lib/deepspeed/moe
2024-02-24T00:01:54,519   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-02-24T00:01:54,522   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-02-24T00:01:54,525   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-02-24T00:01:54,527   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-02-24T00:01:54,530   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-02-24T00:01:54,532   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-02-24T00:01:54,535   creating build/lib/deepspeed/sequence
2024-02-24T00:01:54,536   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-02-24T00:01:54,538   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-02-24T00:01:54,541   creating build/lib/deepspeed/utils
2024-02-24T00:01:54,542   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,544   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,547   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,550   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,553   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,555   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,557   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,560   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,562   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,565   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,566   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,568   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,570   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,573   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,574   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-02-24T00:01:54,578   creating build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,579   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,581   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,583   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,586   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,588   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,590   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,592   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,594   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,597   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,598   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,601   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,604   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,606   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,609   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,611   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,613   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,615   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,618   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,620   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-02-24T00:01:54,623   creating build/lib/deepspeed/module_inject/containers/features
2024-02-24T00:01:54,624   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-24T00:01:54,627   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-24T00:01:54,630   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-24T00:01:54,632   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-24T00:01:54,634   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-24T00:01:54,636   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-24T00:01:54,639   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-24T00:01:54,641   creating build/lib/deepspeed/runtime/pipe
2024-02-24T00:01:54,642   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-02-24T00:01:54,645   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-02-24T00:01:54,647   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-02-24T00:01:54,651   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-02-24T00:01:54,652   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-02-24T00:01:54,655   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-02-24T00:01:54,659   creating build/lib/deepspeed/runtime/data_pipeline
2024-02-24T00:01:54,661   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-24T00:01:54,664   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-24T00:01:54,667   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-24T00:01:54,669   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-24T00:01:54,671   creating build/lib/deepspeed/runtime/compression
2024-02-24T00:01:54,672   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-02-24T00:01:54,675   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-02-24T00:01:54,677   creating build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,678   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,681   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,684   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,686   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,688   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,693   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,696   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,698   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,703   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,706   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,709   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,711   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,714   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,717   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,719   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,722   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-02-24T00:01:54,727   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-02-24T00:01:54,728   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-02-24T00:01:54,730   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-02-24T00:01:54,734   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-02-24T00:01:54,736   creating build/lib/deepspeed/runtime/comm
2024-02-24T00:01:54,737   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-02-24T00:01:54,739   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-02-24T00:01:54,742   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-02-24T00:01:54,745   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-02-24T00:01:54,747   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-02-24T00:01:54,750   creating build/lib/deepspeed/runtime/swap_tensor
2024-02-24T00:01:54,751   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-24T00:01:54,754   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-24T00:01:54,757   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-24T00:01:54,759   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-24T00:01:54,761   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-24T00:01:54,764   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-24T00:01:54,766   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-24T00:01:54,768   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-24T00:01:54,770   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-24T00:01:54,773   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-02-24T00:01:54,774   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-24T00:01:54,776   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-24T00:01:54,780   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-24T00:01:54,782   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-24T00:01:54,785   creating build/lib/deepspeed/runtime/fp16
2024-02-24T00:01:54,786   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-02-24T00:01:54,789   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-02-24T00:01:54,792   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-02-24T00:01:54,795   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-02-24T00:01:54,798   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:01:54,800   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:01:54,803   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:01:54,805   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:01:54,808   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:01:54,810   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:01:54,813   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:01:54,815   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:01:54,819   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:01:54,823   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:01:54,827   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:01:54,831   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:01:54,835   creating build/lib/deepspeed/runtime/fp16/onebit
2024-02-24T00:01:54,837   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-24T00:01:54,842   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-24T00:01:54,845   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-24T00:01:54,849   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-24T00:01:54,854   creating build/lib/deepspeed/model_implementations/diffusers
2024-02-24T00:01:54,855   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-02-24T00:01:54,858   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-02-24T00:01:54,862   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-02-24T00:01:54,865   creating build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,867   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,870   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,873   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,875   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,879   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,882   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,885   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,888   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,891   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,893   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-24T00:01:54,896   creating build/lib/deepspeed/model_implementations/features
2024-02-24T00:01:54,898   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-02-24T00:01:54,901   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-02-24T00:01:54,905   creating build/lib/deepspeed/profiling/flops_profiler
2024-02-24T00:01:54,907   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-02-24T00:01:54,912   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-02-24T00:01:54,916   creating build/lib/deepspeed/ops/deepspeed4science
2024-02-24T00:01:54,917   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-02-24T00:01:54,921   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-02-24T00:01:54,925   creating build/lib/deepspeed/ops/aio
2024-02-24T00:01:54,926   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-02-24T00:01:54,929   creating build/lib/deepspeed/ops/adagrad
2024-02-24T00:01:54,930   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-02-24T00:01:54,932   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-02-24T00:01:54,935   creating build/lib/deepspeed/ops/sparse_attention
2024-02-24T00:01:54,936   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-24T00:01:54,938   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-24T00:01:54,941   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-24T00:01:54,944   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-24T00:01:54,947   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-24T00:01:54,949   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-24T00:01:54,951   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-24T00:01:54,956   creating build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,957   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,959   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,962   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,963   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,965   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,967   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,970   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,972   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,974   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,977   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,979   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,981   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,983   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,985   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,987   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,990   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,991   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,993   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,995   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,997   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:54,999   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:55,001   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-02-24T00:01:55,003   creating build/lib/deepspeed/ops/transformer
2024-02-24T00:01:55,005   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-02-24T00:01:55,008   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-02-24T00:01:55,010   creating build/lib/deepspeed/ops/adam
2024-02-24T00:01:55,011   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-02-24T00:01:55,013   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-02-24T00:01:55,015   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-02-24T00:01:55,017   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-02-24T00:01:55,019   creating build/lib/deepspeed/ops/quantizer
2024-02-24T00:01:55,020   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-02-24T00:01:55,023   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-02-24T00:01:55,025   creating build/lib/deepspeed/ops/random_ltd
2024-02-24T00:01:55,026   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-02-24T00:01:55,028   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-02-24T00:01:55,030   creating build/lib/deepspeed/ops/lamb
2024-02-24T00:01:55,031   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-02-24T00:01:55,033   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-02-24T00:01:55,036   creating build/lib/deepspeed/ops/lion
2024-02-24T00:01:55,037   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-02-24T00:01:55,039   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-02-24T00:01:55,041   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-02-24T00:01:55,043   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-02-24T00:01:55,046   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-24T00:01:55,047   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-24T00:01:55,049   creating build/lib/deepspeed/ops/op_builder/xpu
2024-02-24T00:01:55,050   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-24T00:01:55,052   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-24T00:01:55,055   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-24T00:01:55,057   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-24T00:01:55,059   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-24T00:01:55,061   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-24T00:01:55,063   creating build/lib/deepspeed/ops/op_builder/cpu
2024-02-24T00:01:55,064   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-24T00:01:55,066   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-24T00:01:55,069   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-24T00:01:55,071   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-24T00:01:55,072   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-24T00:01:55,074   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-24T00:01:55,077   creating build/lib/deepspeed/ops/op_builder/npu
2024-02-24T00:01:55,079   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-24T00:01:55,081   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-24T00:01:55,084   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-24T00:01:55,087   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-24T00:01:55,089   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-24T00:01:55,091   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-24T00:01:55,093   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-24T00:01:55,095   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-24T00:01:55,097   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-24T00:01:55,099   creating build/lib/deepspeed/ops/op_builder/hpu
2024-02-24T00:01:55,100   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-24T00:01:55,102   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-24T00:01:55,105   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-24T00:01:55,107   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-24T00:01:55,109   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-24T00:01:55,111   creating build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,112   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,115   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,117   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,119   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,121   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,124   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,127   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,128   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,131   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,134   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-24T00:01:55,137   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,138   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,141   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,143   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,145   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,147   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,149   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,152   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,154   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,156   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,158   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:01:55,161   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,162   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,164   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,166   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,169   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,172   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,174   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,177   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,180   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,182   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,185   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-24T00:01:55,188   creating build/lib/deepspeed/autotuning/tuner
2024-02-24T00:01:55,189   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-02-24T00:01:55,191   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-02-24T00:01:55,193   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-02-24T00:01:55,195   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-02-24T00:01:55,197   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-02-24T00:01:55,199   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-02-24T00:01:55,202   creating build/lib/deepspeed/inference/quantization
2024-02-24T00:01:55,203   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-02-24T00:01:55,206   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-02-24T00:01:55,208   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-02-24T00:01:55,211   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-02-24T00:01:55,213   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-02-24T00:01:55,217   creating build/lib/deepspeed/inference/v2
2024-02-24T00:01:55,218   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-02-24T00:01:55,220   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-02-24T00:01:55,222   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-02-24T00:01:55,224   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-02-24T00:01:55,226   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-02-24T00:01:55,228   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-02-24T00:01:55,229   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-02-24T00:01:55,231   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-02-24T00:01:55,233   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-02-24T00:01:55,235   creating build/lib/deepspeed/inference/v2/model_implementations
2024-02-24T00:01:55,236   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-24T00:01:55,239   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-24T00:01:55,241   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-24T00:01:55,243   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-24T00:01:55,248   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-24T00:01:55,251   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-24T00:01:55,254   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-24T00:01:55,257   creating build/lib/deepspeed/inference/v2/modules
2024-02-24T00:01:55,258   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-02-24T00:01:55,261   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-02-24T00:01:55,263   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-02-24T00:01:55,265   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-02-24T00:01:55,268   creating build/lib/deepspeed/inference/v2/ragged
2024-02-24T00:01:55,269   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-24T00:01:55,271   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-24T00:01:55,274   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-24T00:01:55,278   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-24T00:01:55,280   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-24T00:01:55,282   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-24T00:01:55,285   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-24T00:01:55,288   creating build/lib/deepspeed/inference/v2/kernels
2024-02-24T00:01:55,289   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-02-24T00:01:55,291   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-02-24T00:01:55,294   creating build/lib/deepspeed/inference/v2/checkpoint
2024-02-24T00:01:55,295   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-24T00:01:55,298   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-24T00:01:55,300   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-24T00:01:55,302   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-24T00:01:55,305   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-24T00:01:55,306   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-24T00:01:55,309   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-24T00:01:55,310   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-24T00:01:55,313   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-24T00:01:55,316   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-24T00:01:55,317   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-24T00:01:55,319   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-24T00:01:55,320   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-24T00:01:55,323   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-24T00:01:55,325   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-24T00:01:55,327   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-24T00:01:55,329   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-24T00:01:55,331   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-24T00:01:55,333   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-24T00:01:55,336   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-24T00:01:55,337   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-24T00:01:55,339   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-24T00:01:55,341   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-24T00:01:55,344   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-24T00:01:55,346   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-24T00:01:55,347   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-24T00:01:55,349   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-24T00:01:55,352   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-24T00:01:55,354   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-24T00:01:55,357   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-24T00:01:55,358   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-24T00:01:55,360   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-24T00:01:55,361   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-24T00:01:55,364   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-24T00:01:55,367   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:01:55,367   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:01:55,369   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:01:55,372   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:01:55,374   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:01:55,376   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:01:55,377   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:01:55,379   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:01:55,382   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:01:55,384   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:01:55,386   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-24T00:01:55,387   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-24T00:01:55,389   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-24T00:01:55,391   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-24T00:01:55,394   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-24T00:01:55,396   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:01:55,397   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:01:55,401   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:01:55,404   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:01:55,406   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:01:55,409   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:01:55,411   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:01:55,413   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:01:55,415   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:01:55,417   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:01:55,420   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-02-24T00:01:55,421   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-02-24T00:01:55,424   creating build/lib/deepspeed/inference/v2/modules/configs
2024-02-24T00:01:55,425   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-24T00:01:55,428   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-24T00:01:55,430   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-24T00:01:55,432   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-24T00:01:55,435   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-24T00:01:55,437   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-24T00:01:55,439   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-24T00:01:55,443   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:01:55,444   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:01:55,446   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:01:55,449   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:01:55,451   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:01:55,453   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:01:55,456   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:01:55,459   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:01:55,461   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:01:55,464   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-02-24T00:01:55,465   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-02-24T00:01:55,467   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-02-24T00:01:55,470   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-24T00:01:55,472   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-24T00:01:55,474   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-24T00:01:55,477   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-24T00:01:55,479   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-02-24T00:01:55,480   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-02-24T00:01:55,483   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-02-24T00:01:55,485   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-02-24T00:01:55,486   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-02-24T00:01:55,488   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-02-24T00:01:55,491   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-02-24T00:01:55,492   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-02-24T00:01:55,495   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-02-24T00:01:55,498   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-24T00:01:55,498   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-24T00:01:55,501   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-24T00:01:55,504   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-02-24T00:01:55,504   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-02-24T00:01:55,506   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-02-24T00:01:55,510   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-24T00:01:55,511   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-24T00:01:55,514   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-02-24T00:01:55,515   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-02-24T00:01:55,518   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-02-24T00:01:55,519   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-02-24T00:01:55,522   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:01:55,523   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:01:55,526   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:01:55,528   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:01:55,530   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:01:55,531   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:01:55,534   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:01:55,537   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-24T00:01:55,538   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-24T00:01:55,540   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-24T00:01:55,542   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:01:55,543   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:01:55,546   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:01:55,548   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:01:55,550   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:01:55,554   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:01:55,555   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:01:55,558   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:01:55,560   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:01:55,565   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:01:55,568   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:01:55,571   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:01:55,572   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:01:55,574   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:01:55,576   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:01:55,578   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:01:55,581   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:01:55,583   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:01:55,585   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:01:55,587   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:01:55,590   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:01:55,591   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:01:55,593   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:01:55,597   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:01:55,598   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:01:55,600   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:01:55,602   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:01:55,603   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:01:55,606   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:01:55,608   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:01:55,610   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:01:55,613   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-24T00:01:55,614   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-24T00:01:55,616   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-24T00:01:55,619   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:01:55,620   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:01:55,622   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:01:55,625   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:01:55,626   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:01:55,628   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:01:55,630   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:01:55,631   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:01:55,634   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:01:55,638   running egg_info
2024-02-24T00:01:55,716   writing deepspeed.egg-info/PKG-INFO
2024-02-24T00:01:55,758   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-02-24T00:01:55,760   writing entry points to deepspeed.egg-info/entry_points.txt
2024-02-24T00:01:55,776   writing requirements to deepspeed.egg-info/requires.txt
2024-02-24T00:01:55,778   writing top-level names to deepspeed.egg-info/top_level.txt
2024-02-24T00:01:55,899   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-02-24T00:01:55,920   reading manifest template 'MANIFEST.in'
2024-02-24T00:01:55,922   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-02-24T00:01:55,923   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-02-24T00:01:57,792   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-02-24T00:01:59,106   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-02-24T00:01:59,775   warning: no files found matching '*.tr' under directory 'csrc'
2024-02-24T00:01:59,923   warning: no files found matching '*.cc' under directory 'csrc'
2024-02-24T00:01:59,966   warning: no files found matching '*.py' under directory 'benchmarks'
2024-02-24T00:02:00,035   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-02-24T00:02:00,046   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-02-24T00:02:00,046   !!

2024-02-24T00:02:00,047           ********************************************************************************
2024-02-24T00:02:00,048           ############################
2024-02-24T00:02:00,049           # Package would be ignored #
2024-02-24T00:02:00,049           ############################
2024-02-24T00:02:00,050           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-02-24T00:02:00,050           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,052           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,053           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-02-24T00:02:00,053           to the `packages` configuration field.

2024-02-24T00:02:00,054           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,055           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,055           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,057           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,059           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,061           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-02-24T00:02:00,062           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-02-24T00:02:00,063           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,064           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,065           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,066           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,068           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,070           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,070                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,071                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,071                 directory, all directories are treated like packages.
2024-02-24T00:02:00,072           ********************************************************************************

2024-02-24T00:02:00,073   !!
2024-02-24T00:02:00,073     check.warn(importable)
2024-02-24T00:02:00,074   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-02-24T00:02:00,074   !!

2024-02-24T00:02:00,076           ********************************************************************************
2024-02-24T00:02:00,076           ############################
2024-02-24T00:02:00,077           # Package would be ignored #
2024-02-24T00:02:00,078           ############################
2024-02-24T00:02:00,079           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-02-24T00:02:00,080           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,081           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,081           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-02-24T00:02:00,082           to the `packages` configuration field.

2024-02-24T00:02:00,082           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,083           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,083           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,084           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,085           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,086           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-02-24T00:02:00,086           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-02-24T00:02:00,086           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,087           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,087           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,088           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,089           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,091           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,091                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,092                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,093                 directory, all directories are treated like packages.
2024-02-24T00:02:00,093           ********************************************************************************

2024-02-24T00:02:00,095   !!
2024-02-24T00:02:00,097     check.warn(importable)
2024-02-24T00:02:00,098   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-02-24T00:02:00,098   !!

2024-02-24T00:02:00,100           ********************************************************************************
2024-02-24T00:02:00,100           ############################
2024-02-24T00:02:00,101           # Package would be ignored #
2024-02-24T00:02:00,102           ############################
2024-02-24T00:02:00,103           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-02-24T00:02:00,103           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,104           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,105           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-02-24T00:02:00,105           to the `packages` configuration field.

2024-02-24T00:02:00,106           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,107           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,107           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,108           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,109           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,111           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-02-24T00:02:00,111           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-02-24T00:02:00,112           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,113           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,113           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,114           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,115           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,116           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,116                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,117                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,117                 directory, all directories are treated like packages.
2024-02-24T00:02:00,118           ********************************************************************************

2024-02-24T00:02:00,118   !!
2024-02-24T00:02:00,119     check.warn(importable)
2024-02-24T00:02:00,119   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-02-24T00:02:00,120   !!

2024-02-24T00:02:00,120           ********************************************************************************
2024-02-24T00:02:00,121           ############################
2024-02-24T00:02:00,121           # Package would be ignored #
2024-02-24T00:02:00,122           ############################
2024-02-24T00:02:00,122           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-02-24T00:02:00,123           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,124           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,125           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-02-24T00:02:00,125           to the `packages` configuration field.

2024-02-24T00:02:00,126           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,127           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,128           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,129           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,130           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,131           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-02-24T00:02:00,132           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-02-24T00:02:00,132           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,132           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,133           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,134           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,135           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,137           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,137                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,138                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,139                 directory, all directories are treated like packages.
2024-02-24T00:02:00,139           ********************************************************************************

2024-02-24T00:02:00,140   !!
2024-02-24T00:02:00,141     check.warn(importable)
2024-02-24T00:02:00,142   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-02-24T00:02:00,142   !!

2024-02-24T00:02:00,143           ********************************************************************************
2024-02-24T00:02:00,144           ############################
2024-02-24T00:02:00,144           # Package would be ignored #
2024-02-24T00:02:00,144           ############################
2024-02-24T00:02:00,145           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-02-24T00:02:00,145           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,146           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,146           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-02-24T00:02:00,146           to the `packages` configuration field.

2024-02-24T00:02:00,147           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,147           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,148           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,149           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,149           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,150           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-02-24T00:02:00,151           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-02-24T00:02:00,151           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,152           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,152           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,154           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,155           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,157           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,157                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,158                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,159                 directory, all directories are treated like packages.
2024-02-24T00:02:00,159           ********************************************************************************

2024-02-24T00:02:00,160   !!
2024-02-24T00:02:00,161     check.warn(importable)
2024-02-24T00:02:00,161   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-02-24T00:02:00,162   !!

2024-02-24T00:02:00,163           ********************************************************************************
2024-02-24T00:02:00,164           ############################
2024-02-24T00:02:00,164           # Package would be ignored #
2024-02-24T00:02:00,165           ############################
2024-02-24T00:02:00,165           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-02-24T00:02:00,166           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,167           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,168           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-02-24T00:02:00,168           to the `packages` configuration field.

2024-02-24T00:02:00,170           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,170           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,170           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,171           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,172           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,173           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-02-24T00:02:00,173           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-02-24T00:02:00,173           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,174           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,174           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,175           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,176           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,177           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,177                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,178                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,178                 directory, all directories are treated like packages.
2024-02-24T00:02:00,179           ********************************************************************************

2024-02-24T00:02:00,180   !!
2024-02-24T00:02:00,180     check.warn(importable)
2024-02-24T00:02:00,181   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-02-24T00:02:00,182   !!

2024-02-24T00:02:00,183           ********************************************************************************
2024-02-24T00:02:00,184           ############################
2024-02-24T00:02:00,184           # Package would be ignored #
2024-02-24T00:02:00,185           ############################
2024-02-24T00:02:00,185           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-02-24T00:02:00,186           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,187           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,188           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-02-24T00:02:00,188           to the `packages` configuration field.

2024-02-24T00:02:00,189           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,190           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,191           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,192           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,193           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,194           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-02-24T00:02:00,194           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-02-24T00:02:00,195           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,196           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,196           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,197           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,199           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,201           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,201                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,202                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,202                 directory, all directories are treated like packages.
2024-02-24T00:02:00,202           ********************************************************************************

2024-02-24T00:02:00,203   !!
2024-02-24T00:02:00,204     check.warn(importable)
2024-02-24T00:02:00,204   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-02-24T00:02:00,205   !!

2024-02-24T00:02:00,205           ********************************************************************************
2024-02-24T00:02:00,206           ############################
2024-02-24T00:02:00,206           # Package would be ignored #
2024-02-24T00:02:00,207           ############################
2024-02-24T00:02:00,207           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-02-24T00:02:00,208           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,209           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,209           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-02-24T00:02:00,210           to the `packages` configuration field.

2024-02-24T00:02:00,211           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,212           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,212           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,213           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,215           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,216           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-02-24T00:02:00,217           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-02-24T00:02:00,217           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,218           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,219           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,220           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,221           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,223           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,223                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,224                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,224                 directory, all directories are treated like packages.
2024-02-24T00:02:00,225           ********************************************************************************

2024-02-24T00:02:00,226   !!
2024-02-24T00:02:00,227     check.warn(importable)
2024-02-24T00:02:00,227   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-02-24T00:02:00,228   !!

2024-02-24T00:02:00,229           ********************************************************************************
2024-02-24T00:02:00,230           ############################
2024-02-24T00:02:00,230           # Package would be ignored #
2024-02-24T00:02:00,231           ############################
2024-02-24T00:02:00,232           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-02-24T00:02:00,233           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,233           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,234           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-02-24T00:02:00,234           to the `packages` configuration field.

2024-02-24T00:02:00,235           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,235           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,236           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,237           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,238           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,239           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-02-24T00:02:00,239           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-02-24T00:02:00,240           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,241           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,241           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,242           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,243           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,244           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,245                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,245                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,246                 directory, all directories are treated like packages.
2024-02-24T00:02:00,247           ********************************************************************************

2024-02-24T00:02:00,248   !!
2024-02-24T00:02:00,249     check.warn(importable)
2024-02-24T00:02:00,250   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-02-24T00:02:00,250   !!

2024-02-24T00:02:00,251           ********************************************************************************
2024-02-24T00:02:00,252           ############################
2024-02-24T00:02:00,253           # Package would be ignored #
2024-02-24T00:02:00,253           ############################
2024-02-24T00:02:00,254           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-02-24T00:02:00,254           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,255           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,256           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-02-24T00:02:00,256           to the `packages` configuration field.

2024-02-24T00:02:00,258           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,258           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,259           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,260           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,262           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,263           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-02-24T00:02:00,264           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-02-24T00:02:00,264           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,265           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,266           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,266           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,267           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,268           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,269                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,269                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,270                 directory, all directories are treated like packages.
2024-02-24T00:02:00,270           ********************************************************************************

2024-02-24T00:02:00,271   !!
2024-02-24T00:02:00,272     check.warn(importable)
2024-02-24T00:02:00,272   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-02-24T00:02:00,273   !!

2024-02-24T00:02:00,273           ********************************************************************************
2024-02-24T00:02:00,274           ############################
2024-02-24T00:02:00,274           # Package would be ignored #
2024-02-24T00:02:00,275           ############################
2024-02-24T00:02:00,275           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-02-24T00:02:00,276           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,277           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,277           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-02-24T00:02:00,278           to the `packages` configuration field.

2024-02-24T00:02:00,279           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,280           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,281           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,282           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,283           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,285           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-02-24T00:02:00,285           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-02-24T00:02:00,286           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,287           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,287           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,288           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,289           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,291           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,292                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,293                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,294                 directory, all directories are treated like packages.
2024-02-24T00:02:00,294           ********************************************************************************

2024-02-24T00:02:00,295   !!
2024-02-24T00:02:00,296     check.warn(importable)
2024-02-24T00:02:00,296   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-02-24T00:02:00,297   !!

2024-02-24T00:02:00,299           ********************************************************************************
2024-02-24T00:02:00,299           ############################
2024-02-24T00:02:00,300           # Package would be ignored #
2024-02-24T00:02:00,300           ############################
2024-02-24T00:02:00,300           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-02-24T00:02:00,301           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,302           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,302           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-02-24T00:02:00,302           to the `packages` configuration field.

2024-02-24T00:02:00,303           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,304           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,304           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,305           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,306           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,307           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-02-24T00:02:00,307           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-02-24T00:02:00,308           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,308           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,309           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,310           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,311           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,313           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,314                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,314                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,315                 directory, all directories are treated like packages.
2024-02-24T00:02:00,316           ********************************************************************************

2024-02-24T00:02:00,317   !!
2024-02-24T00:02:00,318     check.warn(importable)
2024-02-24T00:02:00,318   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration.
2024-02-24T00:02:00,319   !!

2024-02-24T00:02:00,320           ********************************************************************************
2024-02-24T00:02:00,320           ############################
2024-02-24T00:02:00,321           # Package would be ignored #
2024-02-24T00:02:00,321           ############################
2024-02-24T00:02:00,322           Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1],
2024-02-24T00:02:00,322           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,323           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,324           package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added
2024-02-24T00:02:00,324           to the `packages` configuration field.

2024-02-24T00:02:00,326           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,326           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,327           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,328           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,329           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,330           If you don't want 'deepspeed.ops.csrc.common' to be distributed and are
2024-02-24T00:02:00,331           already explicitly excluding 'deepspeed.ops.csrc.common' via
2024-02-24T00:02:00,331           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,332           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,332           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,333           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,334           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,335           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,335                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,335                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,336                 directory, all directories are treated like packages.
2024-02-24T00:02:00,336           ********************************************************************************

2024-02-24T00:02:00,337   !!
2024-02-24T00:02:00,337     check.warn(importable)
2024-02-24T00:02:00,338   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-02-24T00:02:00,338   !!

2024-02-24T00:02:00,340           ********************************************************************************
2024-02-24T00:02:00,340           ############################
2024-02-24T00:02:00,341           # Package would be ignored #
2024-02-24T00:02:00,342           ############################
2024-02-24T00:02:00,342           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-02-24T00:02:00,343           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,344           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,345           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-02-24T00:02:00,345           to the `packages` configuration field.

2024-02-24T00:02:00,346           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,347           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,348           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,349           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,350           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,351           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-02-24T00:02:00,351           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-02-24T00:02:00,352           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,353           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,353           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,354           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,356           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,357           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,358                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,358                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,359                 directory, all directories are treated like packages.
2024-02-24T00:02:00,360           ********************************************************************************

2024-02-24T00:02:00,361   !!
2024-02-24T00:02:00,361     check.warn(importable)
2024-02-24T00:02:00,362   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-02-24T00:02:00,362   !!

2024-02-24T00:02:00,363           ********************************************************************************
2024-02-24T00:02:00,363           ############################
2024-02-24T00:02:00,364           # Package would be ignored #
2024-02-24T00:02:00,364           ############################
2024-02-24T00:02:00,364           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-02-24T00:02:00,365           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,366           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,366           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-02-24T00:02:00,366           to the `packages` configuration field.

2024-02-24T00:02:00,367           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,368           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,368           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,369           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,370           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,371           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-02-24T00:02:00,372           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-02-24T00:02:00,373           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,373           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,374           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,375           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,376           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,378           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,378                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,379                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,380                 directory, all directories are treated like packages.
2024-02-24T00:02:00,380           ********************************************************************************

2024-02-24T00:02:00,381   !!
2024-02-24T00:02:00,382     check.warn(importable)
2024-02-24T00:02:00,382   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-02-24T00:02:00,383   !!

2024-02-24T00:02:00,384           ********************************************************************************
2024-02-24T00:02:00,385           ############################
2024-02-24T00:02:00,385           # Package would be ignored #
2024-02-24T00:02:00,386           ############################
2024-02-24T00:02:00,386           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-02-24T00:02:00,387           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,388           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,389           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-02-24T00:02:00,389           to the `packages` configuration field.

2024-02-24T00:02:00,391           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,391           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,392           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,392           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,393           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,394           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-02-24T00:02:00,394           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-02-24T00:02:00,395           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,395           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,396           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,396           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,397           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,398           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,399                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,399                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,400                 directory, all directories are treated like packages.
2024-02-24T00:02:00,400           ********************************************************************************

2024-02-24T00:02:00,401   !!
2024-02-24T00:02:00,402     check.warn(importable)
2024-02-24T00:02:00,402   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-02-24T00:02:00,403   !!

2024-02-24T00:02:00,404           ********************************************************************************
2024-02-24T00:02:00,405           ############################
2024-02-24T00:02:00,405           # Package would be ignored #
2024-02-24T00:02:00,406           ############################
2024-02-24T00:02:00,407           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-02-24T00:02:00,407           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,408           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,409           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-02-24T00:02:00,409           to the `packages` configuration field.

2024-02-24T00:02:00,411           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,411           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,412           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,413           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,414           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,415           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-02-24T00:02:00,416           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-02-24T00:02:00,416           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,417           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,418           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,419           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,420           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,421           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,422                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,422                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,423                 directory, all directories are treated like packages.
2024-02-24T00:02:00,423           ********************************************************************************

2024-02-24T00:02:00,424   !!
2024-02-24T00:02:00,424     check.warn(importable)
2024-02-24T00:02:00,424   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-02-24T00:02:00,425   !!

2024-02-24T00:02:00,426           ********************************************************************************
2024-02-24T00:02:00,426           ############################
2024-02-24T00:02:00,426           # Package would be ignored #
2024-02-24T00:02:00,427           ############################
2024-02-24T00:02:00,427           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-02-24T00:02:00,428           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,429           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,429           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-02-24T00:02:00,430           to the `packages` configuration field.

2024-02-24T00:02:00,431           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,431           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,432           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,434           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,435           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,436           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-02-24T00:02:00,436           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-02-24T00:02:00,437           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,438           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,438           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,440           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,441           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,442           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,443                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,443                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,444                 directory, all directories are treated like packages.
2024-02-24T00:02:00,444           ********************************************************************************

2024-02-24T00:02:00,446   !!
2024-02-24T00:02:00,446     check.warn(importable)
2024-02-24T00:02:00,447   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-02-24T00:02:00,447   !!

2024-02-24T00:02:00,449           ********************************************************************************
2024-02-24T00:02:00,449           ############################
2024-02-24T00:02:00,449           # Package would be ignored #
2024-02-24T00:02:00,450           ############################
2024-02-24T00:02:00,450           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-02-24T00:02:00,451           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,451           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,452           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-02-24T00:02:00,452           to the `packages` configuration field.

2024-02-24T00:02:00,453           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,453           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,454           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,455           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,456           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,457           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-02-24T00:02:00,457           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-02-24T00:02:00,457           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,458           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,458           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,460           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,461           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,462           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,463                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,464                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,465                 directory, all directories are treated like packages.
2024-02-24T00:02:00,465           ********************************************************************************

2024-02-24T00:02:00,466   !!
2024-02-24T00:02:00,467     check.warn(importable)
2024-02-24T00:02:00,468   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-02-24T00:02:00,469   !!

2024-02-24T00:02:00,470           ********************************************************************************
2024-02-24T00:02:00,470           ############################
2024-02-24T00:02:00,471           # Package would be ignored #
2024-02-24T00:02:00,472           ############################
2024-02-24T00:02:00,472           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-02-24T00:02:00,473           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,474           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,475           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-02-24T00:02:00,476           to the `packages` configuration field.

2024-02-24T00:02:00,477           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,477           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,478           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,479           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,480           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,481           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-02-24T00:02:00,481           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-02-24T00:02:00,482           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,482           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,483           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,484           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,485           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,486           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,486                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,487                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,487                 directory, all directories are treated like packages.
2024-02-24T00:02:00,487           ********************************************************************************

2024-02-24T00:02:00,489   !!
2024-02-24T00:02:00,489     check.warn(importable)
2024-02-24T00:02:00,490   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-02-24T00:02:00,490   !!

2024-02-24T00:02:00,492           ********************************************************************************
2024-02-24T00:02:00,492           ############################
2024-02-24T00:02:00,493           # Package would be ignored #
2024-02-24T00:02:00,494           ############################
2024-02-24T00:02:00,494           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-02-24T00:02:00,495           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,496           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,497           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-02-24T00:02:00,497           to the `packages` configuration field.

2024-02-24T00:02:00,499           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,499           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,500           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,501           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,502           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,503           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-02-24T00:02:00,504           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-02-24T00:02:00,505           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,505           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,506           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,507           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,510           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,511           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,512                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,512                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,513                 directory, all directories are treated like packages.
2024-02-24T00:02:00,513           ********************************************************************************

2024-02-24T00:02:00,514   !!
2024-02-24T00:02:00,515     check.warn(importable)
2024-02-24T00:02:00,515   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-02-24T00:02:00,516   !!

2024-02-24T00:02:00,517           ********************************************************************************
2024-02-24T00:02:00,518           ############################
2024-02-24T00:02:00,518           # Package would be ignored #
2024-02-24T00:02:00,519           ############################
2024-02-24T00:02:00,520           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-02-24T00:02:00,520           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,521           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,522           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-02-24T00:02:00,523           to the `packages` configuration field.

2024-02-24T00:02:00,524           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,525           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,525           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,526           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,528           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,529           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-02-24T00:02:00,530           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-02-24T00:02:00,530           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,531           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,532           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,533           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,534           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,536           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,537                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,538                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,538                 directory, all directories are treated like packages.
2024-02-24T00:02:00,539           ********************************************************************************

2024-02-24T00:02:00,540   !!
2024-02-24T00:02:00,541     check.warn(importable)
2024-02-24T00:02:00,542   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-02-24T00:02:00,542   !!

2024-02-24T00:02:00,544           ********************************************************************************
2024-02-24T00:02:00,545           ############################
2024-02-24T00:02:00,545           # Package would be ignored #
2024-02-24T00:02:00,546           ############################
2024-02-24T00:02:00,546           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-02-24T00:02:00,547           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,548           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,549           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-02-24T00:02:00,549           to the `packages` configuration field.

2024-02-24T00:02:00,550           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,551           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,551           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,552           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,553           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,554           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-02-24T00:02:00,554           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-02-24T00:02:00,555           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,555           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,556           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,557           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,558           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,560           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,561                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,561                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,562                 directory, all directories are treated like packages.
2024-02-24T00:02:00,562           ********************************************************************************

2024-02-24T00:02:00,564   !!
2024-02-24T00:02:00,564     check.warn(importable)
2024-02-24T00:02:00,565   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-02-24T00:02:00,565   !!

2024-02-24T00:02:00,566           ********************************************************************************
2024-02-24T00:02:00,567           ############################
2024-02-24T00:02:00,567           # Package would be ignored #
2024-02-24T00:02:00,568           ############################
2024-02-24T00:02:00,568           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-02-24T00:02:00,569           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,570           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,570           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-02-24T00:02:00,571           to the `packages` configuration field.

2024-02-24T00:02:00,572           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,572           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,573           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,574           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,575           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,576           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-02-24T00:02:00,577           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-02-24T00:02:00,577           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,578           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,579           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,580           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,581           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,582           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,583                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,583                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,584                 directory, all directories are treated like packages.
2024-02-24T00:02:00,584           ********************************************************************************

2024-02-24T00:02:00,586   !!
2024-02-24T00:02:00,586     check.warn(importable)
2024-02-24T00:02:00,586   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-02-24T00:02:00,587   !!

2024-02-24T00:02:00,588           ********************************************************************************
2024-02-24T00:02:00,588           ############################
2024-02-24T00:02:00,589           # Package would be ignored #
2024-02-24T00:02:00,589           ############################
2024-02-24T00:02:00,590           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-02-24T00:02:00,590           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,591           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,592           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-02-24T00:02:00,592           to the `packages` configuration field.

2024-02-24T00:02:00,593           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,594           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,594           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,595           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,597           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,598           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-02-24T00:02:00,598           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-02-24T00:02:00,599           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,600           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,600           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,601           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,602           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,604           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,605                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,605                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,606                 directory, all directories are treated like packages.
2024-02-24T00:02:00,607           ********************************************************************************

2024-02-24T00:02:00,608   !!
2024-02-24T00:02:00,609     check.warn(importable)
2024-02-24T00:02:00,609   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-02-24T00:02:00,610   !!

2024-02-24T00:02:00,611           ********************************************************************************
2024-02-24T00:02:00,611           ############################
2024-02-24T00:02:00,612           # Package would be ignored #
2024-02-24T00:02:00,612           ############################
2024-02-24T00:02:00,613           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-02-24T00:02:00,613           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,614           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,615           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-02-24T00:02:00,615           to the `packages` configuration field.

2024-02-24T00:02:00,616           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,617           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,618           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,619           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,619           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,620           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-02-24T00:02:00,621           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-02-24T00:02:00,621           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,622           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,622           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,624           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,625           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,627           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,628                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,629                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,630                 directory, all directories are treated like packages.
2024-02-24T00:02:00,630           ********************************************************************************

2024-02-24T00:02:00,632   !!
2024-02-24T00:02:00,632     check.warn(importable)
2024-02-24T00:02:00,633   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-02-24T00:02:00,634   !!

2024-02-24T00:02:00,635           ********************************************************************************
2024-02-24T00:02:00,636           ############################
2024-02-24T00:02:00,637           # Package would be ignored #
2024-02-24T00:02:00,638           ############################
2024-02-24T00:02:00,638           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-02-24T00:02:00,639           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,641           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,642           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-02-24T00:02:00,642           to the `packages` configuration field.

2024-02-24T00:02:00,643           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,644           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,645           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,646           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,647           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,648           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-02-24T00:02:00,648           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-02-24T00:02:00,648           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,649           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,649           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,650           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,651           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,652           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,653                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,653                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,654                 directory, all directories are treated like packages.
2024-02-24T00:02:00,654           ********************************************************************************

2024-02-24T00:02:00,655   !!
2024-02-24T00:02:00,655     check.warn(importable)
2024-02-24T00:02:00,656   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-02-24T00:02:00,657   !!

2024-02-24T00:02:00,658           ********************************************************************************
2024-02-24T00:02:00,658           ############################
2024-02-24T00:02:00,659           # Package would be ignored #
2024-02-24T00:02:00,659           ############################
2024-02-24T00:02:00,660           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-02-24T00:02:00,660           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,661           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,662           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-02-24T00:02:00,662           to the `packages` configuration field.

2024-02-24T00:02:00,663           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,664           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,664           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,665           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,670           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,671           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-02-24T00:02:00,672           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-02-24T00:02:00,673           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,673           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,674           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,675           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,676           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,678           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,678                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,679                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,680                 directory, all directories are treated like packages.
2024-02-24T00:02:00,680           ********************************************************************************

2024-02-24T00:02:00,681   !!
2024-02-24T00:02:00,682     check.warn(importable)
2024-02-24T00:02:00,682   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-02-24T00:02:00,683   !!

2024-02-24T00:02:00,684           ********************************************************************************
2024-02-24T00:02:00,685           ############################
2024-02-24T00:02:00,685           # Package would be ignored #
2024-02-24T00:02:00,686           ############################
2024-02-24T00:02:00,686           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-02-24T00:02:00,687           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,688           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,689           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-02-24T00:02:00,689           to the `packages` configuration field.

2024-02-24T00:02:00,690           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,691           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,691           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,692           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,693           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,695           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-02-24T00:02:00,695           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-02-24T00:02:00,696           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,696           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,697           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,698           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,699           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,701           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,702                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,702                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,703                 directory, all directories are treated like packages.
2024-02-24T00:02:00,704           ********************************************************************************

2024-02-24T00:02:00,705   !!
2024-02-24T00:02:00,706     check.warn(importable)
2024-02-24T00:02:00,707   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-02-24T00:02:00,708   !!

2024-02-24T00:02:00,709           ********************************************************************************
2024-02-24T00:02:00,710           ############################
2024-02-24T00:02:00,710           # Package would be ignored #
2024-02-24T00:02:00,711           ############################
2024-02-24T00:02:00,712           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-02-24T00:02:00,713           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,714           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,715           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-02-24T00:02:00,716           to the `packages` configuration field.

2024-02-24T00:02:00,717           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,717           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,718           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,719           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,720           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,721           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-02-24T00:02:00,722           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-02-24T00:02:00,723           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,723           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,724           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,725           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,726           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,728           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,729                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,729                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,730                 directory, all directories are treated like packages.
2024-02-24T00:02:00,731           ********************************************************************************

2024-02-24T00:02:00,733   !!
2024-02-24T00:02:00,734     check.warn(importable)
2024-02-24T00:02:00,735   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-02-24T00:02:00,735   !!

2024-02-24T00:02:00,737           ********************************************************************************
2024-02-24T00:02:00,738           ############################
2024-02-24T00:02:00,739           # Package would be ignored #
2024-02-24T00:02:00,739           ############################
2024-02-24T00:02:00,740           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-02-24T00:02:00,740           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,741           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,742           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-02-24T00:02:00,742           to the `packages` configuration field.

2024-02-24T00:02:00,744           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,745           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,745           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,747           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,748           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,749           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-02-24T00:02:00,750           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-02-24T00:02:00,750           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,752           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,752           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,754           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,755           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,757           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,757                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,758                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,758                 directory, all directories are treated like packages.
2024-02-24T00:02:00,759           ********************************************************************************

2024-02-24T00:02:00,760   !!
2024-02-24T00:02:00,761     check.warn(importable)
2024-02-24T00:02:00,761   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-02-24T00:02:00,762   !!

2024-02-24T00:02:00,763           ********************************************************************************
2024-02-24T00:02:00,763           ############################
2024-02-24T00:02:00,764           # Package would be ignored #
2024-02-24T00:02:00,764           ############################
2024-02-24T00:02:00,765           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-02-24T00:02:00,765           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,766           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,767           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-02-24T00:02:00,767           to the `packages` configuration field.

2024-02-24T00:02:00,768           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,769           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,769           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,770           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,772           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,773           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-02-24T00:02:00,774           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-02-24T00:02:00,775           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,775           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,776           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,778           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,779           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,781           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,782                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,782                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,783                 directory, all directories are treated like packages.
2024-02-24T00:02:00,784           ********************************************************************************

2024-02-24T00:02:00,785   !!
2024-02-24T00:02:00,785     check.warn(importable)
2024-02-24T00:02:00,786   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-02-24T00:02:00,787   !!

2024-02-24T00:02:00,789           ********************************************************************************
2024-02-24T00:02:00,789           ############################
2024-02-24T00:02:00,790           # Package would be ignored #
2024-02-24T00:02:00,791           ############################
2024-02-24T00:02:00,791           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-02-24T00:02:00,792           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,793           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,793           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-02-24T00:02:00,794           to the `packages` configuration field.

2024-02-24T00:02:00,795           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,795           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,796           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,797           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,798           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,799           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-02-24T00:02:00,800           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-02-24T00:02:00,800           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,801           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,801           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,803           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,804           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,806           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,806                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,807                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,808                 directory, all directories are treated like packages.
2024-02-24T00:02:00,808           ********************************************************************************

2024-02-24T00:02:00,810   !!
2024-02-24T00:02:00,810     check.warn(importable)
2024-02-24T00:02:00,811   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-02-24T00:02:00,812   !!

2024-02-24T00:02:00,813           ********************************************************************************
2024-02-24T00:02:00,814           ############################
2024-02-24T00:02:00,814           # Package would be ignored #
2024-02-24T00:02:00,815           ############################
2024-02-24T00:02:00,816           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-02-24T00:02:00,816           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,818           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,818           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-02-24T00:02:00,819           to the `packages` configuration field.

2024-02-24T00:02:00,821           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,822           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,822           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,823           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,825           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,826           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-02-24T00:02:00,827           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-02-24T00:02:00,827           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,828           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,828           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,830           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,831           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,832           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,833                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,833                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,834                 directory, all directories are treated like packages.
2024-02-24T00:02:00,835           ********************************************************************************

2024-02-24T00:02:00,836   !!
2024-02-24T00:02:00,836     check.warn(importable)
2024-02-24T00:02:00,837   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-02-24T00:02:00,838   !!

2024-02-24T00:02:00,839           ********************************************************************************
2024-02-24T00:02:00,840           ############################
2024-02-24T00:02:00,841           # Package would be ignored #
2024-02-24T00:02:00,841           ############################
2024-02-24T00:02:00,842           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-02-24T00:02:00,843           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,844           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,844           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-02-24T00:02:00,847           to the `packages` configuration field.

2024-02-24T00:02:00,848           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,848           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,849           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,850           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,852           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,853           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-02-24T00:02:00,854           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-02-24T00:02:00,855           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,855           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,856           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,861           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,863           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,865           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,866                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,866                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,867                 directory, all directories are treated like packages.
2024-02-24T00:02:00,867           ********************************************************************************

2024-02-24T00:02:00,869   !!
2024-02-24T00:02:00,869     check.warn(importable)
2024-02-24T00:02:00,870   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-02-24T00:02:00,871   !!

2024-02-24T00:02:00,872           ********************************************************************************
2024-02-24T00:02:00,872           ############################
2024-02-24T00:02:00,873           # Package would be ignored #
2024-02-24T00:02:00,874           ############################
2024-02-24T00:02:00,874           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-02-24T00:02:00,875           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,876           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,876           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-02-24T00:02:00,877           to the `packages` configuration field.

2024-02-24T00:02:00,877           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,878           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,878           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,879           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,881           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,882           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-02-24T00:02:00,882           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-02-24T00:02:00,883           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,883           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,884           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,885           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,886           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,888           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,888                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,889                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,890                 directory, all directories are treated like packages.
2024-02-24T00:02:00,890           ********************************************************************************

2024-02-24T00:02:00,891   !!
2024-02-24T00:02:00,892     check.warn(importable)
2024-02-24T00:02:00,893   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-02-24T00:02:00,894   !!

2024-02-24T00:02:00,895           ********************************************************************************
2024-02-24T00:02:00,895           ############################
2024-02-24T00:02:00,896           # Package would be ignored #
2024-02-24T00:02:00,897           ############################
2024-02-24T00:02:00,897           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-02-24T00:02:00,898           but it is absent from setuptools' `packages` configuration.

2024-02-24T00:02:00,899           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-24T00:02:00,900           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-02-24T00:02:00,900           to the `packages` configuration field.

2024-02-24T00:02:00,901           Alternatively, you can also rely on setuptools' discovery methods
2024-02-24T00:02:00,902           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-24T00:02:00,902           instead of `find_packages(...)`/`find:`).

2024-02-24T00:02:00,903           You can read more about "package discovery" on setuptools documentation page:

2024-02-24T00:02:00,904           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-24T00:02:00,905           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-02-24T00:02:00,906           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-02-24T00:02:00,906           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-24T00:02:00,906           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-24T00:02:00,907           combination with a more fine grained `package-data` configuration.

2024-02-24T00:02:00,908           You can read more about "package data files" on setuptools documentation page:

2024-02-24T00:02:00,909           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-24T00:02:00,910           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-24T00:02:00,910                 even if it does not contain any `.py` files.
2024-02-24T00:02:00,911                 On the other hand, currently there is no concept of package data
2024-02-24T00:02:00,911                 directory, all directories are treated like packages.
2024-02-24T00:02:00,912           ********************************************************************************

2024-02-24T00:02:00,913   !!
2024-02-24T00:02:00,913     check.warn(importable)
2024-02-24T00:02:00,914   creating build/lib/deepspeed/ops/csrc
2024-02-24T00:02:00,915   creating build/lib/deepspeed/ops/csrc/adagrad
2024-02-24T00:02:00,915   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-02-24T00:02:00,916   creating build/lib/deepspeed/ops/csrc/adam
2024-02-24T00:02:00,916   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-02-24T00:02:00,917   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-02-24T00:02:00,917   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-02-24T00:02:00,918   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-02-24T00:02:00,918   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-02-24T00:02:00,919   creating build/lib/deepspeed/ops/csrc/aio
2024-02-24T00:02:00,920   creating build/lib/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:00,920   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:00,921   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:00,921   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:00,922   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:00,922   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:00,923   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:00,925   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,926   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,926   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,927   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,928   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,928   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,928   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,929   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,930   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,930   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,931   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,931   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:00,932   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-02-24T00:02:00,932   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-02-24T00:02:00,933   creating build/lib/deepspeed/ops/csrc/common
2024-02-24T00:02:00,934   copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common
2024-02-24T00:02:00,934   creating build/lib/deepspeed/ops/csrc/cpu
2024-02-24T00:02:00,935   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-02-24T00:02:00,935   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-02-24T00:02:00,936   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-02-24T00:02:00,937   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-02-24T00:02:00,938   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-02-24T00:02:00,938   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-02-24T00:02:00,939   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-02-24T00:02:00,939   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:00,940   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:00,940   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:00,941   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:00,942   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:00,942   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:00,943   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:00,943   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-24T00:02:00,944   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-24T00:02:00,944   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-24T00:02:00,945   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-24T00:02:00,945   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-24T00:02:00,946   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:00,947   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:00,948   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:00,948   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:00,949   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:00,949   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:00,949   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:00,950   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:00,951   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:00,951   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:00,952   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:00,953   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:00,953   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:00,954   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:00,954   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:00,955   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:00,955   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-24T00:02:00,956   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-24T00:02:00,957   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-24T00:02:00,957   creating build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,958   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,958   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,959   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,959   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,960   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,961   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,961   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,962   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,962   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,963   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,963   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,964   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,964   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,965   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,965   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,966   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,966   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,967   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,967   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,968   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,969   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,969   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,969   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,970   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,971   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,971   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,971   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,972   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,973   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-24T00:02:00,973   creating build/lib/deepspeed/ops/csrc/lamb
2024-02-24T00:02:00,974   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-02-24T00:02:00,975   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-02-24T00:02:00,975   creating build/lib/deepspeed/ops/csrc/lion
2024-02-24T00:02:00,976   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-02-24T00:02:00,977   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-02-24T00:02:00,977   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-02-24T00:02:00,978   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-02-24T00:02:00,978   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-02-24T00:02:00,979   creating build/lib/deepspeed/ops/csrc/quantization
2024-02-24T00:02:00,979   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-24T00:02:00,980   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-24T00:02:00,981   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-02-24T00:02:00,982   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-24T00:02:00,982   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-24T00:02:00,983   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-24T00:02:00,983   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-24T00:02:00,984   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-02-24T00:02:00,984   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-24T00:02:00,985   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-24T00:02:00,985   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-24T00:02:00,986   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-24T00:02:00,986   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-02-24T00:02:00,987   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-02-24T00:02:00,987   creating build/lib/deepspeed/ops/csrc/spatial
2024-02-24T00:02:00,988   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-02-24T00:02:00,988   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-02-24T00:02:00,989   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-02-24T00:02:00,989   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-02-24T00:02:00,990   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-02-24T00:02:00,991   creating build/lib/deepspeed/ops/csrc/transformer
2024-02-24T00:02:00,991   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-24T00:02:00,992   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-24T00:02:00,997   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-02-24T00:02:01,001   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-24T00:02:01,004   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-24T00:02:01,008   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-24T00:02:01,013   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-24T00:02:01,016   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-24T00:02:01,020   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-02-24T00:02:01,021   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,022   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,027   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,030   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,033   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,038   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,040   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,045   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,047   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,051   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,055   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:01,058   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-24T00:02:01,060   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-24T00:02:01,063   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-24T00:02:01,066   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-24T00:02:01,069   creating build/lib/deepspeed/ops/csrc/utils
2024-02-24T00:02:01,070   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-02-24T00:02:01,073   creating build/lib/deepspeed/ops/csrc/xpu
2024-02-24T00:02:01,073   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-02-24T00:02:01,075   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-02-24T00:02:01,078   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-24T00:02:01,080   copying deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-24T00:02:01,083   copying deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-24T00:02:01,085   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-24T00:02:01,088   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-24T00:02:01,091   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-02-24T00:02:01,093   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-02-24T00:02:01,096   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:01,098   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:01,101   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:01,104   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:01,107   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:01,110   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:01,113   creating build/lib/deepspeed/autotuning/config_templates
2024-02-24T00:02:01,115   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-24T00:02:01,117   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-24T00:02:01,120   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-24T00:02:01,123   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-24T00:02:01,125   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-24T00:02:01,128   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-24T00:02:01,131   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-24T00:02:01,133   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-02-24T00:02:01,135   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-02-24T00:02:01,138   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-02-24T00:02:01,141   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-02-24T00:02:01,142   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-02-24T00:02:01,145   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:01,146   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:01,150   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:01,153   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:01,156   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:01,159   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:01,163   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-24T00:02:01,165   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-24T00:02:01,167   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-24T00:02:01,169   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-02-24T00:02:01,172   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-02-24T00:02:01,174   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-24T00:02:01,176   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-24T00:02:01,182   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-24T00:02:01,183   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-24T00:02:01,186   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-24T00:02:01,189   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-24T00:02:01,191   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:02:01,195   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:02:01,198   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:02:01,201   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:02:01,204   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:02:01,207   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:02:01,210   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-24T00:02:01,213   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-24T00:02:01,216   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:01,219   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:01,222   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:01,225   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:02:01,227   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:02:01,233   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:02:01,236   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:02:01,239   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:02:01,242   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:02:01,245   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:01,248   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:01,251   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:01,254   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:01,257   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:01,261   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:01,264   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:01,267   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:01,269   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:01,273   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:01,276   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:01,279   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:01,282   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:01,285   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:01,287   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:01,290   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:01,293   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:01,295   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:01,298   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:01,302   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-24T00:02:01,305   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-24T00:02:01,307   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:01,310   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:01,312   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:01,315   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:01,318   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:01,321   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:01,324   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:01,326   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:01,329   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:01,331   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:01,334   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:01,337   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:01,389   running build_scripts
2024-02-24T00:02:01,390   creating build/scripts-3.11
2024-02-24T00:02:01,391   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-02-24T00:02:01,393   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-02-24T00:02:01,395   copying and adjusting bin/ds -> build/scripts-3.11
2024-02-24T00:02:01,397   copying bin/ds_ssh -> build/scripts-3.11
2024-02-24T00:02:01,399   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-02-24T00:02:01,401   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-02-24T00:02:01,402   copying and adjusting bin/dsr -> build/scripts-3.11
2024-02-24T00:02:01,403   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-02-24T00:02:01,405   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-02-24T00:02:01,405   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-02-24T00:02:01,406   changing mode of build/scripts-3.11/ds from 644 to 755
2024-02-24T00:02:01,407   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-02-24T00:02:01,407   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-02-24T00:02:01,408   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-02-24T00:02:01,410   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-02-24T00:02:01,433   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-02-24T00:02:01,433   !!

2024-02-24T00:02:01,434           ********************************************************************************
2024-02-24T00:02:01,435           Please avoid running ``setup.py`` directly.
2024-02-24T00:02:01,435           Instead, use pypa/build, pypa/installer or other
2024-02-24T00:02:01,436           standards-based tools.

2024-02-24T00:02:01,437           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-02-24T00:02:01,438           ********************************************************************************

2024-02-24T00:02:01,439   !!
2024-02-24T00:02:01,439     self.initialize_options()
2024-02-24T00:02:01,458   installing to build/bdist.linux-armv7l/wheel
2024-02-24T00:02:01,459   running install
2024-02-24T00:02:01,482   running install_lib
2024-02-24T00:02:01,508   creating build/bdist.linux-armv7l
2024-02-24T00:02:01,509   creating build/bdist.linux-armv7l/wheel
2024-02-24T00:02:01,511   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-02-24T00:02:01,512   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-24T00:02:01,515   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,516   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,519   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,520   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,522   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,524   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,527   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,528   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,531   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,533   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,535   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,537   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,539   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,542   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,544   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,546   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,549   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,551   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-24T00:02:01,552   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-24T00:02:01,555   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-24T00:02:01,557   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-24T00:02:01,559   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-24T00:02:01,561   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-24T00:02:01,563   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-24T00:02:01,566   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-24T00:02:01,568   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,571   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,573   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,576   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,578   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-24T00:02:01,581   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,584   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,587   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,590   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,592   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,594   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,597   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,600   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,603   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,605   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,608   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,611   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-24T00:02:01,615   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-02-24T00:02:01,616   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-02-24T00:02:01,619   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-24T00:02:01,622   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-24T00:02:01,623   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-24T00:02:01,625   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-24T00:02:01,628   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-24T00:02:01,631   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-24T00:02:01,634   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-24T00:02:01,636   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-24T00:02:01,639   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,640   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,644   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,647   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,651   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-24T00:02:01,652   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-24T00:02:01,655   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-24T00:02:01,659   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-24T00:02:01,663   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-24T00:02:01,665   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-24T00:02:01,669   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-24T00:02:01,674   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-24T00:02:01,676   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-24T00:02:01,680   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-24T00:02:01,683   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-24T00:02:01,686   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:02:01,688   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:02:01,691   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:02:01,694   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:02:01,698   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:02:01,701   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-24T00:02:01,704   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-24T00:02:01,708   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:02:01,709   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:02:01,713   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:02:01,718   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:02:01,721   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:02:01,726   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-24T00:02:01,728   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,732   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,735   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,739   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,743   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-02-24T00:02:01,744   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-02-24T00:02:01,747   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-02-24T00:02:01,751   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,753   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,756   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,760   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,763   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,766   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,773   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,777   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,780   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,784   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,788   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,793   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,795   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,798   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,801   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,803   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,805   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-24T00:02:01,810   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-24T00:02:01,811   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-24T00:02:01,813   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-24T00:02:01,816   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-24T00:02:01,818   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,821   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-24T00:02:01,822   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-24T00:02:01,825   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-24T00:02:01,827   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-24T00:02:01,830   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-24T00:02:01,832   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-24T00:02:01,834   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,836   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,839   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-24T00:02:01,840   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-24T00:02:01,843   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-24T00:02:01,846   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-24T00:02:01,849   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-24T00:02:01,851   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-24T00:02:01,854   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-24T00:02:01,855   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-24T00:02:01,858   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-24T00:02:01,860   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-24T00:02:01,862   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,865   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,867   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,870   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-24T00:02:01,871   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-24T00:02:01,874   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-24T00:02:01,876   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-24T00:02:01,878   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-24T00:02:01,880   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-24T00:02:01,881   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-24T00:02:01,884   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-24T00:02:01,886   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-24T00:02:01,889   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-24T00:02:01,892   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-24T00:02:01,893   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-24T00:02:01,896   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-24T00:02:01,898   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-24T00:02:01,901   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-24T00:02:01,904   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,910   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,913   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,915   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-24T00:02:01,918   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-02-24T00:02:01,919   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-24T00:02:01,920   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-24T00:02:01,923   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-24T00:02:01,925   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-24T00:02:01,928   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,929   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,931   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,932   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,934   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,936   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,938   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,940   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,943   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,945   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,947   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-24T00:02:01,948   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-02-24T00:02:01,951   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-02-24T00:02:01,952   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-02-24T00:02:01,954   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-02-24T00:02:01,956   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-24T00:02:01,957   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-24T00:02:01,959   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-24T00:02:01,961   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-24T00:02:01,964   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-24T00:02:01,965   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-24T00:02:01,967   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-24T00:02:01,970   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-24T00:02:01,973   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-24T00:02:01,975   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-24T00:02:01,978   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-24T00:02:01,981   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-24T00:02:01,983   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-24T00:02:01,986   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-24T00:02:01,989   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-24T00:02:01,990   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-24T00:02:01,993   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-24T00:02:01,995   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-02-24T00:02:01,996   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-02-24T00:02:02,000   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-02-24T00:02:02,002   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-24T00:02:02,004   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-24T00:02:02,005   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-24T00:02:02,007   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-24T00:02:02,009   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-24T00:02:02,011   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-24T00:02:02,013   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-24T00:02:02,015   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-24T00:02:02,017   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-24T00:02:02,019   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-24T00:02:02,020   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-24T00:02:02,023   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-24T00:02:02,026   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-24T00:02:02,029   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-24T00:02:02,032   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-24T00:02:02,034   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-24T00:02:02,037   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-24T00:02:02,040   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-24T00:02:02,043   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-02-24T00:02:02,045   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-02-24T00:02:02,046   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-02-24T00:02:02,049   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-02-24T00:02:02,052   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-02-24T00:02:02,054   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-02-24T00:02:02,056   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:02,057   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:02,059   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:02,061   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:02,063   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:02,066   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-24T00:02:02,069   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-02-24T00:02:02,070   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-02-24T00:02:02,073   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-02-24T00:02:02,074   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-02-24T00:02:02,077   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-24T00:02:02,078   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-24T00:02:02,080   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-24T00:02:02,083   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-24T00:02:02,085   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-24T00:02:02,088   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-02-24T00:02:02,089   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:02,090   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:02,095   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:02,098   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:02,101   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:02,102   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:02,105   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:02,107   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:02,110   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:02,113   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:02,117   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:02,120   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-24T00:02:02,122   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:02,125   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-24T00:02:02,125   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-24T00:02:02,128   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-24T00:02:02,131   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-24T00:02:02,133   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-24T00:02:02,137   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-24T00:02:02,138   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-24T00:02:02,140   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-24T00:02:02,143   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:02,147   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:02,148   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:02,153   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:02,155   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:02,161   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:02,163   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:02,166   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:02,170   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-24T00:02:02,175   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-24T00:02:02,182   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-24T00:02:02,183   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-24T00:02:02,186   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-24T00:02:02,189   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-24T00:02:02,191   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-24T00:02:02,194   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-24T00:02:02,196   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-24T00:02:02,199   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-24T00:02:02,202   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-02-24T00:02:02,204   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-02-24T00:02:02,205   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-02-24T00:02:02,207   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-02-24T00:02:02,210   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-02-24T00:02:02,211   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-02-24T00:02:02,214   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,215   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,218   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,221   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,223   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,225   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,227   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,229   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,232   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,234   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,236   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,239   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,241   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,243   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,246   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,247   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,250   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,253   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,255   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,258   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,260   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,263   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,265   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,267   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,270   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,273   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,275   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,277   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,279   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,282   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-24T00:02:02,285   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-02-24T00:02:02,286   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-02-24T00:02:02,287   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-02-24T00:02:02,291   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,292   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,295   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,297   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,299   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,302   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,305   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,308   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,311   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,313   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,316   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,318   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-24T00:02:02,322   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:02,323   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:02,326   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:02,328   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:02,330   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:02,333   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:02,336   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-24T00:02:02,340   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-02-24T00:02:02,342   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-02-24T00:02:02,345   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-02-24T00:02:02,346   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-02-24T00:02:02,351   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-02-24T00:02:02,353   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-02-24T00:02:02,354   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-02-24T00:02:02,358   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-02-24T00:02:02,359   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-02-24T00:02:02,362   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-02-24T00:02:02,363   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-02-24T00:02:02,367   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-02-24T00:02:02,368   copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-02-24T00:02:02,371   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-24T00:02:02,373   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-24T00:02:02,376   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-24T00:02:02,380   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-24T00:02:02,383   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-24T00:02:02,386   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-24T00:02:02,390   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-24T00:02:02,394   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-02-24T00:02:02,396   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,397   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,402   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,405   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,407   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,411   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,414   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,417   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,419   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,422   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,425   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-24T00:02:02,428   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-24T00:02:02,429   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-24T00:02:02,433   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-24T00:02:02,436   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-24T00:02:02,439   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-24T00:02:02,442   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-24T00:02:02,447   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-24T00:02:02,448   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-24T00:02:02,451   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-24T00:02:02,453   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-24T00:02:02,456   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-24T00:02:02,458   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-24T00:02:02,462   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-24T00:02:02,463   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-24T00:02:02,467   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-24T00:02:02,469   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-24T00:02:02,472   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-24T00:02:02,475   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-02-24T00:02:02,476   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-02-24T00:02:02,480   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-02-24T00:02:02,483   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-02-24T00:02:02,485   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-02-24T00:02:02,489   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-24T00:02:02,491   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-24T00:02:02,502   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-24T00:02:02,505   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-24T00:02:02,509   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-24T00:02:02,513   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-24T00:02:02,517   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-02-24T00:02:02,519   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-02-24T00:02:02,523   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-02-24T00:02:02,526   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-02-24T00:02:02,529   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-02-24T00:02:02,533   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-24T00:02:02,534   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-24T00:02:02,537   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-24T00:02:02,544   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-24T00:02:02,548   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-24T00:02:02,551   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-24T00:02:02,556   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-24T00:02:02,557   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-24T00:02:02,561   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-24T00:02:02,564   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-24T00:02:02,567   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-24T00:02:02,570   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-24T00:02:02,574   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-24T00:02:02,581   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-02-24T00:02:02,586   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,587   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,593   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-24T00:02:02,594   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-24T00:02:02,597   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-24T00:02:02,601   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-24T00:02:02,603   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-24T00:02:02,606   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-24T00:02:02,609   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-24T00:02:02,611   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,614   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,616   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,619   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,622   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,625   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,628   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,631   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,635   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-24T00:02:02,637   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-24T00:02:02,639   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-24T00:02:02,641   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-24T00:02:02,644   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-24T00:02:02,647   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-24T00:02:02,649   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-24T00:02:02,652   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,655   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,657   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,660   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,662   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,664   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,667   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,670   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-24T00:02:02,671   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-24T00:02:02,673   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-24T00:02:02,676   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-24T00:02:02,678   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-24T00:02:02,681   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-24T00:02:02,683   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-24T00:02:02,685   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-24T00:02:02,687   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-24T00:02:02,690   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-24T00:02:02,693   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,696   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,700   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,702   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,705   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,708   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-24T00:02:02,709   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-24T00:02:02,712   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-24T00:02:02,714   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-24T00:02:02,717   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-24T00:02:02,720   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-24T00:02:02,722   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-24T00:02:02,725   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-02-24T00:02:02,726   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-02-24T00:02:02,730   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-02-24T00:02:02,733   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,734   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,738   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,740   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,744   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,746   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,749   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,752   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,755   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,758   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,762   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,763   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,766   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,768   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,771   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,774   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,776   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,779   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,782   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,785   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,788   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-24T00:02:02,791   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-24T00:02:02,794   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,796   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,800   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,802   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,805   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,810   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,812   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,814   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,817   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,819   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,821   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-24T00:02:02,824   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-24T00:02:02,825   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-24T00:02:02,827   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-24T00:02:02,830   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-24T00:02:02,832   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-24T00:02:02,835   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-02-24T00:02:02,836   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-02-24T00:02:02,838   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-02-24T00:02:02,841   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-02-24T00:02:02,841   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-02-24T00:02:02,843   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-02-24T00:02:02,846   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-02-24T00:02:02,847   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-02-24T00:02:02,850   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-02-24T00:02:02,853   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-24T00:02:02,854   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-24T00:02:02,857   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-24T00:02:02,859   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-24T00:02:02,862   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-24T00:02:02,865   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-24T00:02:02,866   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-24T00:02:02,871   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-24T00:02:02,871   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-24T00:02:02,874   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-24T00:02:02,876   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-24T00:02:02,878   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-24T00:02:02,880   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-24T00:02:02,882   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-24T00:02:02,884   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-24T00:02:02,887   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-24T00:02:02,892   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-24T00:02:02,894   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-24T00:02:02,895   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-24T00:02:02,897   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-24T00:02:02,899   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-24T00:02:02,901   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-24T00:02:02,903   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-24T00:02:02,906   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-24T00:02:02,909   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-24T00:02:02,912   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-24T00:02:02,913   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-24T00:02:02,916   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-24T00:02:02,919   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-24T00:02:02,921   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-24T00:02:02,923   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-24T00:02:02,926   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-24T00:02:02,929   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-24T00:02:02,930   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-24T00:02:02,933   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-24T00:02:02,934   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-24T00:02:02,937   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-24T00:02:02,939   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-24T00:02:02,943   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-24T00:02:02,946   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-24T00:02:02,948   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-24T00:02:02,950   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-24T00:02:02,952   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,953   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,956   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,959   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,962   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,964   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,966   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,970   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,972   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,974   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,977   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-24T00:02:02,980   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-24T00:02:02,983   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-24T00:02:02,985   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-24T00:02:02,986   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-24T00:02:02,989   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-24T00:02:02,992   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-24T00:02:02,994   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-24T00:02:02,996   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-24T00:02:02,999   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-24T00:02:03,002   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-24T00:02:03,005   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-24T00:02:03,007   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-24T00:02:03,009   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-24T00:02:03,010   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-24T00:02:03,013   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-24T00:02:03,015   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-24T00:02:03,018   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-24T00:02:03,021   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-24T00:02:03,022   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-24T00:02:03,024   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-24T00:02:03,026   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-24T00:02:03,029   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-24T00:02:03,032   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-24T00:02:03,033   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-24T00:02:03,035   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-24T00:02:03,038   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-24T00:02:03,040   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-24T00:02:03,043   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-24T00:02:03,044   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-24T00:02:03,046   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-24T00:02:03,049   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-24T00:02:03,051   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-24T00:02:03,054   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-24T00:02:03,056   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-24T00:02:03,059   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-24T00:02:03,062   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-24T00:02:03,065   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-24T00:02:03,066   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-24T00:02:03,069   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-24T00:02:03,071   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-24T00:02:03,074   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-24T00:02:03,077   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-24T00:02:03,078   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-24T00:02:03,080   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-24T00:02:03,082   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-24T00:02:03,084   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-24T00:02:03,087   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:02:03,088   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:02:03,091   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:02:03,094   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:02:03,096   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:02:03,097   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:02:03,100   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:02:03,102   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:02:03,105   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:02:03,107   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-24T00:02:03,110   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-24T00:02:03,114   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-24T00:02:03,115   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-24T00:02:03,121   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-24T00:02:03,124   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-24T00:02:03,127   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-24T00:02:03,129   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-24T00:02:03,133   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:02:03,135   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:02:03,139   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:02:03,141   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:02:03,144   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:02:03,146   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:02:03,149   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:02:03,151   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:02:03,154   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:02:03,156   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-24T00:02:03,159   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-24T00:02:03,163   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-24T00:02:03,164   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-24T00:02:03,167   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-24T00:02:03,171   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-02-24T00:02:03,172   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-02-24T00:02:03,174   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-02-24T00:02:03,176   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-02-24T00:02:03,178   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-24T00:02:03,179   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-24T00:02:03,182   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-24T00:02:03,184   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-24T00:02:03,187   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-02-24T00:02:03,188   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-02-24T00:02:03,191   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-02-24T00:02:03,194   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-02-24T00:02:03,195   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-02-24T00:02:03,197   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-02-24T00:02:03,200   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-02-24T00:02:03,204   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-02-24T00:02:03,207   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-02-24T00:02:03,210   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-24T00:02:03,211   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-24T00:02:03,213   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-24T00:02:03,215   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-02-24T00:02:03,218   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-02-24T00:02:03,219   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-02-24T00:02:03,221   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-02-24T00:02:03,224   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-24T00:02:03,226   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-24T00:02:03,230   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-24T00:02:03,231   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-24T00:02:03,234   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-24T00:02:03,236   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-24T00:02:03,241   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-24T00:02:03,243   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-24T00:02:03,245   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-24T00:02:03,247   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-24T00:02:03,250   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:02:03,251   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:02:03,254   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:02:03,257   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:02:03,259   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:02:03,261   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:02:03,264   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:02:03,266   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:02:03,269   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-24T00:02:03,272   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-24T00:02:03,274   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-24T00:02:03,277   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-24T00:02:03,279   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-02-24T00:02:03,280   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-02-24T00:02:03,282   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-02-24T00:02:03,285   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-24T00:02:03,288   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-02-24T00:02:03,289   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-02-24T00:02:03,292   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-24T00:02:03,294   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-24T00:02:03,297   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-24T00:02:03,300   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-24T00:02:03,302   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-24T00:02:03,305   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-24T00:02:03,307   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-24T00:02:03,310   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-02-24T00:02:03,312   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-24T00:02:03,313   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:02:03,314   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:02:03,317   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:02:03,319   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:02:03,321   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:02:03,323   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:02:03,325   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-24T00:02:03,328   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-24T00:02:03,329   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-24T00:02:03,331   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-24T00:02:03,336   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:02:03,337   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:02:03,340   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:02:03,345   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:02:03,348   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:02:03,350   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-24T00:02:03,352   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-24T00:02:03,354   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:03,355   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:03,359   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:03,364   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:03,367   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:03,369   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-24T00:02:03,372   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-02-24T00:02:03,374   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-24T00:02:03,375   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-24T00:02:03,378   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-24T00:02:03,380   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-24T00:02:03,383   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-24T00:02:03,386   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:03,386   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:03,389   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:03,391   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:03,393   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:03,395   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:03,397   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:03,400   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-24T00:02:03,403   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:02:03,404   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:02:03,406   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:02:03,408   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:02:03,410   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:02:03,413   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-24T00:02:03,415   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:02:03,417   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:02:03,420   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:02:03,422   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:02:03,424   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:02:03,426   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-24T00:02:03,428   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-02-24T00:02:03,430   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-02-24T00:02:03,433   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:03,434   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:03,436   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:03,439   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:03,441   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:03,443   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:03,446   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:03,450   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:03,457   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-24T00:02:03,459   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-02-24T00:02:03,461   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-02-24T00:02:03,464   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-02-24T00:02:03,466   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:03,467   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:03,470   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:03,472   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:03,474   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:03,476   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:03,478   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-24T00:02:03,481   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:03,482   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:03,484   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:03,487   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:03,489   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:03,492   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:03,495   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-24T00:02:03,498   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-24T00:02:03,499   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-24T00:02:03,503   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:03,505   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:03,508   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:03,511   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:03,514   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:03,516   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:03,520   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-24T00:02:03,523   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-02-24T00:02:03,526   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-02-24T00:02:03,529   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-24T00:02:03,531   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-24T00:02:03,534   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-24T00:02:03,536   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-24T00:02:03,540   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:03,541   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:03,545   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:03,548   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:03,551   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:03,554   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:03,557   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:03,559   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:03,563   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-24T00:02:03,567   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-24T00:02:03,569   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-24T00:02:03,572   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-24T00:02:03,575   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-24T00:02:03,578   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-24T00:02:03,581   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:03,583   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:03,586   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:03,589   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:03,593   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:03,595   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:03,597   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-24T00:02:03,600   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:03,602   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:03,604   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:03,609   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:03,611   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:03,614   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:03,617   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-24T00:02:03,620   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:03,621   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:03,624   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:03,628   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:03,630   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:03,633   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:03,636   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-24T00:02:03,638   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-24T00:02:03,640   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-24T00:02:03,643   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-24T00:02:03,645   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-24T00:02:03,648   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-24T00:02:03,650   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-24T00:02:03,652   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-24T00:02:03,655   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-24T00:02:03,657   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-24T00:02:03,659   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-24T00:02:03,662   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-24T00:02:03,664   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-24T00:02:03,668   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-24T00:02:03,669   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-24T00:02:03,672   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-24T00:02:03,676   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-24T00:02:03,678   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-24T00:02:03,681   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-24T00:02:03,684   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-24T00:02:03,687   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-24T00:02:03,690   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-02-24T00:02:03,691   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-02-24T00:02:03,694   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-02-24T00:02:03,700   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,701   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,703   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,707   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,710   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,714   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,716   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,719   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,723   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,726   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,728   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,731   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,733   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,736   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,738   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,740   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-24T00:02:03,743   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-24T00:02:03,745   running install_egg_info
2024-02-24T00:02:03,777   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.13.3-py3.11.egg-info
2024-02-24T00:02:03,792   running install_scripts
2024-02-24T00:02:03,793   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data
2024-02-24T00:02:03,794   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts
2024-02-24T00:02:03,795   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts
2024-02-24T00:02:03,797   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts
2024-02-24T00:02:03,799   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts
2024-02-24T00:02:03,801   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts
2024-02-24T00:02:03,802   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts
2024-02-24T00:02:03,805   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts
2024-02-24T00:02:03,806   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts
2024-02-24T00:02:03,808   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts
2024-02-24T00:02:03,810   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts/dsr to 755
2024-02-24T00:02:03,810   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts/ds to 755
2024-02-24T00:02:03,811   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts/ds_ssh to 755
2024-02-24T00:02:03,812   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts/ds_report to 755
2024-02-24T00:02:03,812   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts/ds_elastic to 755
2024-02-24T00:02:03,813   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts/ds_bench to 755
2024-02-24T00:02:03,814   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts/deepspeed to 755
2024-02-24T00:02:03,814   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.data/scripts/deepspeed.pt to 755
2024-02-24T00:02:03,858   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.3.dist-info/WHEEL
2024-02-24T00:02:03,862   creating '/tmp/pip-wheel-ynk33sb7/deepspeed-0.13.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-02-24T00:02:03,865   adding 'deepspeed/__init__.py'
2024-02-24T00:02:03,867   adding 'deepspeed/constants.py'
2024-02-24T00:02:03,869   adding 'deepspeed/env_report.py'
2024-02-24T00:02:03,870   adding 'deepspeed/git_version_info.py'
2024-02-24T00:02:03,871   adding 'deepspeed/git_version_info_installed.py'
2024-02-24T00:02:03,873   adding 'deepspeed/pydantic_v1.py'
2024-02-24T00:02:03,875   adding 'deepspeed/accelerator/__init__.py'
2024-02-24T00:02:03,876   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-02-24T00:02:03,878   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-02-24T00:02:03,879   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-02-24T00:02:03,881   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-02-24T00:02:03,882   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-02-24T00:02:03,884   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-02-24T00:02:03,886   adding 'deepspeed/accelerator/real_accelerator.py'
2024-02-24T00:02:03,887   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-02-24T00:02:03,889   adding 'deepspeed/autotuning/__init__.py'
2024-02-24T00:02:03,895   adding 'deepspeed/autotuning/autotuner.py'
2024-02-24T00:02:03,896   adding 'deepspeed/autotuning/config.py'
2024-02-24T00:02:03,898   adding 'deepspeed/autotuning/constants.py'
2024-02-24T00:02:03,903   adding 'deepspeed/autotuning/scheduler.py'
2024-02-24T00:02:03,905   adding 'deepspeed/autotuning/utils.py'
2024-02-24T00:02:03,906   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-02-24T00:02:03,908   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-02-24T00:02:03,909   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-02-24T00:02:03,910   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-02-24T00:02:03,912   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-02-24T00:02:03,913   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-02-24T00:02:03,914   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-02-24T00:02:03,916   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-02-24T00:02:03,917   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-02-24T00:02:03,919   adding 'deepspeed/autotuning/tuner/utils.py'
2024-02-24T00:02:03,921   adding 'deepspeed/checkpoint/__init__.py'
2024-02-24T00:02:03,922   adding 'deepspeed/checkpoint/constants.py'
2024-02-24T00:02:03,924   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-02-24T00:02:03,926   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-02-24T00:02:03,928   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-02-24T00:02:03,929   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-02-24T00:02:03,931   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-02-24T00:02:03,932   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-02-24T00:02:03,934   adding 'deepspeed/checkpoint/utils.py'
2024-02-24T00:02:03,935   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-02-24T00:02:03,937   adding 'deepspeed/comm/__init__.py'
2024-02-24T00:02:03,939   adding 'deepspeed/comm/backend.py'
2024-02-24T00:02:03,940   adding 'deepspeed/comm/ccl.py'
2024-02-24T00:02:03,944   adding 'deepspeed/comm/comm.py'
2024-02-24T00:02:03,945   adding 'deepspeed/comm/config.py'
2024-02-24T00:02:03,946   adding 'deepspeed/comm/constants.py'
2024-02-24T00:02:03,947   adding 'deepspeed/comm/reduce_op.py'
2024-02-24T00:02:03,950   adding 'deepspeed/comm/torch.py'
2024-02-24T00:02:03,951   adding 'deepspeed/comm/utils.py'
2024-02-24T00:02:03,953   adding 'deepspeed/compression/__init__.py'
2024-02-24T00:02:03,956   adding 'deepspeed/compression/basic_layer.py'
2024-02-24T00:02:03,958   adding 'deepspeed/compression/compress.py'
2024-02-24T00:02:03,960   adding 'deepspeed/compression/config.py'
2024-02-24T00:02:03,962   adding 'deepspeed/compression/constants.py'
2024-02-24T00:02:03,964   adding 'deepspeed/compression/helper.py'
2024-02-24T00:02:03,966   adding 'deepspeed/compression/scheduler.py'
2024-02-24T00:02:03,967   adding 'deepspeed/compression/utils.py'
2024-02-24T00:02:03,969   adding 'deepspeed/elasticity/__init__.py'
2024-02-24T00:02:03,971   adding 'deepspeed/elasticity/config.py'
2024-02-24T00:02:03,972   adding 'deepspeed/elasticity/constants.py'
2024-02-24T00:02:03,974   adding 'deepspeed/elasticity/elastic_agent.py'
2024-02-24T00:02:03,976   adding 'deepspeed/elasticity/elasticity.py'
2024-02-24T00:02:03,978   adding 'deepspeed/elasticity/utils.py'
2024-02-24T00:02:03,980   adding 'deepspeed/inference/__init__.py'
2024-02-24T00:02:03,982   adding 'deepspeed/inference/config.py'
2024-02-24T00:02:03,985   adding 'deepspeed/inference/engine.py'
2024-02-24T00:02:03,987   adding 'deepspeed/inference/quantization/__init__.py'
2024-02-24T00:02:03,989   adding 'deepspeed/inference/quantization/layers.py'
2024-02-24T00:02:03,990   adding 'deepspeed/inference/quantization/quantization.py'
2024-02-24T00:02:03,991   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-02-24T00:02:03,993   adding 'deepspeed/inference/quantization/utils.py'
2024-02-24T00:02:03,995   adding 'deepspeed/inference/v2/__init__.py'
2024-02-24T00:02:03,997   adding 'deepspeed/inference/v2/allocator.py'
2024-02-24T00:02:03,998   adding 'deepspeed/inference/v2/config_v2.py'
2024-02-24T00:02:04,000   adding 'deepspeed/inference/v2/engine_factory.py'
2024-02-24T00:02:04,001   adding 'deepspeed/inference/v2/engine_v2.py'
2024-02-24T00:02:04,003   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-02-24T00:02:04,005   adding 'deepspeed/inference/v2/inference_utils.py'
2024-02-24T00:02:04,006   adding 'deepspeed/inference/v2/logging.py'
2024-02-24T00:02:04,007   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-02-24T00:02:04,009   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-02-24T00:02:04,011   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-02-24T00:02:04,012   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-02-24T00:02:04,014   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-02-24T00:02:04,015   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-02-24T00:02:04,017   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-02-24T00:02:04,019   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-02-24T00:02:04,020   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-02-24T00:02:04,022   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-02-24T00:02:04,024   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-02-24T00:02:04,025   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-02-24T00:02:04,026   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-02-24T00:02:04,028   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-02-24T00:02:04,030   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-02-24T00:02:04,031   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-02-24T00:02:04,033   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-02-24T00:02:04,034   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-02-24T00:02:04,036   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-02-24T00:02:04,038   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-02-24T00:02:04,039   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-02-24T00:02:04,044   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-02-24T00:02:04,045   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-02-24T00:02:04,047   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-02-24T00:02:04,048   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-02-24T00:02:04,050   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-02-24T00:02:04,052   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-02-24T00:02:04,054   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-02-24T00:02:04,055   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-02-24T00:02:04,057   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-02-24T00:02:04,058   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-02-24T00:02:04,060   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-02-24T00:02:04,062   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-02-24T00:02:04,063   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-02-24T00:02:04,064   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-02-24T00:02:04,066   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-02-24T00:02:04,067   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-02-24T00:02:04,069   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-02-24T00:02:04,071   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-02-24T00:02:04,072   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-02-24T00:02:04,074   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-02-24T00:02:04,076   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-02-24T00:02:04,077   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-02-24T00:02:04,078   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-02-24T00:02:04,079   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-02-24T00:02:04,081   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-02-24T00:02:04,083   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-02-24T00:02:04,087   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-02-24T00:02:04,089   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-02-24T00:02:04,090   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-02-24T00:02:04,091   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-02-24T00:02:04,093   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-02-24T00:02:04,095   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-02-24T00:02:04,097   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-02-24T00:02:04,098   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-02-24T00:02:04,101   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-02-24T00:02:04,103   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-02-24T00:02:04,106   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-02-24T00:02:04,107   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-02-24T00:02:04,109   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-02-24T00:02:04,110   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-02-24T00:02:04,112   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-02-24T00:02:04,114   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-02-24T00:02:04,115   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-02-24T00:02:04,117   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-02-24T00:02:04,119   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-02-24T00:02:04,120   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-02-24T00:02:04,121   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-02-24T00:02:04,123   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-02-24T00:02:04,125   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-02-24T00:02:04,126   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-02-24T00:02:04,127   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-02-24T00:02:04,128   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-02-24T00:02:04,130   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-02-24T00:02:04,131   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-02-24T00:02:04,133   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-02-24T00:02:04,135   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-02-24T00:02:04,137   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-02-24T00:02:04,138   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-02-24T00:02:04,139   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-02-24T00:02:04,141   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-02-24T00:02:04,143   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-02-24T00:02:04,144   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-02-24T00:02:04,146   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-02-24T00:02:04,148   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-02-24T00:02:04,149   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-02-24T00:02:04,150   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-02-24T00:02:04,151   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-02-24T00:02:04,153   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-02-24T00:02:04,155   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-02-24T00:02:04,157   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-02-24T00:02:04,158   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-02-24T00:02:04,160   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-02-24T00:02:04,161   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-02-24T00:02:04,162   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-02-24T00:02:04,164   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-02-24T00:02:04,166   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-02-24T00:02:04,167   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-02-24T00:02:04,168   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-02-24T00:02:04,170   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-02-24T00:02:04,171   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-02-24T00:02:04,173   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-02-24T00:02:04,175   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-02-24T00:02:04,177   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-02-24T00:02:04,178   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-02-24T00:02:04,180   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-02-24T00:02:04,181   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-02-24T00:02:04,182   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-02-24T00:02:04,183   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-02-24T00:02:04,185   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-02-24T00:02:04,186   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-02-24T00:02:04,188   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-02-24T00:02:04,190   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-02-24T00:02:04,192   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-02-24T00:02:04,194   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-02-24T00:02:04,196   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-02-24T00:02:04,198   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-02-24T00:02:04,200   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-02-24T00:02:04,202   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-02-24T00:02:04,203   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-02-24T00:02:04,204   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-02-24T00:02:04,205   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-02-24T00:02:04,206   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-02-24T00:02:04,208   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-02-24T00:02:04,209   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-02-24T00:02:04,211   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-02-24T00:02:04,212   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-02-24T00:02:04,214   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-02-24T00:02:04,215   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-02-24T00:02:04,216   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-02-24T00:02:04,218   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-02-24T00:02:04,219   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-02-24T00:02:04,221   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-02-24T00:02:04,223   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-02-24T00:02:04,224   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-02-24T00:02:04,226   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-02-24T00:02:04,227   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-02-24T00:02:04,229   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-02-24T00:02:04,231   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-02-24T00:02:04,232   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-02-24T00:02:04,233   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-02-24T00:02:04,235   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-02-24T00:02:04,237   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-02-24T00:02:04,238   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-02-24T00:02:04,240   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-02-24T00:02:04,241   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-02-24T00:02:04,243   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-02-24T00:02:04,245   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-02-24T00:02:04,247   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-02-24T00:02:04,248   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-02-24T00:02:04,249   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-02-24T00:02:04,251   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-02-24T00:02:04,252   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-02-24T00:02:04,254   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-02-24T00:02:04,255   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-02-24T00:02:04,257   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-02-24T00:02:04,258   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-02-24T00:02:04,260   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-02-24T00:02:04,261   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-02-24T00:02:04,263   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-02-24T00:02:04,264   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-02-24T00:02:04,266   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-02-24T00:02:04,267   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-02-24T00:02:04,269   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-02-24T00:02:04,271   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-02-24T00:02:04,273   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-02-24T00:02:04,274   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-02-24T00:02:04,276   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-02-24T00:02:04,278   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-02-24T00:02:04,279   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-02-24T00:02:04,281   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-02-24T00:02:04,282   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-02-24T00:02:04,283   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-02-24T00:02:04,285   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-02-24T00:02:04,286   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-02-24T00:02:04,288   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-02-24T00:02:04,289   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-02-24T00:02:04,291   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-02-24T00:02:04,293   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-02-24T00:02:04,295   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-02-24T00:02:04,297   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-02-24T00:02:04,299   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-02-24T00:02:04,300   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-02-24T00:02:04,303   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-02-24T00:02:04,304   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-02-24T00:02:04,306   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-02-24T00:02:04,308   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-02-24T00:02:04,310   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-02-24T00:02:04,311   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-02-24T00:02:04,313   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-02-24T00:02:04,314   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-02-24T00:02:04,317   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-02-24T00:02:04,318   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-02-24T00:02:04,319   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-02-24T00:02:04,321   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-02-24T00:02:04,322   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-02-24T00:02:04,323   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-02-24T00:02:04,325   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-02-24T00:02:04,326   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-02-24T00:02:04,328   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-02-24T00:02:04,329   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-02-24T00:02:04,331   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-02-24T00:02:04,333   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-02-24T00:02:04,335   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-02-24T00:02:04,337   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-02-24T00:02:04,339   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-02-24T00:02:04,341   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-02-24T00:02:04,342   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-02-24T00:02:04,345   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-02-24T00:02:04,347   adding 'deepspeed/launcher/__init__.py'
2024-02-24T00:02:04,348   adding 'deepspeed/launcher/constants.py'
2024-02-24T00:02:04,350   adding 'deepspeed/launcher/launch.py'
2024-02-24T00:02:04,352   adding 'deepspeed/launcher/launcher_helper.py'
2024-02-24T00:02:04,354   adding 'deepspeed/launcher/multinode_runner.py'
2024-02-24T00:02:04,357   adding 'deepspeed/launcher/runner.py'
2024-02-24T00:02:04,359   adding 'deepspeed/model_implementations/__init__.py'
2024-02-24T00:02:04,361   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-02-24T00:02:04,363   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-02-24T00:02:04,364   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-02-24T00:02:04,366   adding 'deepspeed/model_implementations/features/__init__.py'
2024-02-24T00:02:04,367   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-02-24T00:02:04,369   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-02-24T00:02:04,371   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-02-24T00:02:04,372   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-02-24T00:02:04,373   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-02-24T00:02:04,374   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-02-24T00:02:04,376   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-02-24T00:02:04,377   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-02-24T00:02:04,378   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-02-24T00:02:04,380   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-02-24T00:02:04,381   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-02-24T00:02:04,383   adding 'deepspeed/module_inject/__init__.py'
2024-02-24T00:02:04,386   adding 'deepspeed/module_inject/auto_tp.py'
2024-02-24T00:02:04,388   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-02-24T00:02:04,389   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-02-24T00:02:04,391   adding 'deepspeed/module_inject/inject.py'
2024-02-24T00:02:04,392   adding 'deepspeed/module_inject/layers.py'
2024-02-24T00:02:04,394   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-02-24T00:02:04,396   adding 'deepspeed/module_inject/module_quantize.py'
2024-02-24T00:02:04,397   adding 'deepspeed/module_inject/policy.py'
2024-02-24T00:02:04,401   adding 'deepspeed/module_inject/replace_module.py'
2024-02-24T00:02:04,402   adding 'deepspeed/module_inject/replace_policy.py'
2024-02-24T00:02:04,403   adding 'deepspeed/module_inject/tp_shard.py'
2024-02-24T00:02:04,405   adding 'deepspeed/module_inject/utils.py'
2024-02-24T00:02:04,407   adding 'deepspeed/module_inject/containers/__init__.py'
2024-02-24T00:02:04,409   adding 'deepspeed/module_inject/containers/base.py'
2024-02-24T00:02:04,410   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-02-24T00:02:04,412   adding 'deepspeed/module_inject/containers/bert.py'
2024-02-24T00:02:04,413   adding 'deepspeed/module_inject/containers/bloom.py'
2024-02-24T00:02:04,417   adding 'deepspeed/module_inject/containers/clip.py'
2024-02-24T00:02:04,418   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-02-24T00:02:04,420   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-02-24T00:02:04,421   adding 'deepspeed/module_inject/containers/gptj.py'
2024-02-24T00:02:04,423   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-02-24T00:02:04,424   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-02-24T00:02:04,425   adding 'deepspeed/module_inject/containers/internlm.py'
2024-02-24T00:02:04,427   adding 'deepspeed/module_inject/containers/llama.py'
2024-02-24T00:02:04,428   adding 'deepspeed/module_inject/containers/llama2.py'
2024-02-24T00:02:04,430   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-02-24T00:02:04,431   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-02-24T00:02:04,433   adding 'deepspeed/module_inject/containers/opt.py'
2024-02-24T00:02:04,434   adding 'deepspeed/module_inject/containers/unet.py'
2024-02-24T00:02:04,435   adding 'deepspeed/module_inject/containers/vae.py'
2024-02-24T00:02:04,437   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-02-24T00:02:04,439   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-02-24T00:02:04,441   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-02-24T00:02:04,442   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-02-24T00:02:04,443   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-02-24T00:02:04,445   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-02-24T00:02:04,446   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-02-24T00:02:04,448   adding 'deepspeed/moe/__init__.py'
2024-02-24T00:02:04,449   adding 'deepspeed/moe/experts.py'
2024-02-24T00:02:04,451   adding 'deepspeed/moe/layer.py'
2024-02-24T00:02:04,453   adding 'deepspeed/moe/mappings.py'
2024-02-24T00:02:04,455   adding 'deepspeed/moe/sharded_moe.py'
2024-02-24T00:02:04,457   adding 'deepspeed/moe/utils.py'
2024-02-24T00:02:04,459   adding 'deepspeed/monitor/__init__.py'
2024-02-24T00:02:04,461   adding 'deepspeed/monitor/config.py'
2024-02-24T00:02:04,462   adding 'deepspeed/monitor/csv_monitor.py'
2024-02-24T00:02:04,463   adding 'deepspeed/monitor/monitor.py'
2024-02-24T00:02:04,465   adding 'deepspeed/monitor/tensorboard.py'
2024-02-24T00:02:04,466   adding 'deepspeed/monitor/utils.py'
2024-02-24T00:02:04,467   adding 'deepspeed/monitor/wandb.py'
2024-02-24T00:02:04,469   adding 'deepspeed/nebula/__init__.py'
2024-02-24T00:02:04,470   adding 'deepspeed/nebula/config.py'
2024-02-24T00:02:04,472   adding 'deepspeed/nebula/constants.py'
2024-02-24T00:02:04,474   adding 'deepspeed/ops/__init__.py'
2024-02-24T00:02:04,475   adding 'deepspeed/ops/adagrad/__init__.py'
2024-02-24T00:02:04,482   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-02-24T00:02:04,484   adding 'deepspeed/ops/adam/__init__.py'
2024-02-24T00:02:04,485   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-02-24T00:02:04,488   adding 'deepspeed/ops/adam/fused_adam.py'
2024-02-24T00:02:04,489   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-02-24T00:02:04,490   adding 'deepspeed/ops/aio/__init__.py'
2024-02-24T00:02:04,493   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-02-24T00:02:04,495   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-02-24T00:02:04,497   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-02-24T00:02:04,498   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-02-24T00:02:04,499   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-02-24T00:02:04,501   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-02-24T00:02:04,504   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-02-24T00:02:04,505   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-02-24T00:02:04,506   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-02-24T00:02:04,507   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-02-24T00:02:04,509   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-02-24T00:02:04,510   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-02-24T00:02:04,512   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-02-24T00:02:04,513   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-02-24T00:02:04,514   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-02-24T00:02:04,516   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-02-24T00:02:04,517   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-02-24T00:02:04,519   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-02-24T00:02:04,520   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-02-24T00:02:04,522   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-02-24T00:02:04,523   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-02-24T00:02:04,524   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-02-24T00:02:04,526   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-02-24T00:02:04,527   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-02-24T00:02:04,529   adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu'
2024-02-24T00:02:04,531   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-02-24T00:02:04,534   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-02-24T00:02:04,536   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-02-24T00:02:04,538   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-02-24T00:02:04,540   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-02-24T00:02:04,542   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-02-24T00:02:04,544   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-02-24T00:02:04,552   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-02-24T00:02:04,557   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-02-24T00:02:04,559   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-02-24T00:02:04,562   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-02-24T00:02:04,564   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-02-24T00:02:04,565   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-02-24T00:02:04,567   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-02-24T00:02:04,569   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-02-24T00:02:04,572   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-02-24T00:02:04,574   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-02-24T00:02:04,576   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-02-24T00:02:04,578   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-02-24T00:02:04,585   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-02-24T00:02:04,589   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-02-24T00:02:04,590   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-02-24T00:02:04,594   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-02-24T00:02:04,598   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-02-24T00:02:04,602   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-02-24T00:02:04,603   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-02-24T00:02:04,605   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-02-24T00:02:04,607   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-02-24T00:02:04,609   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-02-24T00:02:04,611   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-02-24T00:02:04,612   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-02-24T00:02:04,613   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-02-24T00:02:04,614   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-02-24T00:02:04,615   adding 'deepspeed/ops/csrc/includes/context.h'
2024-02-24T00:02:04,617   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-02-24T00:02:04,619   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-02-24T00:02:04,620   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-02-24T00:02:04,622   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-02-24T00:02:04,623   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-02-24T00:02:04,625   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-02-24T00:02:04,627   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-02-24T00:02:04,628   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-02-24T00:02:04,629   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-02-24T00:02:04,631   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-02-24T00:02:04,633   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-02-24T00:02:04,635   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-02-24T00:02:04,636   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-02-24T00:02:04,637   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-02-24T00:02:04,640   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-02-24T00:02:04,642   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-02-24T00:02:04,643   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-02-24T00:02:04,645   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-02-24T00:02:04,647   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-02-24T00:02:04,649   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-02-24T00:02:04,651   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-02-24T00:02:04,652   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-02-24T00:02:04,654   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-02-24T00:02:04,655   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-02-24T00:02:04,657   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-02-24T00:02:04,659   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-02-24T00:02:04,661   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-02-24T00:02:04,663   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-02-24T00:02:04,664   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-02-24T00:02:04,665   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-02-24T00:02:04,667   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-02-24T00:02:04,669   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-02-24T00:02:04,672   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-02-24T00:02:04,674   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-02-24T00:02:04,676   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-02-24T00:02:04,677   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-02-24T00:02:04,679   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-02-24T00:02:04,681   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-02-24T00:02:04,683   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-02-24T00:02:04,684   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-02-24T00:02:04,685   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-02-24T00:02:04,687   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-02-24T00:02:04,689   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-02-24T00:02:04,691   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-02-24T00:02:04,693   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-02-24T00:02:04,695   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-02-24T00:02:04,698   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-02-24T00:02:04,700   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-02-24T00:02:04,704   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-02-24T00:02:04,706   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-02-24T00:02:04,708   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-02-24T00:02:04,712   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-02-24T00:02:04,715   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-02-24T00:02:04,717   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-02-24T00:02:04,720   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-02-24T00:02:04,722   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-02-24T00:02:04,724   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-02-24T00:02:04,727   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-02-24T00:02:04,728   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-02-24T00:02:04,734   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-02-24T00:02:04,735   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-02-24T00:02:04,737   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-02-24T00:02:04,739   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-02-24T00:02:04,742   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-02-24T00:02:04,745   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-02-24T00:02:04,747   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-02-24T00:02:04,749   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-02-24T00:02:04,751   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-02-24T00:02:04,754   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-02-24T00:02:04,755   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp'
2024-02-24T00:02:04,757   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp'
2024-02-24T00:02:04,758   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-02-24T00:02:04,760   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-02-24T00:02:04,762   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-02-24T00:02:04,764   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-02-24T00:02:04,765   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-02-24T00:02:04,767   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-02-24T00:02:04,768   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-02-24T00:02:04,769   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-02-24T00:02:04,771   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-02-24T00:02:04,773   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-02-24T00:02:04,774   adding 'deepspeed/ops/lamb/__init__.py'
2024-02-24T00:02:04,776   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-02-24T00:02:04,780   adding 'deepspeed/ops/lion/__init__.py'
2024-02-24T00:02:04,781   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-02-24T00:02:04,783   adding 'deepspeed/ops/lion/fused_lion.py'
2024-02-24T00:02:04,784   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-02-24T00:02:04,786   adding 'deepspeed/ops/op_builder/__init__.py'
2024-02-24T00:02:04,787   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-02-24T00:02:04,789   adding 'deepspeed/ops/op_builder/async_io.py'
2024-02-24T00:02:04,792   adding 'deepspeed/ops/op_builder/builder.py'
2024-02-24T00:02:04,793   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-02-24T00:02:04,795   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-02-24T00:02:04,796   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-02-24T00:02:04,798   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-02-24T00:02:04,799   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-02-24T00:02:04,800   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-02-24T00:02:04,801   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-02-24T00:02:04,802   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-02-24T00:02:04,804   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-02-24T00:02:04,805   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-02-24T00:02:04,806   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-02-24T00:02:04,808   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-02-24T00:02:04,809   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-02-24T00:02:04,810   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-02-24T00:02:04,812   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-02-24T00:02:04,813   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-02-24T00:02:04,814   adding 'deepspeed/ops/op_builder/transformer.py'
2024-02-24T00:02:04,815   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-02-24T00:02:04,817   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-02-24T00:02:04,818   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-02-24T00:02:04,820   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-02-24T00:02:04,821   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-02-24T00:02:04,822   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-02-24T00:02:04,823   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-02-24T00:02:04,825   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-02-24T00:02:04,826   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-02-24T00:02:04,828   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-02-24T00:02:04,829   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-02-24T00:02:04,830   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-02-24T00:02:04,832   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-02-24T00:02:04,833   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-02-24T00:02:04,835   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-02-24T00:02:04,836   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-02-24T00:02:04,837   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-02-24T00:02:04,839   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-02-24T00:02:04,840   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-02-24T00:02:04,842   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-02-24T00:02:04,844   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-02-24T00:02:04,846   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-02-24T00:02:04,847   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-02-24T00:02:04,848   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-02-24T00:02:04,850   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-02-24T00:02:04,851   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-02-24T00:02:04,852   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-02-24T00:02:04,853   adding 'deepspeed/ops/quantizer/__init__.py'
2024-02-24T00:02:04,854   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-02-24T00:02:04,856   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-02-24T00:02:04,858   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-02-24T00:02:04,859   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-02-24T00:02:04,861   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-02-24T00:02:04,864   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-02-24T00:02:04,866   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-02-24T00:02:04,868   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-02-24T00:02:04,870   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-02-24T00:02:04,873   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-02-24T00:02:04,876   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-02-24T00:02:04,877   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-02-24T00:02:04,878   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-02-24T00:02:04,880   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-02-24T00:02:04,882   adding 'deepspeed/ops/transformer/__init__.py'
2024-02-24T00:02:04,884   adding 'deepspeed/ops/transformer/transformer.py'
2024-02-24T00:02:04,886   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-02-24T00:02:04,888   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-02-24T00:02:04,889   adding 'deepspeed/ops/transformer/inference/config.py'
2024-02-24T00:02:04,891   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-02-24T00:02:04,892   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-02-24T00:02:04,894   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-02-24T00:02:04,896   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-02-24T00:02:04,897   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-02-24T00:02:04,900   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-02-24T00:02:04,901   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-02-24T00:02:04,903   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-02-24T00:02:04,905   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-02-24T00:02:04,906   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-02-24T00:02:04,907   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-02-24T00:02:04,909   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-02-24T00:02:04,910   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-02-24T00:02:04,912   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-02-24T00:02:04,913   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-02-24T00:02:04,914   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-02-24T00:02:04,916   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-02-24T00:02:04,918   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-02-24T00:02:04,920   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-02-24T00:02:04,922   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-02-24T00:02:04,923   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-02-24T00:02:04,926   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-02-24T00:02:04,927   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-02-24T00:02:04,928   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-02-24T00:02:04,930   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-02-24T00:02:04,931   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-02-24T00:02:04,933   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-02-24T00:02:04,935   adding 'deepspeed/pipe/__init__.py'
2024-02-24T00:02:04,936   adding 'deepspeed/profiling/__init__.py'
2024-02-24T00:02:04,938   adding 'deepspeed/profiling/config.py'
2024-02-24T00:02:04,939   adding 'deepspeed/profiling/constants.py'
2024-02-24T00:02:04,941   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-02-24T00:02:04,946   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-02-24T00:02:04,948   adding 'deepspeed/runtime/__init__.py'
2024-02-24T00:02:04,950   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-02-24T00:02:04,952   adding 'deepspeed/runtime/compiler.py'
2024-02-24T00:02:04,956   adding 'deepspeed/runtime/config.py'
2024-02-24T00:02:04,958   adding 'deepspeed/runtime/config_utils.py'
2024-02-24T00:02:04,960   adding 'deepspeed/runtime/constants.py'
2024-02-24T00:02:04,962   adding 'deepspeed/runtime/dataloader.py'
2024-02-24T00:02:04,964   adding 'deepspeed/runtime/eigenvalue.py'
2024-02-24T00:02:04,982   adding 'deepspeed/runtime/engine.py'
2024-02-24T00:02:04,985   adding 'deepspeed/runtime/hybrid_engine.py'
2024-02-24T00:02:04,989   adding 'deepspeed/runtime/lr_schedules.py'
2024-02-24T00:02:04,990   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-02-24T00:02:04,992   adding 'deepspeed/runtime/quantize.py'
2024-02-24T00:02:04,994   adding 'deepspeed/runtime/sparse_tensor.py'
2024-02-24T00:02:04,996   adding 'deepspeed/runtime/state_dict_factory.py'
2024-02-24T00:02:05,000   adding 'deepspeed/runtime/utils.py'
2024-02-24T00:02:05,002   adding 'deepspeed/runtime/weight_quantizer.py'
2024-02-24T00:02:05,004   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-02-24T00:02:05,009   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-02-24T00:02:05,011   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-02-24T00:02:05,012   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-02-24T00:02:05,013   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-02-24T00:02:05,015   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-02-24T00:02:05,016   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-02-24T00:02:05,018   adding 'deepspeed/runtime/comm/__init__.py'
2024-02-24T00:02:05,020   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-02-24T00:02:05,021   adding 'deepspeed/runtime/comm/hccl.py'
2024-02-24T00:02:05,023   adding 'deepspeed/runtime/comm/mpi.py'
2024-02-24T00:02:05,025   adding 'deepspeed/runtime/comm/nccl.py'
2024-02-24T00:02:05,026   adding 'deepspeed/runtime/compression/__init__.py'
2024-02-24T00:02:05,028   adding 'deepspeed/runtime/compression/cupy.py'
2024-02-24T00:02:05,029   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-02-24T00:02:05,031   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-02-24T00:02:05,032   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-02-24T00:02:05,034   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-02-24T00:02:05,036   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-02-24T00:02:05,037   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-02-24T00:02:05,038   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-02-24T00:02:05,040   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-02-24T00:02:05,041   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-02-24T00:02:05,043   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-02-24T00:02:05,051   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-02-24T00:02:05,054   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-02-24T00:02:05,056   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-02-24T00:02:05,058   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-02-24T00:02:05,059   adding 'deepspeed/runtime/fp16/__init__.py'
2024-02-24T00:02:05,062   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-02-24T00:02:05,064   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-02-24T00:02:05,066   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-02-24T00:02:05,068   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-02-24T00:02:05,070   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-02-24T00:02:05,073   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-02-24T00:02:05,076   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-02-24T00:02:05,077   adding 'deepspeed/runtime/pipe/__init__.py'
2024-02-24T00:02:05,084   adding 'deepspeed/runtime/pipe/engine.py'
2024-02-24T00:02:05,087   adding 'deepspeed/runtime/pipe/module.py'
2024-02-24T00:02:05,089   adding 'deepspeed/runtime/pipe/p2p.py'
2024-02-24T00:02:05,091   adding 'deepspeed/runtime/pipe/schedule.py'
2024-02-24T00:02:05,094   adding 'deepspeed/runtime/pipe/topology.py'
2024-02-24T00:02:05,098   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-02-24T00:02:05,099   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-02-24T00:02:05,101   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-02-24T00:02:05,102   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-02-24T00:02:05,104   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-02-24T00:02:05,106   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-02-24T00:02:05,109   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-02-24T00:02:05,110   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-02-24T00:02:05,112   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-02-24T00:02:05,115   adding 'deepspeed/runtime/zero/__init__.py'
2024-02-24T00:02:05,117   adding 'deepspeed/runtime/zero/config.py'
2024-02-24T00:02:05,119   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-02-24T00:02:05,121   adding 'deepspeed/runtime/zero/linear.py'
2024-02-24T00:02:05,123   adding 'deepspeed/runtime/zero/mics.py'
2024-02-24T00:02:05,125   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-02-24T00:02:05,126   adding 'deepspeed/runtime/zero/offload_config.py'
2024-02-24T00:02:05,129   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-02-24T00:02:05,141   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-02-24T00:02:05,145   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-02-24T00:02:05,148   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-02-24T00:02:05,163   adding 'deepspeed/runtime/zero/stage3.py'
2024-02-24T00:02:05,177   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-02-24T00:02:05,179   adding 'deepspeed/runtime/zero/test.py'
2024-02-24T00:02:05,181   adding 'deepspeed/runtime/zero/tiling.py'
2024-02-24T00:02:05,182   adding 'deepspeed/runtime/zero/utils.py'
2024-02-24T00:02:05,184   adding 'deepspeed/sequence/__init__.py'
2024-02-24T00:02:05,186   adding 'deepspeed/sequence/layer.py'
2024-02-24T00:02:05,188   adding 'deepspeed/utils/__init__.py'
2024-02-24T00:02:05,189   adding 'deepspeed/utils/comms_logging.py'
2024-02-24T00:02:05,191   adding 'deepspeed/utils/debug.py'
2024-02-24T00:02:05,192   adding 'deepspeed/utils/exceptions.py'
2024-02-24T00:02:05,195   adding 'deepspeed/utils/groups.py'
2024-02-24T00:02:05,197   adding 'deepspeed/utils/init_on_device.py'
2024-02-24T00:02:05,198   adding 'deepspeed/utils/logging.py'
2024-02-24T00:02:05,199   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-02-24T00:02:05,201   adding 'deepspeed/utils/numa.py'
2024-02-24T00:02:05,202   adding 'deepspeed/utils/nvtx.py'
2024-02-24T00:02:05,204   adding 'deepspeed/utils/tensor_fragment.py'
2024-02-24T00:02:05,206   adding 'deepspeed/utils/timer.py'
2024-02-24T00:02:05,207   adding 'deepspeed/utils/types.py'
2024-02-24T00:02:05,208   adding 'deepspeed/utils/z3_leaf_module.py'
2024-02-24T00:02:05,211   adding 'deepspeed/utils/zero_to_fp32.py'
2024-02-24T00:02:05,213   adding 'deepspeed-0.13.3.data/scripts/deepspeed'
2024-02-24T00:02:05,214   adding 'deepspeed-0.13.3.data/scripts/deepspeed.pt'
2024-02-24T00:02:05,215   adding 'deepspeed-0.13.3.data/scripts/ds'
2024-02-24T00:02:05,217   adding 'deepspeed-0.13.3.data/scripts/ds_bench'
2024-02-24T00:02:05,218   adding 'deepspeed-0.13.3.data/scripts/ds_elastic'
2024-02-24T00:02:05,219   adding 'deepspeed-0.13.3.data/scripts/ds_report'
2024-02-24T00:02:05,220   adding 'deepspeed-0.13.3.data/scripts/ds_ssh'
2024-02-24T00:02:05,221   adding 'deepspeed-0.13.3.data/scripts/dsr'
2024-02-24T00:02:05,227   adding 'deepspeed-0.13.3.dist-info/METADATA'
2024-02-24T00:02:05,228   adding 'deepspeed-0.13.3.dist-info/WHEEL'
2024-02-24T00:02:05,229   adding 'deepspeed-0.13.3.dist-info/entry_points.txt'
2024-02-24T00:02:05,230   adding 'deepspeed-0.13.3.dist-info/top_level.txt'
2024-02-24T00:02:05,242   adding 'deepspeed-0.13.3.dist-info/RECORD'
2024-02-24T00:02:05,265   removing build/bdist.linux-armv7l/wheel
2024-02-24T00:02:05,511   deepspeed build time = 12.093352556228638 secs
2024-02-24T00:02:05,633   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-02-24T00:02:05,649   Created wheel for deepspeed: filename=deepspeed-0.13.3-py3-none-any.whl size=1365775 sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189
2024-02-24T00:02:05,651   Stored in directory: /tmp/pip-ephem-wheel-cache-xqm968ux/wheels/7a/10/e0/2d49ac6ce15365b0710b733be3261b4e52f672a37dd5665861
2024-02-24T00:02:05,690 Successfully built deepspeed
2024-02-24T00:02:05,725 Removed build tracker: '/tmp/pip-build-tracker-dkleobj2'