2024-06-21T18:33:08,384 Created temporary directory: /tmp/pip-build-tracker-dz84j4l3
2024-06-21T18:33:08,385 Initialized build tracking at /tmp/pip-build-tracker-dz84j4l3
2024-06-21T18:33:08,385 Created build tracker: /tmp/pip-build-tracker-dz84j4l3
2024-06-21T18:33:08,386 Entered build tracker: /tmp/pip-build-tracker-dz84j4l3
2024-06-21T18:33:08,387 Created temporary directory: /tmp/pip-wheel-kllzvv3_
2024-06-21T18:33:08,390 Created temporary directory: /tmp/pip-ephem-wheel-cache-2u7buwut
2024-06-21T18:33:08,412 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-06-21T18:33:08,415 2 location(s) to search for versions of deepspeed:
2024-06-21T18:33:08,415 * https://pypi.org/simple/deepspeed/
2024-06-21T18:33:08,415 * https://www.piwheels.org/simple/deepspeed/
2024-06-21T18:33:08,416 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-06-21T18:33:08,417 Getting page https://pypi.org/simple/deepspeed/
2024-06-21T18:33:08,418 Found index url https://pypi.org/simple/
2024-06-21T18:33:08,634 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-06-21T18:33:08,651   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-06-21T18:33:08,652   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-06-21T18:33:08,653   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-06-21T18:33:08,653   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-06-21T18:33:08,654   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-06-21T18:33:08,654   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-06-21T18:33:08,655   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-06-21T18:33:08,656   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-06-21T18:33:08,657   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-06-21T18:33:08,658   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-06-21T18:33:08,658   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-06-21T18:33:08,659   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-06-21T18:33:08,660   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-06-21T18:33:08,661   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-06-21T18:33:08,662   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-06-21T18:33:08,662   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-06-21T18:33:08,663   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-06-21T18:33:08,663   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-06-21T18:33:08,664   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-06-21T18:33:08,664   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-06-21T18:33:08,665   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-06-21T18:33:08,666   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-06-21T18:33:08,666   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-06-21T18:33:08,667   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-06-21T18:33:08,668   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-06-21T18:33:08,669   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-06-21T18:33:08,669   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-06-21T18:33:08,670   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-06-21T18:33:08,671   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-06-21T18:33:08,671   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-06-21T18:33:08,672   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-06-21T18:33:08,673   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-06-21T18:33:08,674   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-06-21T18:33:08,674   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-06-21T18:33:08,675   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-06-21T18:33:08,675   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-06-21T18:33:08,676   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-06-21T18:33:08,676   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-06-21T18:33:08,677   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-06-21T18:33:08,678   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-06-21T18:33:08,678   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-06-21T18:33:08,679   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-06-21T18:33:08,680   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-06-21T18:33:08,681   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-06-21T18:33:08,682   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-06-21T18:33:08,682   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-06-21T18:33:08,683   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-06-21T18:33:08,684   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-06-21T18:33:08,684   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-06-21T18:33:08,685   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-06-21T18:33:08,686   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-06-21T18:33:08,687   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-06-21T18:33:08,687   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-06-21T18:33:08,688   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-06-21T18:33:08,688   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-06-21T18:33:08,689   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-06-21T18:33:08,690   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-06-21T18:33:08,690   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-06-21T18:33:08,691   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-06-21T18:33:08,692   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-06-21T18:33:08,692   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-06-21T18:33:08,693   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-06-21T18:33:08,694   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-06-21T18:33:08,695   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-06-21T18:33:08,695   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-06-21T18:33:08,696   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-06-21T18:33:08,697   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-06-21T18:33:08,698   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-06-21T18:33:08,698   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-06-21T18:33:08,699   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-06-21T18:33:08,700   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-06-21T18:33:08,700   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-06-21T18:33:08,701   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-06-21T18:33:08,701   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-06-21T18:33:08,702   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-06-21T18:33:08,703   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-06-21T18:33:08,703   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-06-21T18:33:08,704   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-06-21T18:33:08,705   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-06-21T18:33:08,706   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-06-21T18:33:08,706   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-06-21T18:33:08,707   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-06-21T18:33:08,708   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-06-21T18:33:08,708   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-06-21T18:33:08,709   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-06-21T18:33:08,710   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-06-21T18:33:08,711   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-06-21T18:33:08,711   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-06-21T18:33:08,712   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-06-21T18:33:08,712   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-06-21T18:33:08,713   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-06-21T18:33:08,714   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-06-21T18:33:08,714   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-06-21T18:33:08,715   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-06-21T18:33:08,715   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-06-21T18:33:08,716   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2024-06-21T18:33:08,717 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-06-21T18:33:08,717 Getting page https://www.piwheels.org/simple/deepspeed/
2024-06-21T18:33:08,718 Found index url https://www.piwheels.org/simple/
2024-06-21T18:33:08,874 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-06-21T18:33:08,891   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,891   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,892   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,893   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,893   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,894   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,895   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,895   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,896   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,896   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,896   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,897   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,898   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,898   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,899   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,899   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,900   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,901   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,901   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,902   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,903   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,903   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,904   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,904   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,905   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,905   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,906   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,906   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,907   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,908   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,908   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,909   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,910   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,910   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,911   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,912   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,912   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,912   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,913   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,913   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,914   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,914   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,915   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,915   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,916   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,917   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,917   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,918   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,918   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,919   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,920   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,920   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,920   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,921   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,921   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,922   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,922   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,923   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,923   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,924   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,925   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,925   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,926   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,926   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,927   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-06-21T18:33:08,928 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-06-21T18:33:08,928 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-06-21T18:33:08,958 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-06-21T18:33:08,978 Collecting deepspeed==0.14.4
2024-06-21T18:33:08,980   Created temporary directory: /tmp/pip-unpack-rmdb7yhe
2024-06-21T18:33:09,463   Downloading deepspeed-0.14.4.tar.gz (1.3 MB)
2024-06-21T18:33:11,750   Added deepspeed==0.14.4 from https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz to build tracker '/tmp/pip-build-tracker-dz84j4l3'
2024-06-21T18:33:11,751   Running setup.py (path:/tmp/pip-wheel-kllzvv3_/deepspeed_a1e0d3050e0f4c28a77f9a53b50683b4/setup.py) egg_info for package deepspeed
2024-06-21T18:33:11,752   Created temporary directory: /tmp/pip-pip-egg-info-yqqkc3c4
2024-06-21T18:33:11,753   Preparing metadata (setup.py): started
2024-06-21T18:33:11,754   Running command python setup.py egg_info
2024-06-21T18:33:12,699   fatal: not a git repository (or any of the parent directories): .git
2024-06-21T18:33:13,221   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-06-21T18:33:13,222    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-06-21T18:33:13,222   DS_BUILD_OPS=0
2024-06-21T18:33:13,223    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-06-21T18:33:13,223    [WARNING]  async_io: please install the libaio-dev package with apt
2024-06-21T18:33:13,224    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-06-21T18:33:13,224    [WARNING]  Please install torch if trying to pre-compile kernels
2024-06-21T18:33:13,225    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:13,226    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:13,226    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:13,227    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:13,227    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:13,228    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:13,228    [WARNING]  unable to import torch, please install it first
2024-06-21T18:33:13,229    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:13,230   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-06-21T18:33:13,230   version=0.14.4, git_hash=unknown, git_branch=unknown
2024-06-21T18:33:13,231   install_requires=['hjson', 'ninja', 'numpy', 'nvidia-ml-py', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm']
2024-06-21T18:33:13,231   ext_modules=[]
2024-06-21T18:33:13,232   running egg_info
2024-06-21T18:33:13,233   creating /tmp/pip-pip-egg-info-yqqkc3c4/deepspeed.egg-info
2024-06-21T18:33:13,253   writing /tmp/pip-pip-egg-info-yqqkc3c4/deepspeed.egg-info/PKG-INFO
2024-06-21T18:33:13,288   writing dependency_links to /tmp/pip-pip-egg-info-yqqkc3c4/deepspeed.egg-info/dependency_links.txt
2024-06-21T18:33:13,290   writing entry points to /tmp/pip-pip-egg-info-yqqkc3c4/deepspeed.egg-info/entry_points.txt
2024-06-21T18:33:13,308   writing requirements to /tmp/pip-pip-egg-info-yqqkc3c4/deepspeed.egg-info/requires.txt
2024-06-21T18:33:13,309   writing top-level names to /tmp/pip-pip-egg-info-yqqkc3c4/deepspeed.egg-info/top_level.txt
2024-06-21T18:33:13,310   writing manifest file '/tmp/pip-pip-egg-info-yqqkc3c4/deepspeed.egg-info/SOURCES.txt'
2024-06-21T18:33:13,533   reading manifest file '/tmp/pip-pip-egg-info-yqqkc3c4/deepspeed.egg-info/SOURCES.txt'
2024-06-21T18:33:13,535   reading manifest template 'MANIFEST.in'
2024-06-21T18:33:13,537   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-06-21T18:33:13,537   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-06-21T18:33:15,231   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-06-21T18:33:16,128   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-06-21T18:33:19,401   warning: no files found matching '*.tr' under directory 'csrc'
2024-06-21T18:33:19,514   warning: no files found matching '*.cc' under directory 'csrc'
2024-06-21T18:33:19,551   warning: no files found matching '*.py' under directory 'benchmarks'
2024-06-21T18:33:19,679   writing manifest file '/tmp/pip-pip-egg-info-yqqkc3c4/deepspeed.egg-info/SOURCES.txt'
2024-06-21T18:33:19,681   deepspeed build time = 6.978469371795654 secs
2024-06-21T18:33:19,796   Preparing metadata (setup.py): finished with status 'done'
2024-06-21T18:33:19,802   Source in /tmp/pip-wheel-kllzvv3_/deepspeed_a1e0d3050e0f4c28a77f9a53b50683b4 has version 0.14.4, which satisfies requirement deepspeed==0.14.4 from https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz
2024-06-21T18:33:19,803   Removed deepspeed==0.14.4 from https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz from build tracker '/tmp/pip-build-tracker-dz84j4l3'
2024-06-21T18:33:19,812 Created temporary directory: /tmp/pip-unpack-5v72m2rz
2024-06-21T18:33:19,813 Created temporary directory: /tmp/pip-unpack-e3hiti0u
2024-06-21T18:33:20,087 Building wheels for collected packages: deepspeed
2024-06-21T18:33:20,093   Created temporary directory: /tmp/pip-wheel-pfrwsw66
2024-06-21T18:33:20,093   Building wheel for deepspeed (setup.py): started
2024-06-21T18:33:20,095   Destination directory: /tmp/pip-wheel-pfrwsw66
2024-06-21T18:33:20,096   Running command python setup.py bdist_wheel
2024-06-21T18:33:20,610   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-06-21T18:33:20,619    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-06-21T18:33:20,707   DS_BUILD_OPS=0
2024-06-21T18:33:20,825    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-06-21T18:33:20,885    [WARNING]  async_io: please install the libaio-dev package with apt
2024-06-21T18:33:20,886    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-06-21T18:33:20,886    [WARNING]  Please install torch if trying to pre-compile kernels
2024-06-21T18:33:20,887    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:20,888    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:20,888    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:20,889    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:20,890    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:20,890    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:20,891    [WARNING]  unable to import torch, please install it first
2024-06-21T18:33:20,891    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-21T18:33:20,892   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-06-21T18:33:20,899   fatal: not a git repository (or any of the parent directories): .git
2024-06-21T18:33:20,901   version=0.14.4, git_hash=unknown, git_branch=unknown
2024-06-21T18:33:20,902   install_requires=['hjson', 'ninja', 'numpy', 'nvidia-ml-py', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm']
2024-06-21T18:33:20,902   ext_modules=[]
2024-06-21T18:33:21,357   running bdist_wheel
2024-06-21T18:33:21,486   running build
2024-06-21T18:33:21,487   running build_py
2024-06-21T18:33:21,515   creating build
2024-06-21T18:33:21,516   creating build/lib
2024-06-21T18:33:21,517   creating build/lib/deepspeed
2024-06-21T18:33:21,518   copying deepspeed/constants.py -> build/lib/deepspeed
2024-06-21T18:33:21,519   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2024-06-21T18:33:21,521   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-06-21T18:33:21,523   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-06-21T18:33:21,525   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-06-21T18:33:21,527   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-06-21T18:33:21,529   creating build/lib/deepspeed/ops
2024-06-21T18:33:21,530   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-06-21T18:33:21,533   creating build/lib/deepspeed/inference
2024-06-21T18:33:21,534   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-06-21T18:33:21,535   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-06-21T18:33:21,538   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-06-21T18:33:21,541   creating build/lib/deepspeed/pipe
2024-06-21T18:33:21,542   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-06-21T18:33:21,544   creating build/lib/deepspeed/launcher
2024-06-21T18:33:21,545   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-06-21T18:33:21,547   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-06-21T18:33:21,549   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-06-21T18:33:21,551   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-06-21T18:33:21,553   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-06-21T18:33:21,555   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-06-21T18:33:21,558   creating build/lib/deepspeed/accelerator
2024-06-21T18:33:21,559   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-21T18:33:21,562   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-21T18:33:21,564   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-21T18:33:21,566   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-21T18:33:21,568   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-06-21T18:33:21,570   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-21T18:33:21,572   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-21T18:33:21,575   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-21T18:33:21,577   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-21T18:33:21,579   creating build/lib/deepspeed/moe
2024-06-21T18:33:21,580   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-06-21T18:33:21,583   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-06-21T18:33:21,584   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-06-21T18:33:21,586   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-06-21T18:33:21,588   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-06-21T18:33:21,590   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-06-21T18:33:21,593   creating build/lib/deepspeed/utils
2024-06-21T18:33:21,594   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,595   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,598   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,599   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,601   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,603   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,606   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,607   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,609   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,611   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,613   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,615   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,617   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,619   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,621   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,623   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,625   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,626   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-06-21T18:33:21,629   creating build/lib/deepspeed/monitor
2024-06-21T18:33:21,630   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-06-21T18:33:21,632   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-06-21T18:33:21,634   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-06-21T18:33:21,635   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-06-21T18:33:21,637   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-06-21T18:33:21,639   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-06-21T18:33:21,640   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-06-21T18:33:21,642   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-06-21T18:33:21,645   creating build/lib/deepspeed/linear
2024-06-21T18:33:21,646   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-06-21T18:33:21,648   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-06-21T18:33:21,650   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-06-21T18:33:21,651   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-06-21T18:33:21,654   creating build/lib/deepspeed/module_inject
2024-06-21T18:33:21,655   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,658   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,659   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,661   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,663   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,665   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,667   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,669   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,670   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,672   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,674   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,676   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,678   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-06-21T18:33:21,681   creating build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,682   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,684   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,687   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,688   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,690   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,693   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,694   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,696   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,698   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,700   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-06-21T18:33:21,703   creating build/lib/deepspeed/elasticity
2024-06-21T18:33:21,704   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-06-21T18:33:21,706   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-06-21T18:33:21,708   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-06-21T18:33:21,710   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-06-21T18:33:21,712   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-06-21T18:33:21,713   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-06-21T18:33:21,716   creating build/lib/deepspeed/nebula
2024-06-21T18:33:21,717   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-06-21T18:33:21,718   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-06-21T18:33:21,720   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-06-21T18:33:21,722   creating build/lib/deepspeed/model_implementations
2024-06-21T18:33:21,723   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-06-21T18:33:21,725   creating build/lib/deepspeed/compression
2024-06-21T18:33:21,726   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-06-21T18:33:21,729   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-06-21T18:33:21,731   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-06-21T18:33:21,734   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-06-21T18:33:21,736   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-06-21T18:33:21,738   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-06-21T18:33:21,740   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-06-21T18:33:21,742   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-06-21T18:33:21,745   creating build/lib/deepspeed/autotuning
2024-06-21T18:33:21,746   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-06-21T18:33:21,748   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-06-21T18:33:21,750   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-06-21T18:33:21,753   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-06-21T18:33:21,755   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-06-21T18:33:21,758   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-06-21T18:33:21,763   creating build/lib/deepspeed/profiling
2024-06-21T18:33:21,764   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-06-21T18:33:21,766   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-06-21T18:33:21,767   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-06-21T18:33:21,769   creating build/lib/deepspeed/sequence
2024-06-21T18:33:21,770   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-06-21T18:33:21,772   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-06-21T18:33:21,775   creating build/lib/deepspeed/comm
2024-06-21T18:33:21,775   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-06-21T18:33:21,777   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-06-21T18:33:21,780   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-06-21T18:33:21,782   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-06-21T18:33:21,784   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-06-21T18:33:21,786   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-06-21T18:33:21,787   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-06-21T18:33:21,789   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-06-21T18:33:21,791   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-06-21T18:33:21,794   creating build/lib/deepspeed/runtime
2024-06-21T18:33:21,795   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,797   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,799   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,801   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,803   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,806   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,807   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,809   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,811   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,814   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,817   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,819   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,824   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,827   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,829   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,832   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,834   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,837   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-06-21T18:33:21,840   creating build/lib/deepspeed/ops/adam
2024-06-21T18:33:21,841   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-06-21T18:33:21,843   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-06-21T18:33:21,845   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-06-21T18:33:21,846   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-06-21T18:33:21,849   creating build/lib/deepspeed/ops/lamb
2024-06-21T18:33:21,850   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-06-21T18:33:21,852   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-06-21T18:33:21,855   creating build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,856   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,857   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,859   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,861   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,862   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,864   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,866   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,868   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,869   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,871   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,873   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,875   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,877   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,879   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,881   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,883   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,885   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,887   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,889   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,890   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,892   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,894   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,896   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-06-21T18:33:21,898   creating build/lib/deepspeed/ops/sparse_attention
2024-06-21T18:33:21,899   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-21T18:33:21,903   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-21T18:33:21,905   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-21T18:33:21,907   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-21T18:33:21,909   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-21T18:33:21,912   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-21T18:33:21,913   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-21T18:33:21,916   creating build/lib/deepspeed/ops/deepspeed4science
2024-06-21T18:33:21,917   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-06-21T18:33:21,919   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-06-21T18:33:21,921   creating build/lib/deepspeed/ops/quantizer
2024-06-21T18:33:21,922   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-06-21T18:33:21,924   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-06-21T18:33:21,926   creating build/lib/deepspeed/ops/random_ltd
2024-06-21T18:33:21,926   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-06-21T18:33:21,928   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-06-21T18:33:21,931   creating build/lib/deepspeed/ops/aio
2024-06-21T18:33:21,932   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-06-21T18:33:21,935   creating build/lib/deepspeed/ops/transformer
2024-06-21T18:33:21,936   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-06-21T18:33:21,938   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-06-21T18:33:21,940   creating build/lib/deepspeed/ops/adagrad
2024-06-21T18:33:21,941   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-06-21T18:33:21,944   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-06-21T18:33:21,946   creating build/lib/deepspeed/ops/lion
2024-06-21T18:33:21,946   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-06-21T18:33:21,949   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-06-21T18:33:21,951   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-06-21T18:33:21,953   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-06-21T18:33:21,955   creating build/lib/deepspeed/ops/fp_quantizer
2024-06-21T18:33:21,956   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-06-21T18:33:21,958   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-06-21T18:33:21,960   creating build/lib/deepspeed/ops/op_builder/npu
2024-06-21T18:33:21,961   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-21T18:33:21,963   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-21T18:33:21,965   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-21T18:33:21,967   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-21T18:33:21,968   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-21T18:33:21,970   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-21T18:33:21,972   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-21T18:33:21,974   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-21T18:33:21,975   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-21T18:33:21,978   creating build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,979   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,981   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,982   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,984   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,986   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,987   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,989   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,991   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,992   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,994   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:21,996   creating build/lib/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:21,997   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:21,999   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:22,000   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:22,002   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:22,004   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:22,006   creating build/lib/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:22,007   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:22,009   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:22,010   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:22,012   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:22,014   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:22,015   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:22,017   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-06-21T18:33:22,018   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-06-21T18:33:22,021   creating build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,022   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,024   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,026   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,028   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,030   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,031   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,034   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,036   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,038   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,040   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-21T18:33:22,043   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,043   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,045   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,047   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,050   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,052   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,054   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,056   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,057   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,059   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,061   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:22,064   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,065   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,067   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,068   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,070   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,072   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,074   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,076   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,078   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,079   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,081   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:22,083   creating build/lib/deepspeed/inference/quantization
2024-06-21T18:33:22,085   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-06-21T18:33:22,086   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-06-21T18:33:22,088   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-06-21T18:33:22,090   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-06-21T18:33:22,092   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-06-21T18:33:22,095   creating build/lib/deepspeed/inference/v2
2024-06-21T18:33:22,095   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-06-21T18:33:22,097   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-06-21T18:33:22,099   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-06-21T18:33:22,101   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-06-21T18:33:22,102   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-06-21T18:33:22,104   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-06-21T18:33:22,106   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-06-21T18:33:22,107   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-06-21T18:33:22,109   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-06-21T18:33:22,111   creating build/lib/deepspeed/inference/v2/ragged
2024-06-21T18:33:22,112   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-21T18:33:22,114   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-21T18:33:22,116   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-21T18:33:22,118   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-21T18:33:22,120   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-21T18:33:22,122   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-21T18:33:22,124   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-21T18:33:22,127   creating build/lib/deepspeed/inference/v2/kernels
2024-06-21T18:33:22,128   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-06-21T18:33:22,129   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-06-21T18:33:22,132   creating build/lib/deepspeed/inference/v2/checkpoint
2024-06-21T18:33:22,133   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-06-21T18:33:22,134   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-06-21T18:33:22,136   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-06-21T18:33:22,138   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-06-21T18:33:22,140   creating build/lib/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:22,141   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:22,144   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:22,146   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:22,148   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:22,150   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:22,152   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:22,155   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:22,158   creating build/lib/deepspeed/inference/v2/modules
2024-06-21T18:33:22,159   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-06-21T18:33:22,161   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-06-21T18:33:22,162   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-06-21T18:33:22,164   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-06-21T18:33:22,166   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-21T18:33:22,167   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-21T18:33:22,169   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-06-21T18:33:22,170   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-06-21T18:33:22,172   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-06-21T18:33:22,173   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-06-21T18:33:22,175   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:22,176   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:22,178   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:22,180   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:22,182   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:22,183   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:22,185   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:22,187   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:22,188   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:22,190   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:22,192   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:22,193   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:22,196   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:22,197   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:22,199   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:22,201   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:22,203   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:22,204   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:22,207   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-21T18:33:22,207   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-21T18:33:22,209   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-21T18:33:22,211   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:22,212   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:22,214   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:22,217   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:22,217   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:22,219   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:22,221   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:22,222   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:22,224   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:22,226   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:22,227   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:22,229   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:22,231   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:22,232   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:22,234   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:22,236   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:22,237   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:22,239   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:22,241   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:22,242   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:22,244   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:22,246   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-21T18:33:22,247   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-21T18:33:22,249   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-21T18:33:22,252   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:22,252   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:22,254   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:22,256   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:22,258   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:22,260   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:22,260   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:22,262   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:22,265   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:22,265   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:22,267   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:22,270   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:22,270   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:22,272   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:22,274   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:22,276   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:22,278   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:22,280   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:22,282   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:22,284   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:22,286   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:22,289   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-06-21T18:33:22,290   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-06-21T18:33:22,292   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-06-21T18:33:22,293   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-06-21T18:33:22,295   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-06-21T18:33:22,298   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-06-21T18:33:22,298   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-06-21T18:33:22,300   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-06-21T18:33:22,302   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-06-21T18:33:22,304   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-06-21T18:33:22,306   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-06-21T18:33:22,307   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-06-21T18:33:22,308   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-06-21T18:33:22,310   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-06-21T18:33:22,311   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-06-21T18:33:22,314   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:22,315   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:22,317   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:22,319   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:22,320   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:22,322   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:22,324   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:22,325   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:22,327   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:22,328   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:22,331   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-06-21T18:33:22,331   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-06-21T18:33:22,333   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-06-21T18:33:22,335   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-06-21T18:33:22,337   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-06-21T18:33:22,339   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-21T18:33:22,340   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-21T18:33:22,342   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-21T18:33:22,343   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-21T18:33:22,345   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-21T18:33:22,348   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-06-21T18:33:22,349   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-06-21T18:33:22,350   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-06-21T18:33:22,352   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-06-21T18:33:22,354   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-06-21T18:33:22,357   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-06-21T18:33:22,358   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-06-21T18:33:22,360   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-06-21T18:33:22,362   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-06-21T18:33:22,364   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-06-21T18:33:22,367   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-21T18:33:22,368   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-21T18:33:22,370   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-21T18:33:22,372   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-21T18:33:22,375   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-21T18:33:22,378   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-06-21T18:33:22,379   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-06-21T18:33:22,382   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:22,383   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:22,386   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:22,388   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:22,390   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:22,393   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:22,395   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:22,397   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:22,399   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:22,402   creating build/lib/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:22,403   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:22,405   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:22,407   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:22,409   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:22,411   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:22,413   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:22,415   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:22,418   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-21T18:33:22,419   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-21T18:33:22,421   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-21T18:33:22,423   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-21T18:33:22,426   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-06-21T18:33:22,427   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-06-21T18:33:22,430   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-06-21T18:33:22,433   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-06-21T18:33:22,434   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-06-21T18:33:22,436   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-06-21T18:33:22,439   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-06-21T18:33:22,440   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-06-21T18:33:22,443   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-06-21T18:33:22,445   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-06-21T18:33:22,448   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-06-21T18:33:22,449   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-06-21T18:33:22,451   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-06-21T18:33:22,454   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-06-21T18:33:22,455   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-06-21T18:33:22,458   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-06-21T18:33:22,460   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-21T18:33:22,461   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-21T18:33:22,463   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-21T18:33:22,467   creating build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,469   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,474   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,477   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,479   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,481   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,483   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,485   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,487   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,489   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,491   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,493   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,495   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,497   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,498   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,500   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,502   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,504   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,506   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,509   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-06-21T18:33:22,511   creating build/lib/deepspeed/module_inject/containers/features
2024-06-21T18:33:22,512   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-21T18:33:22,514   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-21T18:33:22,516   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-21T18:33:22,518   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-21T18:33:22,520   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-21T18:33:22,522   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-21T18:33:22,524   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-21T18:33:22,527   creating build/lib/deepspeed/model_implementations/diffusers
2024-06-21T18:33:22,528   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-06-21T18:33:22,530   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-06-21T18:33:22,532   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-06-21T18:33:22,534   creating build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,535   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,537   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,538   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,540   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,542   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,544   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,545   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,547   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,548   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,550   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-21T18:33:22,552   creating build/lib/deepspeed/model_implementations/features
2024-06-21T18:33:22,553   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-06-21T18:33:22,555   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-06-21T18:33:22,557   creating build/lib/deepspeed/autotuning/tuner
2024-06-21T18:33:22,558   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-06-21T18:33:22,560   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-06-21T18:33:22,562   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-06-21T18:33:22,564   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-06-21T18:33:22,565   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-06-21T18:33:22,567   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-06-21T18:33:22,570   creating build/lib/deepspeed/profiling/flops_profiler
2024-06-21T18:33:22,571   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-06-21T18:33:22,574   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-06-21T18:33:22,576   creating build/lib/deepspeed/runtime/swap_tensor
2024-06-21T18:33:22,577   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-21T18:33:22,579   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-21T18:33:22,581   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-21T18:33:22,583   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-21T18:33:22,586   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-21T18:33:22,588   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-21T18:33:22,590   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-21T18:33:22,592   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-21T18:33:22,594   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-21T18:33:22,596   creating build/lib/deepspeed/runtime/fp16
2024-06-21T18:33:22,597   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-06-21T18:33:22,600   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-06-21T18:33:22,602   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-06-21T18:33:22,604   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-06-21T18:33:22,606   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-06-21T18:33:22,607   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-06-21T18:33:22,610   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-06-21T18:33:22,611   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-06-21T18:33:22,613   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-06-21T18:33:22,615   creating build/lib/deepspeed/runtime/pipe
2024-06-21T18:33:22,616   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-06-21T18:33:22,618   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-06-21T18:33:22,621   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-06-21T18:33:22,623   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-06-21T18:33:22,625   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-06-21T18:33:22,627   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-06-21T18:33:22,631   creating build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,632   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,634   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,636   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,638   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,641   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,645   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,647   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,649   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,651   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,653   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,655   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,657   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,661   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,663   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,667   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,670   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-06-21T18:33:22,672   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-06-21T18:33:22,672   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-06-21T18:33:22,676   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-06-21T18:33:22,677   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-06-21T18:33:22,679   creating build/lib/deepspeed/runtime/compression
2024-06-21T18:33:22,680   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-06-21T18:33:22,682   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-06-21T18:33:22,684   creating build/lib/deepspeed/runtime/comm
2024-06-21T18:33:22,685   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-06-21T18:33:22,687   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-06-21T18:33:22,689   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-06-21T18:33:22,691   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-06-21T18:33:22,693   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-06-21T18:33:22,695   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-06-21T18:33:22,698   creating build/lib/deepspeed/runtime/data_pipeline
2024-06-21T18:33:22,698   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-06-21T18:33:22,701   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-06-21T18:33:22,702   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-06-21T18:33:22,705   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-06-21T18:33:22,708   creating build/lib/deepspeed/runtime/fp16/onebit
2024-06-21T18:33:22,709   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-06-21T18:33:22,711   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-06-21T18:33:22,713   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-06-21T18:33:22,716   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-06-21T18:33:22,719   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:22,720   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:22,722   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:22,724   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:22,726   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:22,727   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:22,730   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:22,731   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:22,733   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:22,736   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:22,738   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:22,740   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:22,743   running egg_info
2024-06-21T18:33:22,770   writing deepspeed.egg-info/PKG-INFO
2024-06-21T18:33:22,804   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-06-21T18:33:22,806   writing entry points to deepspeed.egg-info/entry_points.txt
2024-06-21T18:33:22,824   writing requirements to deepspeed.egg-info/requires.txt
2024-06-21T18:33:22,826   writing top-level names to deepspeed.egg-info/top_level.txt
2024-06-21T18:33:22,946   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-06-21T18:33:22,971   reading manifest template 'MANIFEST.in'
2024-06-21T18:33:22,973   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-06-21T18:33:22,974   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-06-21T18:33:24,724   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-06-21T18:33:25,599   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-06-21T18:33:26,187   warning: no files found matching '*.tr' under directory 'csrc'
2024-06-21T18:33:26,297   warning: no files found matching '*.cc' under directory 'csrc'
2024-06-21T18:33:26,333   warning: no files found matching '*.py' under directory 'benchmarks'
2024-06-21T18:33:26,383   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-06-21T18:33:26,391   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-06-21T18:33:26,392   !!

2024-06-21T18:33:26,393           ********************************************************************************
2024-06-21T18:33:26,393           ############################
2024-06-21T18:33:26,394           # Package would be ignored #
2024-06-21T18:33:26,395           ############################
2024-06-21T18:33:26,395           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-06-21T18:33:26,396           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,397           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,398           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-06-21T18:33:26,398           to the `packages` configuration field.

2024-06-21T18:33:26,399           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,400           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,400           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,402           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,403           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,404           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-06-21T18:33:26,405           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-06-21T18:33:26,406           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,406           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,407           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,408           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,409           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,410           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,410                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,410                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,411                 directory, all directories are treated like packages.
2024-06-21T18:33:26,411           ********************************************************************************

2024-06-21T18:33:26,412   !!
2024-06-21T18:33:26,412     check.warn(importable)
2024-06-21T18:33:26,413   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-06-21T18:33:26,413   !!

2024-06-21T18:33:26,414           ********************************************************************************
2024-06-21T18:33:26,415           ############################
2024-06-21T18:33:26,415           # Package would be ignored #
2024-06-21T18:33:26,416           ############################
2024-06-21T18:33:26,416           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-06-21T18:33:26,417           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,418           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,418           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-06-21T18:33:26,419           to the `packages` configuration field.

2024-06-21T18:33:26,420           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,421           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,421           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,422           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,423           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,424           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-06-21T18:33:26,425           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-06-21T18:33:26,425           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,426           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,426           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,427           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,428           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,429           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,430                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,431                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,431                 directory, all directories are treated like packages.
2024-06-21T18:33:26,432           ********************************************************************************

2024-06-21T18:33:26,433   !!
2024-06-21T18:33:26,433     check.warn(importable)
2024-06-21T18:33:26,434   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-06-21T18:33:26,434   !!

2024-06-21T18:33:26,435           ********************************************************************************
2024-06-21T18:33:26,435           ############################
2024-06-21T18:33:26,435           # Package would be ignored #
2024-06-21T18:33:26,436           ############################
2024-06-21T18:33:26,436           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-06-21T18:33:26,437           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,437           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,438           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-06-21T18:33:26,438           to the `packages` configuration field.

2024-06-21T18:33:26,439           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,439           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,439           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,440           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,441           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,442           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-06-21T18:33:26,442           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-06-21T18:33:26,443           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,443           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,444           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,445           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,446           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,448           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,448                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,449                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,450                 directory, all directories are treated like packages.
2024-06-21T18:33:26,450           ********************************************************************************

2024-06-21T18:33:26,451   !!
2024-06-21T18:33:26,451     check.warn(importable)
2024-06-21T18:33:26,452   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-06-21T18:33:26,452   !!

2024-06-21T18:33:26,453           ********************************************************************************
2024-06-21T18:33:26,454           ############################
2024-06-21T18:33:26,454           # Package would be ignored #
2024-06-21T18:33:26,455           ############################
2024-06-21T18:33:26,455           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-06-21T18:33:26,456           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,457           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,458           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-06-21T18:33:26,458           to the `packages` configuration field.

2024-06-21T18:33:26,460           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,460           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,461           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,461           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,462           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,463           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-06-21T18:33:26,463           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-06-21T18:33:26,463           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,464           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,464           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,465           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,466           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,467           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,467                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,468                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,468                 directory, all directories are treated like packages.
2024-06-21T18:33:26,468           ********************************************************************************

2024-06-21T18:33:26,469   !!
2024-06-21T18:33:26,470     check.warn(importable)
2024-06-21T18:33:26,470   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-06-21T18:33:26,471   !!

2024-06-21T18:33:26,472           ********************************************************************************
2024-06-21T18:33:26,473           ############################
2024-06-21T18:33:26,473           # Package would be ignored #
2024-06-21T18:33:26,474           ############################
2024-06-21T18:33:26,474           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-06-21T18:33:26,475           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,476           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,476           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-06-21T18:33:26,477           to the `packages` configuration field.

2024-06-21T18:33:26,478           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,478           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,478           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,479           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,480           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,481           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-06-21T18:33:26,482           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-06-21T18:33:26,482           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,483           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,484           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,485           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,486           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,487           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,487                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,488                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,488                 directory, all directories are treated like packages.
2024-06-21T18:33:26,489           ********************************************************************************

2024-06-21T18:33:26,489   !!
2024-06-21T18:33:26,490     check.warn(importable)
2024-06-21T18:33:26,490   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-06-21T18:33:26,490   !!

2024-06-21T18:33:26,491           ********************************************************************************
2024-06-21T18:33:26,491           ############################
2024-06-21T18:33:26,492           # Package would be ignored #
2024-06-21T18:33:26,492           ############################
2024-06-21T18:33:26,493           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-06-21T18:33:26,493           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,494           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,494           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-06-21T18:33:26,495           to the `packages` configuration field.

2024-06-21T18:33:26,496           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,496           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,497           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,498           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,499           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,500           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-06-21T18:33:26,500           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-06-21T18:33:26,501           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,502           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,502           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,503           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,504           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,505           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,506                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,506                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,507                 directory, all directories are treated like packages.
2024-06-21T18:33:26,507           ********************************************************************************

2024-06-21T18:33:26,509   !!
2024-06-21T18:33:26,509     check.warn(importable)
2024-06-21T18:33:26,510   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-06-21T18:33:26,510   !!

2024-06-21T18:33:26,512           ********************************************************************************
2024-06-21T18:33:26,512           ############################
2024-06-21T18:33:26,513           # Package would be ignored #
2024-06-21T18:33:26,513           ############################
2024-06-21T18:33:26,514           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-06-21T18:33:26,514           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,515           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,515           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-06-21T18:33:26,516           to the `packages` configuration field.

2024-06-21T18:33:26,516           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,517           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,517           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,518           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,519           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,520           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-06-21T18:33:26,521           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-06-21T18:33:26,521           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,522           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,523           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,525           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,527           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,562           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,562                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,563                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,563                 directory, all directories are treated like packages.
2024-06-21T18:33:26,564           ********************************************************************************

2024-06-21T18:33:26,565   !!
2024-06-21T18:33:26,565     check.warn(importable)
2024-06-21T18:33:26,566   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-06-21T18:33:26,567   !!

2024-06-21T18:33:26,567           ********************************************************************************
2024-06-21T18:33:26,568           ############################
2024-06-21T18:33:26,568           # Package would be ignored #
2024-06-21T18:33:26,569           ############################
2024-06-21T18:33:26,569           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-06-21T18:33:26,570           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,571           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,571           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-06-21T18:33:26,572           to the `packages` configuration field.

2024-06-21T18:33:26,573           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,573           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,574           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,575           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,576           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,577           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-06-21T18:33:26,577           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-06-21T18:33:26,577           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,577           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,578           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,579           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,791           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,792           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,792                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,793                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,793                 directory, all directories are treated like packages.
2024-06-21T18:33:26,793           ********************************************************************************

2024-06-21T18:33:26,794   !!
2024-06-21T18:33:26,794     check.warn(importable)
2024-06-21T18:33:26,795   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-06-21T18:33:26,795   !!

2024-06-21T18:33:26,796           ********************************************************************************
2024-06-21T18:33:26,796           ############################
2024-06-21T18:33:26,797           # Package would be ignored #
2024-06-21T18:33:26,797           ############################
2024-06-21T18:33:26,798           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-06-21T18:33:26,798           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,799           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,800           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-06-21T18:33:26,800           to the `packages` configuration field.

2024-06-21T18:33:26,801           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,802           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,803           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,804           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,807           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,808           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-06-21T18:33:26,808           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-06-21T18:33:26,809           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,809           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,810           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,811           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,812           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,813           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,814                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,814                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,815                 directory, all directories are treated like packages.
2024-06-21T18:33:26,815           ********************************************************************************

2024-06-21T18:33:26,816   !!
2024-06-21T18:33:26,816     check.warn(importable)
2024-06-21T18:33:26,817   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-06-21T18:33:26,817   !!

2024-06-21T18:33:26,818           ********************************************************************************
2024-06-21T18:33:26,818           ############################
2024-06-21T18:33:26,818           # Package would be ignored #
2024-06-21T18:33:26,819           ############################
2024-06-21T18:33:26,819           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-06-21T18:33:26,819           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,820           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,821           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-06-21T18:33:26,821           to the `packages` configuration field.

2024-06-21T18:33:26,822           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,822           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,823           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,824           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,825           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,826           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-06-21T18:33:26,826           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-06-21T18:33:26,827           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,827           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,828           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,829           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,830           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,832           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,832                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,833                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,833                 directory, all directories are treated like packages.
2024-06-21T18:33:26,834           ********************************************************************************

2024-06-21T18:33:26,835   !!
2024-06-21T18:33:26,835     check.warn(importable)
2024-06-21T18:33:26,835   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-06-21T18:33:26,836   !!

2024-06-21T18:33:26,837           ********************************************************************************
2024-06-21T18:33:26,837           ############################
2024-06-21T18:33:26,838           # Package would be ignored #
2024-06-21T18:33:26,838           ############################
2024-06-21T18:33:26,839           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-06-21T18:33:26,839           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,840           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,841           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-06-21T18:33:26,841           to the `packages` configuration field.

2024-06-21T18:33:26,842           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,843           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,843           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,844           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,844           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,845           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-06-21T18:33:26,845           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-06-21T18:33:26,846           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,846           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,846           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,847           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,848           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,849           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,849                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,850                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,850                 directory, all directories are treated like packages.
2024-06-21T18:33:26,851           ********************************************************************************

2024-06-21T18:33:26,851   !!
2024-06-21T18:33:26,852     check.warn(importable)
2024-06-21T18:33:26,852   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-06-21T18:33:26,853   !!

2024-06-21T18:33:26,854           ********************************************************************************
2024-06-21T18:33:26,854           ############################
2024-06-21T18:33:26,855           # Package would be ignored #
2024-06-21T18:33:26,855           ############################
2024-06-21T18:33:26,856           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-06-21T18:33:26,856           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,858           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,858           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-06-21T18:33:26,859           to the `packages` configuration field.

2024-06-21T18:33:26,860           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,860           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,860           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,861           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,862           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,863           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-06-21T18:33:26,864           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-06-21T18:33:26,864           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,865           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,865           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,866           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,867           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,868           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,869                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,869                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,869                 directory, all directories are treated like packages.
2024-06-21T18:33:26,870           ********************************************************************************

2024-06-21T18:33:26,870   !!
2024-06-21T18:33:26,870     check.warn(importable)
2024-06-21T18:33:26,871   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-06-21T18:33:26,871   !!

2024-06-21T18:33:26,872           ********************************************************************************
2024-06-21T18:33:26,872           ############################
2024-06-21T18:33:26,873           # Package would be ignored #
2024-06-21T18:33:26,873           ############################
2024-06-21T18:33:26,873           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-06-21T18:33:26,874           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,874           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,875           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-06-21T18:33:26,875           to the `packages` configuration field.

2024-06-21T18:33:26,876           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,877           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,879           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,880           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,881           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,883           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-06-21T18:33:26,883           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-06-21T18:33:26,884           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,884           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,885           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,886           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,887           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,888           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,889                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,889                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,890                 directory, all directories are treated like packages.
2024-06-21T18:33:26,891           ********************************************************************************

2024-06-21T18:33:26,892   !!
2024-06-21T18:33:26,892     check.warn(importable)
2024-06-21T18:33:26,893   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-06-21T18:33:26,893   !!

2024-06-21T18:33:26,894           ********************************************************************************
2024-06-21T18:33:26,895           ############################
2024-06-21T18:33:26,895           # Package would be ignored #
2024-06-21T18:33:26,896           ############################
2024-06-21T18:33:26,896           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-06-21T18:33:26,897           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,897           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,898           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-06-21T18:33:26,898           to the `packages` configuration field.

2024-06-21T18:33:26,899           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,899           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,899           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,900           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,901           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,902           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-06-21T18:33:26,902           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-06-21T18:33:26,902           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,903           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,903           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,904           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,905           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,906           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,907                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,907                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,908                 directory, all directories are treated like packages.
2024-06-21T18:33:26,908           ********************************************************************************

2024-06-21T18:33:26,910   !!
2024-06-21T18:33:26,910     check.warn(importable)
2024-06-21T18:33:26,911   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-06-21T18:33:26,911   !!

2024-06-21T18:33:26,912           ********************************************************************************
2024-06-21T18:33:26,913           ############################
2024-06-21T18:33:26,913           # Package would be ignored #
2024-06-21T18:33:26,914           ############################
2024-06-21T18:33:26,914           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-06-21T18:33:26,915           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,916           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,916           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-06-21T18:33:26,916           to the `packages` configuration field.

2024-06-21T18:33:26,917           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,918           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,918           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,919           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,920           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,921           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-06-21T18:33:26,922           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-06-21T18:33:26,923           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,924           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,924           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,925           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,925           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,926           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,927                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,927                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,928                 directory, all directories are treated like packages.
2024-06-21T18:33:26,928           ********************************************************************************

2024-06-21T18:33:26,929   !!
2024-06-21T18:33:26,929     check.warn(importable)
2024-06-21T18:33:26,930   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-06-21T18:33:26,930   !!

2024-06-21T18:33:26,931           ********************************************************************************
2024-06-21T18:33:26,931           ############################
2024-06-21T18:33:26,931           # Package would be ignored #
2024-06-21T18:33:26,932           ############################
2024-06-21T18:33:26,932           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-06-21T18:33:26,933           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,934           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,934           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-06-21T18:33:26,935           to the `packages` configuration field.

2024-06-21T18:33:26,936           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,936           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,937           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,938           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,939           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,940           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-06-21T18:33:26,941           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-06-21T18:33:26,941           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,942           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,942           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,943           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,944           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,946           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,946                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,947                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,947                 directory, all directories are treated like packages.
2024-06-21T18:33:26,948           ********************************************************************************

2024-06-21T18:33:26,949   !!
2024-06-21T18:33:26,950     check.warn(importable)
2024-06-21T18:33:26,951   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-06-21T18:33:26,951   !!

2024-06-21T18:33:26,953           ********************************************************************************
2024-06-21T18:33:26,953           ############################
2024-06-21T18:33:26,954           # Package would be ignored #
2024-06-21T18:33:26,954           ############################
2024-06-21T18:33:26,954           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-06-21T18:33:26,955           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,955           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,956           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-06-21T18:33:26,956           to the `packages` configuration field.

2024-06-21T18:33:26,957           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,958           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,958           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,959           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,959           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,960           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-06-21T18:33:26,961           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-06-21T18:33:26,961           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,961           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,962           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,963           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,964           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,966           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,966                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,967                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,967                 directory, all directories are treated like packages.
2024-06-21T18:33:26,968           ********************************************************************************

2024-06-21T18:33:26,969   !!
2024-06-21T18:33:26,969     check.warn(importable)
2024-06-21T18:33:26,970   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-06-21T18:33:26,970   !!

2024-06-21T18:33:26,971           ********************************************************************************
2024-06-21T18:33:26,971           ############################
2024-06-21T18:33:26,972           # Package would be ignored #
2024-06-21T18:33:26,972           ############################
2024-06-21T18:33:26,973           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-06-21T18:33:26,973           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,974           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,975           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-06-21T18:33:26,975           to the `packages` configuration field.

2024-06-21T18:33:26,976           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,977           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,977           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,978           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,978           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,979           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-06-21T18:33:26,979           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-06-21T18:33:26,980           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,980           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:26,981           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:26,981           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:26,982           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:26,983           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:26,983                 even if it does not contain any `.py` files.
2024-06-21T18:33:26,984                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:26,984                 directory, all directories are treated like packages.
2024-06-21T18:33:26,985           ********************************************************************************

2024-06-21T18:33:26,985   !!
2024-06-21T18:33:26,986     check.warn(importable)
2024-06-21T18:33:26,986   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-06-21T18:33:26,987   !!

2024-06-21T18:33:26,988           ********************************************************************************
2024-06-21T18:33:26,989           ############################
2024-06-21T18:33:26,989           # Package would be ignored #
2024-06-21T18:33:26,990           ############################
2024-06-21T18:33:26,990           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-06-21T18:33:26,991           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:26,992           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:26,992           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-06-21T18:33:26,993           to the `packages` configuration field.

2024-06-21T18:33:26,994           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:26,994           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:26,995           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:26,996           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:26,996           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:26,997           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-06-21T18:33:26,998           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-06-21T18:33:26,998           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:26,999           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,000           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,001           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,002           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,003           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,004                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,004                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,005                 directory, all directories are treated like packages.
2024-06-21T18:33:27,005           ********************************************************************************

2024-06-21T18:33:27,007   !!
2024-06-21T18:33:27,008     check.warn(importable)
2024-06-21T18:33:27,009   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-06-21T18:33:27,010   !!

2024-06-21T18:33:27,231           ********************************************************************************
2024-06-21T18:33:27,232           ############################
2024-06-21T18:33:27,233           # Package would be ignored #
2024-06-21T18:33:27,233           ############################
2024-06-21T18:33:27,234           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-06-21T18:33:27,234           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,235           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,236           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-06-21T18:33:27,237           to the `packages` configuration field.

2024-06-21T18:33:27,238           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,239           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,239           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,241           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,242           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,244           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-06-21T18:33:27,244           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-06-21T18:33:27,245           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,246           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,247           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,248           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,249           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,251           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,252                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,252                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,253                 directory, all directories are treated like packages.
2024-06-21T18:33:27,254           ********************************************************************************

2024-06-21T18:33:27,256   !!
2024-06-21T18:33:27,256     check.warn(importable)
2024-06-21T18:33:27,257   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-06-21T18:33:27,258   !!

2024-06-21T18:33:27,260           ********************************************************************************
2024-06-21T18:33:27,260           ############################
2024-06-21T18:33:27,261           # Package would be ignored #
2024-06-21T18:33:27,262           ############################
2024-06-21T18:33:27,262           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-06-21T18:33:27,263           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,264           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,265           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-06-21T18:33:27,265           to the `packages` configuration field.

2024-06-21T18:33:27,266           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,267           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,268           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,269           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,270           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,271           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-06-21T18:33:27,272           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-06-21T18:33:27,272           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,273           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,274           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,276           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,277           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,280           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,280                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,281                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,282                 directory, all directories are treated like packages.
2024-06-21T18:33:27,283           ********************************************************************************

2024-06-21T18:33:27,284   !!
2024-06-21T18:33:27,285     check.warn(importable)
2024-06-21T18:33:27,286   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-06-21T18:33:27,287   !!

2024-06-21T18:33:27,288           ********************************************************************************
2024-06-21T18:33:27,289           ############################
2024-06-21T18:33:27,289           # Package would be ignored #
2024-06-21T18:33:27,290           ############################
2024-06-21T18:33:27,291           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-06-21T18:33:27,292           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,293           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,294           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-06-21T18:33:27,295           to the `packages` configuration field.

2024-06-21T18:33:27,296           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,297           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,298           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,300           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,301           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,302           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-06-21T18:33:27,303           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-06-21T18:33:27,303           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,304           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,304           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,306           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,307           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,309           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,309                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,310                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,310                 directory, all directories are treated like packages.
2024-06-21T18:33:27,311           ********************************************************************************

2024-06-21T18:33:27,312   !!
2024-06-21T18:33:27,313     check.warn(importable)
2024-06-21T18:33:27,313   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-06-21T18:33:27,314   !!

2024-06-21T18:33:27,315           ********************************************************************************
2024-06-21T18:33:27,317           ############################
2024-06-21T18:33:27,317           # Package would be ignored #
2024-06-21T18:33:27,318           ############################
2024-06-21T18:33:27,319           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-06-21T18:33:27,319           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,321           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,322           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-06-21T18:33:27,322           to the `packages` configuration field.

2024-06-21T18:33:27,324           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,324           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,325           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,327           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,328           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,329           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-06-21T18:33:27,330           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-06-21T18:33:27,331           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,332           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,332           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,334           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,336           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,338           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,339                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,340                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,341                 directory, all directories are treated like packages.
2024-06-21T18:33:27,341           ********************************************************************************

2024-06-21T18:33:27,343   !!
2024-06-21T18:33:27,343     check.warn(importable)
2024-06-21T18:33:27,344   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-06-21T18:33:27,345   !!

2024-06-21T18:33:27,346           ********************************************************************************
2024-06-21T18:33:27,346           ############################
2024-06-21T18:33:27,347           # Package would be ignored #
2024-06-21T18:33:27,348           ############################
2024-06-21T18:33:27,348           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-06-21T18:33:27,349           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,350           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,351           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-06-21T18:33:27,351           to the `packages` configuration field.

2024-06-21T18:33:27,352           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,353           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,354           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,355           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,356           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,357           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-06-21T18:33:27,358           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-06-21T18:33:27,358           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,359           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,359           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,361           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,362           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,363           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,364                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,365                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,365                 directory, all directories are treated like packages.
2024-06-21T18:33:27,366           ********************************************************************************

2024-06-21T18:33:27,367   !!
2024-06-21T18:33:27,367     check.warn(importable)
2024-06-21T18:33:27,368   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-06-21T18:33:27,368   !!

2024-06-21T18:33:27,369           ********************************************************************************
2024-06-21T18:33:27,370           ############################
2024-06-21T18:33:27,370           # Package would be ignored #
2024-06-21T18:33:27,371           ############################
2024-06-21T18:33:27,372           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-06-21T18:33:27,372           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,373           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,374           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-06-21T18:33:27,375           to the `packages` configuration field.

2024-06-21T18:33:27,376           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,376           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,376           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,377           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,378           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,379           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-06-21T18:33:27,379           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-06-21T18:33:27,380           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,380           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,381           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,382           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,382           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,384           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,384                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,385                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,385                 directory, all directories are treated like packages.
2024-06-21T18:33:27,386           ********************************************************************************

2024-06-21T18:33:27,387   !!
2024-06-21T18:33:27,387     check.warn(importable)
2024-06-21T18:33:27,388   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-06-21T18:33:27,388   !!

2024-06-21T18:33:27,389           ********************************************************************************
2024-06-21T18:33:27,390           ############################
2024-06-21T18:33:27,390           # Package would be ignored #
2024-06-21T18:33:27,391           ############################
2024-06-21T18:33:27,391           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-06-21T18:33:27,392           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,393           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,394           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-06-21T18:33:27,394           to the `packages` configuration field.

2024-06-21T18:33:27,395           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,396           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,396           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,397           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,398           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,399           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-06-21T18:33:27,400           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-06-21T18:33:27,400           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,401           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,402           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,403           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,404           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,405           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,405                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,406                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,406                 directory, all directories are treated like packages.
2024-06-21T18:33:27,407           ********************************************************************************

2024-06-21T18:33:27,407   !!
2024-06-21T18:33:27,408     check.warn(importable)
2024-06-21T18:33:27,408   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-06-21T18:33:27,409   !!

2024-06-21T18:33:27,410           ********************************************************************************
2024-06-21T18:33:27,410           ############################
2024-06-21T18:33:27,410           # Package would be ignored #
2024-06-21T18:33:27,411           ############################
2024-06-21T18:33:27,411           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-06-21T18:33:27,412           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,413           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,413           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-06-21T18:33:27,414           to the `packages` configuration field.

2024-06-21T18:33:27,415           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,415           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,416           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,417           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,418           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,419           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-06-21T18:33:27,419           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-06-21T18:33:27,420           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,420           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,421           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,422           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,423           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,425           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,425                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,426                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,426                 directory, all directories are treated like packages.
2024-06-21T18:33:27,427           ********************************************************************************

2024-06-21T18:33:27,428   !!
2024-06-21T18:33:27,428     check.warn(importable)
2024-06-21T18:33:27,429   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-06-21T18:33:27,429   !!

2024-06-21T18:33:27,431           ********************************************************************************
2024-06-21T18:33:27,431           ############################
2024-06-21T18:33:27,432           # Package would be ignored #
2024-06-21T18:33:27,432           ############################
2024-06-21T18:33:27,433           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-06-21T18:33:27,433           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,434           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,435           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-06-21T18:33:27,435           to the `packages` configuration field.

2024-06-21T18:33:27,436           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,436           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,437           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,437           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,438           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,439           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-06-21T18:33:27,440           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-06-21T18:33:27,440           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,441           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,441           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,442           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,443           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,445           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,445                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,446                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,446                 directory, all directories are treated like packages.
2024-06-21T18:33:27,447           ********************************************************************************

2024-06-21T18:33:27,448   !!
2024-06-21T18:33:27,448     check.warn(importable)
2024-06-21T18:33:27,449   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-06-21T18:33:27,449   !!

2024-06-21T18:33:27,450           ********************************************************************************
2024-06-21T18:33:27,451           ############################
2024-06-21T18:33:27,451           # Package would be ignored #
2024-06-21T18:33:27,452           ############################
2024-06-21T18:33:27,452           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-06-21T18:33:27,453           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,454           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,454           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-06-21T18:33:27,455           to the `packages` configuration field.

2024-06-21T18:33:27,456           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,457           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,457           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,458           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,459           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,460           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-06-21T18:33:27,461           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-06-21T18:33:27,461           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,462           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,462           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,463           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,464           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,465           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,466                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,466                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,466                 directory, all directories are treated like packages.
2024-06-21T18:33:27,467           ********************************************************************************

2024-06-21T18:33:27,468   !!
2024-06-21T18:33:27,468     check.warn(importable)
2024-06-21T18:33:27,469   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-06-21T18:33:27,469   !!

2024-06-21T18:33:27,470           ********************************************************************************
2024-06-21T18:33:27,470           ############################
2024-06-21T18:33:27,471           # Package would be ignored #
2024-06-21T18:33:27,472           ############################
2024-06-21T18:33:27,472           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-06-21T18:33:27,472           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,473           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,474           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-06-21T18:33:27,474           to the `packages` configuration field.

2024-06-21T18:33:27,475           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,476           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,476           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,477           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,478           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,479           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-06-21T18:33:27,480           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-06-21T18:33:27,480           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,480           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,481           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,482           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,483           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,484           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,485                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,485                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,486                 directory, all directories are treated like packages.
2024-06-21T18:33:27,486           ********************************************************************************

2024-06-21T18:33:27,487   !!
2024-06-21T18:33:27,488     check.warn(importable)
2024-06-21T18:33:27,488   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-06-21T18:33:27,489   !!

2024-06-21T18:33:27,489           ********************************************************************************
2024-06-21T18:33:27,490           ############################
2024-06-21T18:33:27,490           # Package would be ignored #
2024-06-21T18:33:27,491           ############################
2024-06-21T18:33:27,491           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-06-21T18:33:27,491           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,492           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,493           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-06-21T18:33:27,493           to the `packages` configuration field.

2024-06-21T18:33:27,494           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,495           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,495           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,496           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,497           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,498           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-06-21T18:33:27,498           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-06-21T18:33:27,499           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,499           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,500           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,500           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,502           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,503           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,504                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,504                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,504                 directory, all directories are treated like packages.
2024-06-21T18:33:27,505           ********************************************************************************

2024-06-21T18:33:27,506   !!
2024-06-21T18:33:27,506     check.warn(importable)
2024-06-21T18:33:27,507   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-06-21T18:33:27,507   !!

2024-06-21T18:33:27,508           ********************************************************************************
2024-06-21T18:33:27,509           ############################
2024-06-21T18:33:27,510           # Package would be ignored #
2024-06-21T18:33:27,510           ############################
2024-06-21T18:33:27,511           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-06-21T18:33:27,511           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,512           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,513           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-06-21T18:33:27,514           to the `packages` configuration field.

2024-06-21T18:33:27,514           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,515           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,516           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,516           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,517           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,518           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-06-21T18:33:27,519           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-06-21T18:33:27,519           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,520           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,520           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,521           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,522           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,523           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,523                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,524                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,524                 directory, all directories are treated like packages.
2024-06-21T18:33:27,525           ********************************************************************************

2024-06-21T18:33:27,526   !!
2024-06-21T18:33:27,526     check.warn(importable)
2024-06-21T18:33:27,527   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-06-21T18:33:27,527   !!

2024-06-21T18:33:27,528           ********************************************************************************
2024-06-21T18:33:27,529           ############################
2024-06-21T18:33:27,529           # Package would be ignored #
2024-06-21T18:33:27,530           ############################
2024-06-21T18:33:27,530           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-06-21T18:33:27,531           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,532           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,533           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-06-21T18:33:27,533           to the `packages` configuration field.

2024-06-21T18:33:27,535           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,536           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,536           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,537           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,538           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,539           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-06-21T18:33:27,540           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-06-21T18:33:27,540           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,541           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,541           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,542           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,543           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,544           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,545                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,545                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,546                 directory, all directories are treated like packages.
2024-06-21T18:33:27,546           ********************************************************************************

2024-06-21T18:33:27,547   !!
2024-06-21T18:33:27,547     check.warn(importable)
2024-06-21T18:33:27,548   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-06-21T18:33:27,548   !!

2024-06-21T18:33:27,549           ********************************************************************************
2024-06-21T18:33:27,549           ############################
2024-06-21T18:33:27,550           # Package would be ignored #
2024-06-21T18:33:27,550           ############################
2024-06-21T18:33:27,551           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-06-21T18:33:27,551           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,552           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,552           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-06-21T18:33:27,553           to the `packages` configuration field.

2024-06-21T18:33:27,554           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,554           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,555           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,556           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,557           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,558           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-06-21T18:33:27,558           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-06-21T18:33:27,559           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,559           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,560           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,561           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,562           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,563           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,564                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,564                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,565                 directory, all directories are treated like packages.
2024-06-21T18:33:27,566           ********************************************************************************

2024-06-21T18:33:27,567   !!
2024-06-21T18:33:27,567     check.warn(importable)
2024-06-21T18:33:27,568   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-06-21T18:33:27,568   !!

2024-06-21T18:33:27,569           ********************************************************************************
2024-06-21T18:33:27,570           ############################
2024-06-21T18:33:27,570           # Package would be ignored #
2024-06-21T18:33:27,571           ############################
2024-06-21T18:33:27,572           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-06-21T18:33:27,572           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,573           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,573           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-06-21T18:33:27,574           to the `packages` configuration field.

2024-06-21T18:33:27,575           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,575           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,576           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,576           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,577           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,579           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-06-21T18:33:27,579           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-06-21T18:33:27,580           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,580           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,581           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,582           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,582           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,584           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,585                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,585                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,585                 directory, all directories are treated like packages.
2024-06-21T18:33:27,586           ********************************************************************************

2024-06-21T18:33:27,587   !!
2024-06-21T18:33:27,587     check.warn(importable)
2024-06-21T18:33:27,588   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-06-21T18:33:27,588   !!

2024-06-21T18:33:27,589           ********************************************************************************
2024-06-21T18:33:27,590           ############################
2024-06-21T18:33:27,590           # Package would be ignored #
2024-06-21T18:33:27,591           ############################
2024-06-21T18:33:27,592           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-06-21T18:33:27,592           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,593           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,593           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-06-21T18:33:27,594           to the `packages` configuration field.

2024-06-21T18:33:27,595           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,596           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,596           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,597           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,598           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,600           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-06-21T18:33:27,600           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-06-21T18:33:27,601           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,601           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,602           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,603           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,604           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,605           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,606                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,606                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,607                 directory, all directories are treated like packages.
2024-06-21T18:33:27,607           ********************************************************************************

2024-06-21T18:33:27,608   !!
2024-06-21T18:33:27,608     check.warn(importable)
2024-06-21T18:33:27,609   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-06-21T18:33:27,609   !!

2024-06-21T18:33:27,611           ********************************************************************************
2024-06-21T18:33:27,611           ############################
2024-06-21T18:33:27,612           # Package would be ignored #
2024-06-21T18:33:27,613           ############################
2024-06-21T18:33:27,613           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-06-21T18:33:27,614           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,615           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,615           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-06-21T18:33:27,616           to the `packages` configuration field.

2024-06-21T18:33:27,617           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,617           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,618           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,619           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,620           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,622           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-06-21T18:33:27,622           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-06-21T18:33:27,623           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,623           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,624           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,625           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,627           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,628           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,629                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,629                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,630                 directory, all directories are treated like packages.
2024-06-21T18:33:27,630           ********************************************************************************

2024-06-21T18:33:27,632   !!
2024-06-21T18:33:27,633     check.warn(importable)
2024-06-21T18:33:27,633   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-06-21T18:33:27,634   !!

2024-06-21T18:33:27,635           ********************************************************************************
2024-06-21T18:33:27,635           ############################
2024-06-21T18:33:27,636           # Package would be ignored #
2024-06-21T18:33:27,636           ############################
2024-06-21T18:33:27,637           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-06-21T18:33:27,637           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,638           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,639           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-06-21T18:33:27,640           to the `packages` configuration field.

2024-06-21T18:33:27,641           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,641           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,642           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,643           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,644           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,645           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-06-21T18:33:27,646           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-06-21T18:33:27,646           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,647           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,647           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,648           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,649           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,651           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,651                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,652                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,652                 directory, all directories are treated like packages.
2024-06-21T18:33:27,653           ********************************************************************************

2024-06-21T18:33:27,654   !!
2024-06-21T18:33:27,655     check.warn(importable)
2024-06-21T18:33:27,655   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-06-21T18:33:27,656   !!

2024-06-21T18:33:27,657           ********************************************************************************
2024-06-21T18:33:27,657           ############################
2024-06-21T18:33:27,658           # Package would be ignored #
2024-06-21T18:33:27,658           ############################
2024-06-21T18:33:27,659           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-06-21T18:33:27,659           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,660           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,661           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-06-21T18:33:27,661           to the `packages` configuration field.

2024-06-21T18:33:27,663           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,663           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,664           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,665           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,666           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,667           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-06-21T18:33:27,667           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-06-21T18:33:27,668           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,668           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,668           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,669           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,670           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,672           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,672                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,673                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,673                 directory, all directories are treated like packages.
2024-06-21T18:33:27,674           ********************************************************************************

2024-06-21T18:33:27,675   !!
2024-06-21T18:33:27,675     check.warn(importable)
2024-06-21T18:33:27,676   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-06-21T18:33:27,676   !!

2024-06-21T18:33:27,677           ********************************************************************************
2024-06-21T18:33:27,678           ############################
2024-06-21T18:33:27,678           # Package would be ignored #
2024-06-21T18:33:27,679           ############################
2024-06-21T18:33:27,679           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-06-21T18:33:27,680           but it is absent from setuptools' `packages` configuration.

2024-06-21T18:33:27,681           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-21T18:33:27,681           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-06-21T18:33:27,682           to the `packages` configuration field.

2024-06-21T18:33:27,683           Alternatively, you can also rely on setuptools' discovery methods
2024-06-21T18:33:27,684           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-21T18:33:27,684           instead of `find_packages(...)`/`find:`).

2024-06-21T18:33:27,685           You can read more about "package discovery" on setuptools documentation page:

2024-06-21T18:33:27,687           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-21T18:33:27,688           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-06-21T18:33:27,688           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-06-21T18:33:27,689           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-21T18:33:27,690           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-21T18:33:27,690           combination with a more fine grained `package-data` configuration.

2024-06-21T18:33:27,691           You can read more about "package data files" on setuptools documentation page:

2024-06-21T18:33:27,692           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-21T18:33:27,694           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-21T18:33:27,694                 even if it does not contain any `.py` files.
2024-06-21T18:33:27,695                 On the other hand, currently there is no concept of package data
2024-06-21T18:33:27,696                 directory, all directories are treated like packages.
2024-06-21T18:33:27,696           ********************************************************************************

2024-06-21T18:33:27,697   !!
2024-06-21T18:33:27,697     check.warn(importable)
2024-06-21T18:33:27,698   creating build/lib/deepspeed/ops/csrc
2024-06-21T18:33:27,698   creating build/lib/deepspeed/ops/csrc/adagrad
2024-06-21T18:33:27,699   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-06-21T18:33:27,699   creating build/lib/deepspeed/ops/csrc/adam
2024-06-21T18:33:27,700   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-06-21T18:33:27,700   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-06-21T18:33:27,700   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-06-21T18:33:27,701   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-06-21T18:33:27,701   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-06-21T18:33:27,702   creating build/lib/deepspeed/ops/csrc/aio
2024-06-21T18:33:27,702   creating build/lib/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:27,702   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:27,703   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:27,703   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:27,704   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:27,704   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:27,705   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:27,705   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,706   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,706   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,707   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,707   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,708   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,708   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,709   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,709   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,710   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,710   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,711   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:27,711   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-06-21T18:33:27,712   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-06-21T18:33:27,712   creating build/lib/deepspeed/ops/csrc/cpu
2024-06-21T18:33:27,713   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-06-21T18:33:27,713   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-06-21T18:33:27,714   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-06-21T18:33:27,714   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-06-21T18:33:27,715   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-06-21T18:33:27,715   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-06-21T18:33:27,716   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-06-21T18:33:27,716   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-06-21T18:33:27,716   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-06-21T18:33:27,717   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-06-21T18:33:27,717   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:27,718   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:27,718   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:27,719   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:27,719   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:27,719   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:27,720   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:27,720   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-21T18:33:27,721   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-21T18:33:27,721   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-21T18:33:27,722   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-21T18:33:27,722   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-21T18:33:27,723   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:27,723   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:27,724   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:27,724   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:27,724   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:27,725   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:27,725   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:27,726   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:27,727   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:27,727   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:27,727   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:27,728   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:27,728   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:27,729   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:27,729   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:27,729   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:27,730   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-21T18:33:27,730   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-21T18:33:27,731   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-21T18:33:27,731   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-06-21T18:33:27,732   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-06-21T18:33:27,732   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-06-21T18:33:27,733   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-21T18:33:27,733   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-21T18:33:27,734   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-21T18:33:27,734   creating build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,735   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,735   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,736   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,736   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,737   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,737   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,738   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,738   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,738   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,739   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,740   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,740   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,741   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,741   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,742   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,742   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,743   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,743   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,744   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,745   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,745   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,746   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,746   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,746   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,747   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,748   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,748   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,749   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,749   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-21T18:33:27,750   creating build/lib/deepspeed/ops/csrc/lamb
2024-06-21T18:33:27,751   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-06-21T18:33:27,751   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-06-21T18:33:27,752   creating build/lib/deepspeed/ops/csrc/lion
2024-06-21T18:33:27,752   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-06-21T18:33:27,753   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-06-21T18:33:27,753   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-06-21T18:33:27,754   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-06-21T18:33:27,754   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-06-21T18:33:27,755   creating build/lib/deepspeed/ops/csrc/quantization
2024-06-21T18:33:27,756   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-21T18:33:27,756   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-21T18:33:27,757   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-06-21T18:33:27,757   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-21T18:33:27,758   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-21T18:33:27,758   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-21T18:33:27,759   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-21T18:33:27,760   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-06-21T18:33:27,760   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-06-21T18:33:27,763   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-06-21T18:33:27,765   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-06-21T18:33:27,767   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-06-21T18:33:27,769   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-06-21T18:33:27,770   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-06-21T18:33:27,773   creating build/lib/deepspeed/ops/csrc/spatial
2024-06-21T18:33:27,773   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-06-21T18:33:27,774   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-06-21T18:33:27,777   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-06-21T18:33:27,779   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-06-21T18:33:27,779   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-06-21T18:33:27,782   creating build/lib/deepspeed/ops/csrc/transformer
2024-06-21T18:33:27,783   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-21T18:33:27,785   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-21T18:33:27,788   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-06-21T18:33:27,792   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-21T18:33:27,794   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-21T18:33:27,797   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-21T18:33:27,801   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-21T18:33:27,804   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-21T18:33:27,807   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-06-21T18:33:27,807   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,808   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,811   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,814   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,816   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,819   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,821   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,825   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,827   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,830   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,833   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:27,836   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-06-21T18:33:27,837   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-06-21T18:33:27,839   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-06-21T18:33:27,842   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-06-21T18:33:27,844   creating build/lib/deepspeed/ops/csrc/utils
2024-06-21T18:33:27,845   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-06-21T18:33:27,847   creating build/lib/deepspeed/ops/csrc/xpu
2024-06-21T18:33:27,847   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-06-21T18:33:27,848   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-06-21T18:33:27,851   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:27,852   copying deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:27,854   copying deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:27,856   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:27,858   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:27,860   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:27,862   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-06-21T18:33:27,863   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-06-21T18:33:27,866   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:27,866   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:27,869   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:27,871   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:27,874   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:27,876   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:27,878   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-06-21T18:33:27,879   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-06-21T18:33:27,882   creating build/lib/deepspeed/autotuning/config_templates
2024-06-21T18:33:27,883   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-06-21T18:33:27,885   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-06-21T18:33:27,886   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-06-21T18:33:27,888   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-06-21T18:33:27,890   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-06-21T18:33:27,893   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-06-21T18:33:27,895   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-06-21T18:33:27,897   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-06-21T18:33:27,898   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-06-21T18:33:27,900   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-06-21T18:33:27,902   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-06-21T18:33:27,903   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-06-21T18:33:27,905   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:27,906   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:27,908   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:27,910   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:27,912   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:27,915   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:27,918   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-21T18:33:27,920   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-06-21T18:33:27,921   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-06-21T18:33:27,923   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-06-21T18:33:27,925   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-06-21T18:33:27,926   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-06-21T18:33:27,927   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-06-21T18:33:27,929   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-21T18:33:27,930   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-21T18:33:27,932   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-21T18:33:27,934   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-21T18:33:27,936   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:27,939   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:27,941   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:27,943   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:27,945   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:27,947   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:27,949   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:27,951   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:27,954   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:27,956   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:27,959   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:27,961   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:27,965   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-21T18:33:27,967   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-21T18:33:27,970   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:27,972   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:27,974   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:27,977   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:27,979   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:27,980   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:27,982   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:27,985   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:27,987   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:27,989   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:27,992   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:27,994   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:27,996   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:27,998   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:28,001   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:28,003   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:28,006   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:28,008   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:28,010   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:28,012   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:28,014   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:28,016   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:28,018   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:28,020   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:28,022   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:28,024   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:28,026   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:28,028   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:28,030   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:28,032   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:28,034   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:28,036   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:28,039   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:28,041   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:28,043   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:28,045   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:28,047   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-21T18:33:28,049   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-21T18:33:28,051   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:28,054   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:28,056   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:28,058   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:28,061   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:28,063   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:28,065   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:28,067   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:28,069   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:28,071   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:28,073   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:28,075   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:28,126   running build_scripts
2024-06-21T18:33:28,126   creating build/scripts-3.11
2024-06-21T18:33:28,127   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-06-21T18:33:28,129   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-06-21T18:33:28,130   copying and adjusting bin/ds -> build/scripts-3.11
2024-06-21T18:33:28,132   copying bin/ds_ssh -> build/scripts-3.11
2024-06-21T18:33:28,134   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-06-21T18:33:28,135   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-06-21T18:33:28,136   copying and adjusting bin/dsr -> build/scripts-3.11
2024-06-21T18:33:28,138   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-06-21T18:33:28,139   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-06-21T18:33:28,139   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-06-21T18:33:28,140   changing mode of build/scripts-3.11/ds from 644 to 755
2024-06-21T18:33:28,141   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-06-21T18:33:28,141   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-06-21T18:33:28,142   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-06-21T18:33:28,142   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-06-21T18:33:28,168   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-06-21T18:33:28,169   !!

2024-06-21T18:33:28,170           ********************************************************************************
2024-06-21T18:33:28,170           Please avoid running ``setup.py`` directly.
2024-06-21T18:33:28,171           Instead, use pypa/build, pypa/installer or other
2024-06-21T18:33:28,172           standards-based tools.

2024-06-21T18:33:28,173           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-06-21T18:33:28,173           ********************************************************************************

2024-06-21T18:33:28,175   !!
2024-06-21T18:33:28,175     self.initialize_options()
2024-06-21T18:33:28,197   installing to build/bdist.linux-armv7l/wheel
2024-06-21T18:33:28,198   running install
2024-06-21T18:33:28,222   running install_lib
2024-06-21T18:33:28,248   creating build/bdist.linux-armv7l
2024-06-21T18:33:28,249   creating build/bdist.linux-armv7l/wheel
2024-06-21T18:33:28,250   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-06-21T18:33:28,252   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-06-21T18:33:28,253   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-06-21T18:33:28,254   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-06-21T18:33:28,256   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-06-21T18:33:28,258   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-06-21T18:33:28,260   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-06-21T18:33:28,262   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-06-21T18:33:28,263   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-06-21T18:33:28,265   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-06-21T18:33:28,267   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,268   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,270   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,272   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,274   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,275   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,277   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,279   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,281   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,283   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,285   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-21T18:33:28,286   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-21T18:33:28,288   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-21T18:33:28,290   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-21T18:33:28,292   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-21T18:33:28,294   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-21T18:33:28,295   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-21T18:33:28,297   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-21T18:33:28,299   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-21T18:33:28,301   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-21T18:33:28,304   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,305   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,307   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,308   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,310   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,312   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,314   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,316   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,317   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,319   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,321   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-21T18:33:28,323   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,325   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,327   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,329   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,330   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,333   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,335   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:28,336   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:28,338   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:28,340   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:28,342   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:28,344   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-21T18:33:28,346   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:28,347   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:28,349   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:28,350   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:28,352   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:28,354   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:28,356   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-21T18:33:28,358   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,359   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,361   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,363   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,365   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,366   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,368   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,370   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-21T18:33:28,372   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-21T18:33:28,373   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-21T18:33:28,376   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-21T18:33:28,379   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-21T18:33:28,382   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-21T18:33:28,384   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-21T18:33:28,386   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-21T18:33:28,388   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-06-21T18:33:28,389   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-06-21T18:33:28,391   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-06-21T18:33:28,393   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-06-21T18:33:28,395   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-06-21T18:33:28,397   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-21T18:33:28,399   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-06-21T18:33:28,401   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-06-21T18:33:28,403   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-06-21T18:33:28,405   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-06-21T18:33:28,406   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-06-21T18:33:28,408   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-06-21T18:33:28,410   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-06-21T18:33:28,411   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-21T18:33:28,413   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-21T18:33:28,414   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-21T18:33:28,416   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-21T18:33:28,418   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-21T18:33:28,420   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-21T18:33:28,422   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-06-21T18:33:28,423   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-06-21T18:33:28,425   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-06-21T18:33:28,428   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-06-21T18:33:28,429   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:28,430   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:28,433   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:28,435   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:28,437   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:28,440   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-21T18:33:28,442   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-06-21T18:33:28,443   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-06-21T18:33:28,445   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:28,447   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:28,449   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:28,451   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:28,453   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:28,455   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-21T18:33:28,457   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-06-21T18:33:28,459   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-06-21T18:33:28,463   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-06-21T18:33:28,464   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-06-21T18:33:28,468   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-06-21T18:33:28,469   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-06-21T18:33:28,472   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-06-21T18:33:28,474   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:28,475   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:28,477   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:28,478   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:28,482   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:28,485   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:28,488   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:28,490   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:28,493   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:28,496   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-21T18:33:28,499   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:28,503   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:28,506   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-21T18:33:28,506   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-21T18:33:28,509   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-21T18:33:28,512   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-21T18:33:28,514   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-21T18:33:28,516   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:28,519   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-21T18:33:28,520   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-21T18:33:28,522   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-21T18:33:28,525   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:28,531   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:28,531   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:28,533   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:28,536   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:28,540   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:28,542   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:28,546   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:28,550   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-21T18:33:28,552   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-21T18:33:28,556   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-06-21T18:33:28,557   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-06-21T18:33:28,559   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-06-21T18:33:28,561   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-06-21T18:33:28,563   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-06-21T18:33:28,565   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-06-21T18:33:28,566   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-06-21T18:33:28,569   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-06-21T18:33:28,570   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-06-21T18:33:28,572   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-06-21T18:33:28,574   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-06-21T18:33:28,576   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-06-21T18:33:28,579   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-06-21T18:33:28,580   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-06-21T18:33:28,582   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-06-21T18:33:28,585   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-06-21T18:33:28,587   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-06-21T18:33:28,589   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-06-21T18:33:28,590   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:28,591   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:28,593   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:28,595   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:28,597   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:28,599   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:28,601   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-21T18:33:28,604   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-06-21T18:33:28,605   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-06-21T18:33:28,608   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,609   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,611   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,613   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,615   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,617   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,620   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,622   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,624   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,626   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,628   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,630   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-21T18:33:28,633   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-21T18:33:28,634   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-21T18:33:28,636   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-21T18:33:28,638   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-21T18:33:28,640   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-21T18:33:28,642   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-21T18:33:28,645   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-21T18:33:28,648   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-21T18:33:28,650   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,651   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,653   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,656   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,659   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,661   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,664   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,668   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,672   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,674   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,676   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,679   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,681   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,683   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,685   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,688   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,691   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,694   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,696   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,699   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,701   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,703   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,706   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,708   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,711   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,714   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,716   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,719   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,721   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,723   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-21T18:33:28,726   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-06-21T18:33:28,728   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-06-21T18:33:28,729   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-06-21T18:33:28,731   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-06-21T18:33:28,734   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-06-21T18:33:28,735   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-06-21T18:33:28,742   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-21T18:33:28,744   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-21T18:33:28,747   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-06-21T18:33:28,749   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:28,750   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:28,971   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:28,976   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:28,980   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:28,984   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:28,991   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:28,996   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:29,002   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:29,007   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:29,010   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-21T18:33:29,016   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-06-21T18:33:29,018   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-06-21T18:33:29,022   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-06-21T18:33:29,026   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-06-21T18:33:29,030   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-21T18:33:29,034   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-21T18:33:29,041   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-21T18:33:29,046   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-21T18:33:29,050   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-21T18:33:29,055   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-21T18:33:29,060   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-21T18:33:29,065   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-06-21T18:33:29,066   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-06-21T18:33:29,071   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-21T18:33:29,073   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-21T18:33:29,076   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-21T18:33:29,079   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-21T18:33:29,083   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-21T18:33:29,087   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-21T18:33:29,091   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-06-21T18:33:29,093   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-06-21T18:33:29,098   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-21T18:33:29,101   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-21T18:33:29,104   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-21T18:33:29,107   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-06-21T18:33:29,110   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-06-21T18:33:29,111   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-06-21T18:33:29,114   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-06-21T18:33:29,116   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-06-21T18:33:29,118   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-06-21T18:33:29,119   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-06-21T18:33:29,122   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-06-21T18:33:29,124   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,125   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,128   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,130   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,133   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,135   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,137   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,140   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,141   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,143   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,146   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,149   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,154   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,157   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,159   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,161   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,163   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,166   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-21T18:33:29,169   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,172   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,174   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,177   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-21T18:33:29,180   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,181   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,183   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,185   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,187   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,190   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,192   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,194   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,197   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,199   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,201   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-21T18:33:29,203   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-06-21T18:33:29,206   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-06-21T18:33:29,208   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-06-21T18:33:29,210   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-06-21T18:33:29,213   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-06-21T18:33:29,216   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-06-21T18:33:29,217   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-06-21T18:33:29,220   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-06-21T18:33:29,222   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-06-21T18:33:29,224   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-06-21T18:33:29,227   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-06-21T18:33:29,228   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-06-21T18:33:29,232   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-06-21T18:33:29,235   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-21T18:33:29,237   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-21T18:33:29,239   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-06-21T18:33:29,241   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-06-21T18:33:29,243   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-21T18:33:29,244   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-21T18:33:29,247   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-21T18:33:29,249   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-21T18:33:29,251   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-21T18:33:29,254   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-21T18:33:29,257   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-21T18:33:29,258   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-21T18:33:29,260   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-21T18:33:29,262   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-21T18:33:29,264   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-21T18:33:29,266   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-21T18:33:29,269   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-06-21T18:33:29,271   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-06-21T18:33:29,274   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-06-21T18:33:29,276   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-21T18:33:29,278   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-21T18:33:29,281   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-06-21T18:33:29,282   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-06-21T18:33:29,284   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-21T18:33:29,287   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-21T18:33:29,289   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-21T18:33:29,291   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-21T18:33:29,294   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-21T18:33:29,296   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-21T18:33:29,298   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-06-21T18:33:29,300   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-21T18:33:29,301   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-21T18:33:29,303   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:29,304   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:29,306   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:29,308   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:29,310   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:29,311   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:29,313   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-21T18:33:29,315   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-21T18:33:29,317   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-06-21T18:33:29,318   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-06-21T18:33:29,320   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:29,321   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:29,323   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:29,325   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:29,326   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:29,328   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-21T18:33:29,331   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-06-21T18:33:29,332   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:29,333   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:29,335   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:29,337   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:29,340   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:29,342   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:29,344   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:29,345   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-21T18:33:29,347   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-06-21T18:33:29,349   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:29,350   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:29,352   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:29,354   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:29,356   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:29,358   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:29,361   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:29,363   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:29,366   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-21T18:33:29,368   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-21T18:33:29,369   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-21T18:33:29,371   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-21T18:33:29,373   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-21T18:33:29,375   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-21T18:33:29,378   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:29,379   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:29,380   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:29,383   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:29,385   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:29,387   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:29,390   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:29,392   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:29,393   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:29,395   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:29,397   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-21T18:33:29,399   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:29,401   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:29,403   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:29,405   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:29,407   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:29,409   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-21T18:33:29,412   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:29,413   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:29,415   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:29,418   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:29,419   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:29,421   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-21T18:33:29,424   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-06-21T18:33:29,426   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:29,427   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:29,429   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:29,431   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:29,433   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:29,435   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-21T18:33:29,437   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-06-21T18:33:29,438   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:29,439   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:29,441   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:29,444   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:29,446   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:29,449   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-21T18:33:29,450   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-06-21T18:33:29,453   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-06-21T18:33:29,454   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:29,455   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:29,457   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:29,460   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:29,461   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:29,463   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:29,465   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-21T18:33:29,467   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-21T18:33:29,469   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-21T18:33:29,470   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-21T18:33:29,473   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-21T18:33:29,475   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:29,476   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:29,477   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:29,479   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:29,481   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:29,483   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:29,485   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-21T18:33:29,487   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-06-21T18:33:29,489   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:29,490   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:29,492   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:29,494   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:29,496   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:29,498   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:29,500   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-21T18:33:29,502   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:29,503   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:29,505   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:29,507   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:29,509   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:29,510   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:29,513   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-21T18:33:29,514   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-06-21T18:33:29,516   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-21T18:33:29,517   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-21T18:33:29,519   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-21T18:33:29,521   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-21T18:33:29,523   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-21T18:33:29,526   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-06-21T18:33:29,527   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-06-21T18:33:29,529   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:29,530   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:29,533   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:29,535   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:29,537   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:29,539   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:29,541   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:29,543   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:29,545   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-21T18:33:29,547   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:29,548   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:29,550   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:29,551   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:29,553   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:29,555   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:29,557   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-21T18:33:29,559   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:29,560   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:29,562   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:29,564   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:29,566   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:29,568   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:29,570   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-21T18:33:29,572   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-21T18:33:29,574   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-21T18:33:29,576   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-06-21T18:33:29,577   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-06-21T18:33:29,579   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-06-21T18:33:29,581   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-06-21T18:33:29,583   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-06-21T18:33:29,585   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:29,587   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:29,588   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:29,590   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:29,592   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:29,594   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:29,595   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:29,597   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:29,599   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:29,601   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:29,603   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-21T18:33:29,605   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:29,608   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-06-21T18:33:29,609   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-06-21T18:33:29,611   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-06-21T18:33:29,613   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-06-21T18:33:29,614   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-06-21T18:33:29,617   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-06-21T18:33:29,618   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-06-21T18:33:29,620   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-06-21T18:33:29,622   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-06-21T18:33:29,624   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-06-21T18:33:29,626   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-06-21T18:33:29,628   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-06-21T18:33:29,630   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-06-21T18:33:29,632   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-06-21T18:33:29,634   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-06-21T18:33:29,637   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:29,638   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:29,639   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:29,641   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:29,643   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:29,644   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:29,646   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:29,648   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:29,650   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:29,651   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-21T18:33:29,654   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-06-21T18:33:29,655   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-06-21T18:33:29,657   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-06-21T18:33:29,659   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-06-21T18:33:29,660   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-06-21T18:33:29,663   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:29,665   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-21T18:33:29,667   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-21T18:33:29,669   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-21T18:33:29,670   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-21T18:33:29,672   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-21T18:33:29,675   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:29,677   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-06-21T18:33:29,678   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-06-21T18:33:29,679   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-06-21T18:33:29,681   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-06-21T18:33:29,683   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-06-21T18:33:29,685   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-06-21T18:33:29,686   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-06-21T18:33:29,688   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-06-21T18:33:29,690   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-06-21T18:33:29,692   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-06-21T18:33:29,694   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:29,696   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:29,699   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-21T18:33:29,701   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-21T18:33:29,702   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-21T18:33:29,704   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-21T18:33:29,706   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-21T18:33:29,708   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:29,711   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-21T18:33:29,714   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-21T18:33:29,716   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-21T18:33:29,718   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-06-21T18:33:29,719   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-06-21T18:33:29,721   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-21T18:33:29,722   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-21T18:33:29,723   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-21T18:33:29,725   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-21T18:33:29,728   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-06-21T18:33:29,729   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-06-21T18:33:29,731   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-06-21T18:33:29,733   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-06-21T18:33:29,734   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-06-21T18:33:29,737   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-06-21T18:33:29,739   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-06-21T18:33:29,740   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-06-21T18:33:29,742   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-06-21T18:33:29,745   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-06-21T18:33:29,750   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-06-21T18:33:29,751   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-06-21T18:33:29,753   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-06-21T18:33:29,755   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-06-21T18:33:29,758   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-06-21T18:33:29,759   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-06-21T18:33:29,762   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-06-21T18:33:29,764   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-21T18:33:29,765   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-21T18:33:29,767   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-21T18:33:29,769   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-06-21T18:33:29,771   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-06-21T18:33:29,773   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-06-21T18:33:29,775   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:29,776   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:29,778   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:29,779   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:29,781   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:29,783   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:29,785   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:29,787   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:29,789   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-21T18:33:29,791   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:29,792   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:29,794   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:29,796   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:29,797   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:29,800   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:29,801   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:29,803   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-21T18:33:29,805   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-06-21T18:33:29,807   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-06-21T18:33:29,810   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-06-21T18:33:29,814   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-06-21T18:33:29,815   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-06-21T18:33:29,818   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-21T18:33:29,819   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-21T18:33:29,822   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-21T18:33:29,825   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-21T18:33:29,828   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-21T18:33:29,831   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-21T18:33:29,833   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-21T18:33:29,838   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-21T18:33:29,839   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-21T18:33:29,842   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-21T18:33:29,845   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-21T18:33:29,847   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-21T18:33:29,850   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-21T18:33:29,853   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-21T18:33:29,856   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-21T18:33:29,859   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-21T18:33:29,862   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-21T18:33:29,865   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-21T18:33:29,869   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-21T18:33:29,870   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-21T18:33:29,875   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-21T18:33:29,879   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-21T18:33:29,881   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-21T18:33:29,884   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-21T18:33:29,887   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-21T18:33:29,890   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,891   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,894   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,897   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,900   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,902   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,905   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,909   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,911   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,913   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,916   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,919   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,921   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,923   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,925   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,927   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,929   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,931   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,933   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-21T18:33:29,936   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-21T18:33:29,937   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-21T18:33:29,939   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-21T18:33:29,940   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-21T18:33:29,944   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-21T18:33:29,946   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-21T18:33:29,948   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-21T18:33:29,950   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-21T18:33:29,952   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-21T18:33:29,954   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-06-21T18:33:29,955   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-06-21T18:33:29,958   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-06-21T18:33:29,961   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-06-21T18:33:29,963   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-06-21T18:33:29,965   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-21T18:33:29,967   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-21T18:33:29,970   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:29,970   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:29,973   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:29,975   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,976   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,979   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,981   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,983   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,985   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,987   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,990   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,992   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,994   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,995   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:29,998   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:30,000   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:30,002   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:30,005   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:30,008   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-21T18:33:30,008   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-21T18:33:30,010   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-21T18:33:30,013   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-21T18:33:30,015   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-21T18:33:30,018   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-21T18:33:30,020   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-21T18:33:30,022   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-21T18:33:30,025   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:30,026   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:30,029   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:30,031   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:30,033   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-21T18:33:30,035   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,037   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,040   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,042   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,043   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,045   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,047   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,049   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,051   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,053   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,055   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-21T18:33:30,059   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,060   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,063   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,065   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,067   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,069   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,071   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,073   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,075   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,077   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,079   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-21T18:33:30,082   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-21T18:33:30,083   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-21T18:33:30,085   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-21T18:33:30,088   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-21T18:33:30,091   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-21T18:33:30,093   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-21T18:33:30,094   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-21T18:33:30,097   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-06-21T18:33:30,098   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-06-21T18:33:30,101   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-06-21T18:33:30,103   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-06-21T18:33:30,105   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-06-21T18:33:30,106   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-06-21T18:33:30,107   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-06-21T18:33:30,109   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-06-21T18:33:30,111   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-06-21T18:33:30,113   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,114   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,116   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,118   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,119   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,122   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,123   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,125   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,126   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,128   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,130   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-21T18:33:30,132   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-06-21T18:33:30,133   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-06-21T18:33:30,135   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-06-21T18:33:30,136   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-06-21T18:33:30,139   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-21T18:33:30,139   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-21T18:33:30,142   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-21T18:33:30,145   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-21T18:33:30,148   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-21T18:33:30,150   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-21T18:33:30,153   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-21T18:33:30,155   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-21T18:33:30,157   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-21T18:33:30,160   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-21T18:33:30,161   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-21T18:33:30,162   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-21T18:33:30,164   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-21T18:33:30,166   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-21T18:33:30,168   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-21T18:33:30,169   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-21T18:33:30,171   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-21T18:33:30,173   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-21T18:33:30,175   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-21T18:33:30,178   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-21T18:33:30,181   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-21T18:33:30,183   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-21T18:33:30,185   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-06-21T18:33:30,186   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-06-21T18:33:30,189   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-06-21T18:33:30,191   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-06-21T18:33:30,192   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-06-21T18:33:30,194   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-21T18:33:30,197   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-06-21T18:33:30,198   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-06-21T18:33:30,200   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-06-21T18:33:30,201   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-06-21T18:33:30,204   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-06-21T18:33:30,206   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-06-21T18:33:30,208   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-06-21T18:33:30,210   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-21T18:33:30,212   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-06-21T18:33:30,212   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-06-21T18:33:30,214   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-06-21T18:33:30,217   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-21T18:33:30,217   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-21T18:33:30,219   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-21T18:33:30,221   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-21T18:33:30,224   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-21T18:33:30,226   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-21T18:33:30,227   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-21T18:33:30,229   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-21T18:33:30,232   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-21T18:33:30,234   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-21T18:33:30,237   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,238   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-21T18:33:30,239   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-21T18:33:30,241   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-21T18:33:30,244   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-21T18:33:30,246   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-21T18:33:30,248   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-21T18:33:30,251   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-21T18:33:30,254   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-21T18:33:30,257   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-21T18:33:30,258   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-21T18:33:30,261   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,263   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-06-21T18:33:30,265   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-06-21T18:33:30,266   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-06-21T18:33:30,269   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-06-21T18:33:30,270   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-06-21T18:33:30,273   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-06-21T18:33:30,276   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-06-21T18:33:30,279   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-06-21T18:33:30,281   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-06-21T18:33:30,283   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-06-21T18:33:30,285   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,288   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-06-21T18:33:30,289   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-06-21T18:33:30,291   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-06-21T18:33:30,293   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-06-21T18:33:30,295   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-06-21T18:33:30,298   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-21T18:33:30,299   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-21T18:33:30,302   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-21T18:33:30,304   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-21T18:33:30,307   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-21T18:33:30,309   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-21T18:33:30,311   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-21T18:33:30,315   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,317   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,318   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,320   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,322   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,325   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,328   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,332   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,335   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,338   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,341   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,343   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,345   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,347   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,353   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,356   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,361   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,363   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-21T18:33:30,366   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-06-21T18:33:30,367   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-06-21T18:33:30,370   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-06-21T18:33:30,372   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-06-21T18:33:30,374   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,376   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,379   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,381   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,383   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,385   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,389   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,391   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,393   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,401   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-06-21T18:33:30,402   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-06-21T18:33:30,404   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-06-21T18:33:30,406   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,409   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,413   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,416   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,420   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-21T18:33:30,421   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-21T18:33:30,424   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-21T18:33:30,427   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-21T18:33:30,429   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-21T18:33:30,432   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-21T18:33:30,435   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-21T18:33:30,438   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,440   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-21T18:33:30,444   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-06-21T18:33:30,445   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-06-21T18:33:30,448   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:30,449   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:30,452   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:30,455   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:30,458   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:30,461   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-21T18:33:30,463   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:30,465   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:30,468   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:30,470   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:30,474   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:30,477   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-21T18:33:30,479   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-06-21T18:33:30,482   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-06-21T18:33:30,486   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-06-21T18:33:30,489   running install_egg_info
2024-06-21T18:33:30,522   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.14.4-py3.11.egg-info
2024-06-21T18:33:30,536   running install_scripts
2024-06-21T18:33:30,537   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data
2024-06-21T18:33:30,538   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts
2024-06-21T18:33:30,539   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts
2024-06-21T18:33:30,542   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts
2024-06-21T18:33:30,544   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts
2024-06-21T18:33:30,546   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts
2024-06-21T18:33:30,548   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts
2024-06-21T18:33:30,550   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts
2024-06-21T18:33:30,552   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts
2024-06-21T18:33:30,554   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts
2024-06-21T18:33:30,555   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts/ds_bench to 755
2024-06-21T18:33:30,555   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts/deepspeed.pt to 755
2024-06-21T18:33:30,556   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts/deepspeed to 755
2024-06-21T18:33:30,556   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts/ds_ssh to 755
2024-06-21T18:33:30,557   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts/ds_elastic to 755
2024-06-21T18:33:30,557   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts/ds to 755
2024-06-21T18:33:30,558   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts/ds_report to 755
2024-06-21T18:33:30,558   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.data/scripts/dsr to 755
2024-06-21T18:33:30,604   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.4.dist-info/WHEEL
2024-06-21T18:33:30,606   creating '/tmp/pip-wheel-pfrwsw66/deepspeed-0.14.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-06-21T18:33:30,610   adding 'deepspeed/__init__.py'
2024-06-21T18:33:30,612   adding 'deepspeed/constants.py'
2024-06-21T18:33:30,614   adding 'deepspeed/env_report.py'
2024-06-21T18:33:30,615   adding 'deepspeed/git_version_info.py'
2024-06-21T18:33:30,617   adding 'deepspeed/git_version_info_installed.py'
2024-06-21T18:33:30,618   adding 'deepspeed/pydantic_v1.py'
2024-06-21T18:33:30,621   adding 'deepspeed/accelerator/__init__.py'
2024-06-21T18:33:30,623   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-06-21T18:33:30,625   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-06-21T18:33:30,628   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-06-21T18:33:30,630   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-06-21T18:33:30,633   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-06-21T18:33:30,635   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-06-21T18:33:30,638   adding 'deepspeed/accelerator/real_accelerator.py'
2024-06-21T18:33:30,641   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-06-21T18:33:30,644   adding 'deepspeed/autotuning/__init__.py'
2024-06-21T18:33:30,652   adding 'deepspeed/autotuning/autotuner.py'
2024-06-21T18:33:30,654   adding 'deepspeed/autotuning/config.py'
2024-06-21T18:33:30,656   adding 'deepspeed/autotuning/constants.py'
2024-06-21T18:33:30,660   adding 'deepspeed/autotuning/scheduler.py'
2024-06-21T18:33:30,663   adding 'deepspeed/autotuning/utils.py'
2024-06-21T18:33:30,666   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-06-21T18:33:30,668   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-06-21T18:33:30,669   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-06-21T18:33:30,671   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-06-21T18:33:30,674   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-06-21T18:33:30,676   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-06-21T18:33:30,678   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-06-21T18:33:30,679   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-06-21T18:33:30,681   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-06-21T18:33:30,683   adding 'deepspeed/autotuning/tuner/utils.py'
2024-06-21T18:33:30,686   adding 'deepspeed/checkpoint/__init__.py'
2024-06-21T18:33:30,687   adding 'deepspeed/checkpoint/constants.py'
2024-06-21T18:33:30,690   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-06-21T18:33:30,694   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-06-21T18:33:30,696   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-06-21T18:33:30,698   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-06-21T18:33:30,701   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-06-21T18:33:30,703   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-06-21T18:33:30,705   adding 'deepspeed/checkpoint/utils.py'
2024-06-21T18:33:30,707   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-06-21T18:33:30,709   adding 'deepspeed/comm/__init__.py'
2024-06-21T18:33:30,711   adding 'deepspeed/comm/backend.py'
2024-06-21T18:33:30,713   adding 'deepspeed/comm/ccl.py'
2024-06-21T18:33:30,718   adding 'deepspeed/comm/comm.py'
2024-06-21T18:33:30,720   adding 'deepspeed/comm/config.py'
2024-06-21T18:33:30,721   adding 'deepspeed/comm/constants.py'
2024-06-21T18:33:30,722   adding 'deepspeed/comm/reduce_op.py'
2024-06-21T18:33:30,724   adding 'deepspeed/comm/torch.py'
2024-06-21T18:33:30,726   adding 'deepspeed/comm/utils.py'
2024-06-21T18:33:30,727   adding 'deepspeed/compression/__init__.py'
2024-06-21T18:33:30,731   adding 'deepspeed/compression/basic_layer.py'
2024-06-21T18:33:30,733   adding 'deepspeed/compression/compress.py'
2024-06-21T18:33:30,735   adding 'deepspeed/compression/config.py'
2024-06-21T18:33:30,736   adding 'deepspeed/compression/constants.py'
2024-06-21T18:33:30,738   adding 'deepspeed/compression/helper.py'
2024-06-21T18:33:30,740   adding 'deepspeed/compression/scheduler.py'
2024-06-21T18:33:30,742   adding 'deepspeed/compression/utils.py'
2024-06-21T18:33:30,743   adding 'deepspeed/elasticity/__init__.py'
2024-06-21T18:33:30,745   adding 'deepspeed/elasticity/config.py'
2024-06-21T18:33:30,747   adding 'deepspeed/elasticity/constants.py'
2024-06-21T18:33:30,748   adding 'deepspeed/elasticity/elastic_agent.py'
2024-06-21T18:33:30,751   adding 'deepspeed/elasticity/elasticity.py'
2024-06-21T18:33:30,752   adding 'deepspeed/elasticity/utils.py'
2024-06-21T18:33:30,754   adding 'deepspeed/inference/__init__.py'
2024-06-21T18:33:30,755   adding 'deepspeed/inference/config.py'
2024-06-21T18:33:30,759   adding 'deepspeed/inference/engine.py'
2024-06-21T18:33:30,761   adding 'deepspeed/inference/quantization/__init__.py'
2024-06-21T18:33:30,762   adding 'deepspeed/inference/quantization/layers.py'
2024-06-21T18:33:30,764   adding 'deepspeed/inference/quantization/quantization.py'
2024-06-21T18:33:30,765   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-06-21T18:33:30,767   adding 'deepspeed/inference/quantization/utils.py'
2024-06-21T18:33:30,769   adding 'deepspeed/inference/v2/__init__.py'
2024-06-21T18:33:30,770   adding 'deepspeed/inference/v2/allocator.py'
2024-06-21T18:33:30,771   adding 'deepspeed/inference/v2/config_v2.py'
2024-06-21T18:33:30,773   adding 'deepspeed/inference/v2/engine_factory.py'
2024-06-21T18:33:30,775   adding 'deepspeed/inference/v2/engine_v2.py'
2024-06-21T18:33:30,776   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-06-21T18:33:30,778   adding 'deepspeed/inference/v2/inference_utils.py'
2024-06-21T18:33:30,779   adding 'deepspeed/inference/v2/logging.py'
2024-06-21T18:33:30,781   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-06-21T18:33:30,782   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-06-21T18:33:30,784   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-06-21T18:33:30,785   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-06-21T18:33:30,787   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-06-21T18:33:30,789   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-06-21T18:33:30,790   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-06-21T18:33:30,792   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-06-21T18:33:30,793   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-06-21T18:33:30,795   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-06-21T18:33:30,796   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-06-21T18:33:30,797   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-06-21T18:33:30,798   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-06-21T18:33:30,800   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-06-21T18:33:30,802   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-06-21T18:33:30,803   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-06-21T18:33:30,804   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-06-21T18:33:30,806   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-06-21T18:33:30,808   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-06-21T18:33:30,809   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-06-21T18:33:30,811   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-06-21T18:33:30,812   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-06-21T18:33:30,813   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-06-21T18:33:30,815   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-06-21T18:33:30,816   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-06-21T18:33:30,818   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-06-21T18:33:30,820   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-06-21T18:33:30,822   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-06-21T18:33:30,824   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-06-21T18:33:30,825   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-06-21T18:33:30,827   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-06-21T18:33:30,828   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-06-21T18:33:30,831   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-06-21T18:33:30,833   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-06-21T18:33:30,834   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-06-21T18:33:30,835   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-06-21T18:33:30,837   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-06-21T18:33:30,839   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-06-21T18:33:30,840   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-06-21T18:33:30,842   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-06-21T18:33:30,844   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-06-21T18:33:30,846   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-06-21T18:33:30,847   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-06-21T18:33:30,848   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-06-21T18:33:30,849   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-06-21T18:33:30,850   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-06-21T18:33:30,852   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-06-21T18:33:30,854   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-06-21T18:33:30,855   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-06-21T18:33:30,857   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-06-21T18:33:30,858   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-06-21T18:33:30,860   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-06-21T18:33:30,861   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-06-21T18:33:30,863   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-06-21T18:33:30,864   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-06-21T18:33:30,866   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-06-21T18:33:30,867   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-06-21T18:33:30,868   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-06-21T18:33:30,870   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-06-21T18:33:30,871   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-06-21T18:33:30,873   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-06-21T18:33:30,874   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-06-21T18:33:30,876   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-06-21T18:33:30,877   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-06-21T18:33:30,878   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-06-21T18:33:30,879   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-06-21T18:33:30,881   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-06-21T18:33:30,883   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-06-21T18:33:30,885   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-06-21T18:33:30,886   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-06-21T18:33:30,889   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-06-21T18:33:30,891   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-06-21T18:33:30,894   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-06-21T18:33:30,895   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-06-21T18:33:30,897   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-06-21T18:33:30,899   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-06-21T18:33:30,900   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-06-21T18:33:30,901   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-06-21T18:33:30,904   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-06-21T18:33:30,905   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-06-21T18:33:30,907   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-06-21T18:33:30,908   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-06-21T18:33:30,910   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-06-21T18:33:30,911   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-06-21T18:33:30,914   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-06-21T18:33:30,915   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-06-21T18:33:30,917   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-06-21T18:33:30,918   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-06-21T18:33:30,919   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-06-21T18:33:30,921   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-06-21T18:33:30,923   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-06-21T18:33:30,925   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-06-21T18:33:30,926   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-06-21T18:33:30,927   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-06-21T18:33:30,929   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-06-21T18:33:30,931   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-06-21T18:33:30,933   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-06-21T18:33:30,934   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-06-21T18:33:30,935   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-06-21T18:33:30,937   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-06-21T18:33:30,938   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-06-21T18:33:30,940   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-06-21T18:33:30,941   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-06-21T18:33:30,943   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-06-21T18:33:30,944   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-06-21T18:33:30,946   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-06-21T18:33:30,947   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-06-21T18:33:30,948   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-06-21T18:33:30,949   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-06-21T18:33:30,951   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-06-21T18:33:30,952   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-06-21T18:33:30,954   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-06-21T18:33:30,956   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-06-21T18:33:30,957   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-06-21T18:33:30,959   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-06-21T18:33:30,960   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-06-21T18:33:30,962   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-06-21T18:33:30,964   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-06-21T18:33:30,965   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-06-21T18:33:30,966   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-06-21T18:33:30,968   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-06-21T18:33:30,970   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-06-21T18:33:30,971   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-06-21T18:33:30,972   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-06-21T18:33:30,973   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-06-21T18:33:30,975   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-06-21T18:33:30,977   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-06-21T18:33:30,979   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-06-21T18:33:30,980   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-06-21T18:33:30,982   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-06-21T18:33:30,985   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-06-21T18:33:30,987   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-06-21T18:33:30,989   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-06-21T18:33:30,990   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-06-21T18:33:30,992   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-06-21T18:33:30,993   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-06-21T18:33:30,994   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-06-21T18:33:30,995   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-06-21T18:33:30,997   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-06-21T18:33:30,998   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-06-21T18:33:30,999   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-06-21T18:33:31,000   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-06-21T18:33:31,002   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-06-21T18:33:31,003   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-06-21T18:33:31,005   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-06-21T18:33:31,006   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-06-21T18:33:31,008   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-06-21T18:33:31,009   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-06-21T18:33:31,011   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-06-21T18:33:31,012   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-06-21T18:33:31,014   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-06-21T18:33:31,015   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-06-21T18:33:31,016   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-06-21T18:33:31,018   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-06-21T18:33:31,019   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-06-21T18:33:31,021   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-06-21T18:33:31,023   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-06-21T18:33:31,024   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-06-21T18:33:31,026   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-06-21T18:33:31,027   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-06-21T18:33:31,028   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-06-21T18:33:31,030   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-06-21T18:33:31,031   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-06-21T18:33:31,033   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-06-21T18:33:31,034   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-06-21T18:33:31,035   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-06-21T18:33:31,037   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-06-21T18:33:31,038   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-06-21T18:33:31,040   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-06-21T18:33:31,041   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-06-21T18:33:31,042   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-06-21T18:33:31,044   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-06-21T18:33:31,045   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-06-21T18:33:31,046   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-06-21T18:33:31,048   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-06-21T18:33:31,049   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-06-21T18:33:31,051   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-06-21T18:33:31,052   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-06-21T18:33:31,053   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-06-21T18:33:31,055   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-06-21T18:33:31,056   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-06-21T18:33:31,057   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-06-21T18:33:31,059   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-06-21T18:33:31,060   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-06-21T18:33:31,062   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-06-21T18:33:31,063   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-06-21T18:33:31,064   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-06-21T18:33:31,066   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-06-21T18:33:31,068   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-06-21T18:33:31,069   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-06-21T18:33:31,070   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-06-21T18:33:31,072   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-06-21T18:33:31,073   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-06-21T18:33:31,074   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-06-21T18:33:31,076   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-06-21T18:33:31,077   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-06-21T18:33:31,079   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-06-21T18:33:31,081   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-06-21T18:33:31,082   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-06-21T18:33:31,084   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-06-21T18:33:31,086   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-06-21T18:33:31,087   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-06-21T18:33:31,089   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-06-21T18:33:31,091   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-06-21T18:33:31,093   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-06-21T18:33:31,095   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-06-21T18:33:31,097   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-06-21T18:33:31,098   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-06-21T18:33:31,099   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-06-21T18:33:31,101   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-06-21T18:33:31,102   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-06-21T18:33:31,104   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-06-21T18:33:31,105   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-06-21T18:33:31,107   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-06-21T18:33:31,108   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-06-21T18:33:31,109   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-06-21T18:33:31,111   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-06-21T18:33:31,112   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-06-21T18:33:31,113   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-06-21T18:33:31,115   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-06-21T18:33:31,116   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-06-21T18:33:31,118   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-06-21T18:33:31,120   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-06-21T18:33:31,121   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-06-21T18:33:31,123   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-06-21T18:33:31,125   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-06-21T18:33:31,127   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-06-21T18:33:31,128   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-06-21T18:33:31,130   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-06-21T18:33:31,131   adding 'deepspeed/launcher/__init__.py'
2024-06-21T18:33:31,133   adding 'deepspeed/launcher/constants.py'
2024-06-21T18:33:31,135   adding 'deepspeed/launcher/launch.py'
2024-06-21T18:33:31,136   adding 'deepspeed/launcher/launcher_helper.py'
2024-06-21T18:33:31,138   adding 'deepspeed/launcher/multinode_runner.py'
2024-06-21T18:33:31,141   adding 'deepspeed/launcher/runner.py'
2024-06-21T18:33:31,143   adding 'deepspeed/linear/__init__.py'
2024-06-21T18:33:31,144   adding 'deepspeed/linear/config.py'
2024-06-21T18:33:31,146   adding 'deepspeed/linear/optimized_linear.py'
2024-06-21T18:33:31,147   adding 'deepspeed/linear/quantization.py'
2024-06-21T18:33:31,149   adding 'deepspeed/model_implementations/__init__.py'
2024-06-21T18:33:31,151   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-06-21T18:33:31,152   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-06-21T18:33:31,154   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-06-21T18:33:31,155   adding 'deepspeed/model_implementations/features/__init__.py'
2024-06-21T18:33:31,156   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-06-21T18:33:31,158   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-06-21T18:33:31,160   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-06-21T18:33:31,161   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-06-21T18:33:31,162   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-06-21T18:33:31,163   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-06-21T18:33:31,164   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-06-21T18:33:31,166   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-06-21T18:33:31,167   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-06-21T18:33:31,168   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-06-21T18:33:31,169   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-06-21T18:33:31,171   adding 'deepspeed/module_inject/__init__.py'
2024-06-21T18:33:31,174   adding 'deepspeed/module_inject/auto_tp.py'
2024-06-21T18:33:31,175   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-06-21T18:33:31,177   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-06-21T18:33:31,178   adding 'deepspeed/module_inject/inject.py'
2024-06-21T18:33:31,180   adding 'deepspeed/module_inject/layers.py'
2024-06-21T18:33:31,182   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-06-21T18:33:31,183   adding 'deepspeed/module_inject/module_quantize.py'
2024-06-21T18:33:31,185   adding 'deepspeed/module_inject/policy.py'
2024-06-21T18:33:31,189   adding 'deepspeed/module_inject/replace_module.py'
2024-06-21T18:33:31,190   adding 'deepspeed/module_inject/replace_policy.py'
2024-06-21T18:33:31,191   adding 'deepspeed/module_inject/tp_shard.py'
2024-06-21T18:33:31,193   adding 'deepspeed/module_inject/utils.py'
2024-06-21T18:33:31,194   adding 'deepspeed/module_inject/containers/__init__.py'
2024-06-21T18:33:31,196   adding 'deepspeed/module_inject/containers/base.py'
2024-06-21T18:33:31,198   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-06-21T18:33:31,199   adding 'deepspeed/module_inject/containers/bert.py'
2024-06-21T18:33:31,200   adding 'deepspeed/module_inject/containers/bloom.py'
2024-06-21T18:33:31,202   adding 'deepspeed/module_inject/containers/clip.py'
2024-06-21T18:33:31,203   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-06-21T18:33:31,204   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-06-21T18:33:31,206   adding 'deepspeed/module_inject/containers/gptj.py'
2024-06-21T18:33:31,207   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-06-21T18:33:31,208   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-06-21T18:33:31,210   adding 'deepspeed/module_inject/containers/internlm.py'
2024-06-21T18:33:31,211   adding 'deepspeed/module_inject/containers/llama.py'
2024-06-21T18:33:31,213   adding 'deepspeed/module_inject/containers/llama2.py'
2024-06-21T18:33:31,214   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-06-21T18:33:31,216   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-06-21T18:33:31,217   adding 'deepspeed/module_inject/containers/opt.py'
2024-06-21T18:33:31,219   adding 'deepspeed/module_inject/containers/unet.py'
2024-06-21T18:33:31,220   adding 'deepspeed/module_inject/containers/vae.py'
2024-06-21T18:33:31,222   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-06-21T18:33:31,223   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-06-21T18:33:31,225   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-06-21T18:33:31,226   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-06-21T18:33:31,227   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-06-21T18:33:31,229   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-06-21T18:33:31,230   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-06-21T18:33:31,232   adding 'deepspeed/moe/__init__.py'
2024-06-21T18:33:31,233   adding 'deepspeed/moe/experts.py'
2024-06-21T18:33:31,235   adding 'deepspeed/moe/layer.py'
2024-06-21T18:33:31,237   adding 'deepspeed/moe/mappings.py'
2024-06-21T18:33:31,240   adding 'deepspeed/moe/sharded_moe.py'
2024-06-21T18:33:31,242   adding 'deepspeed/moe/utils.py'
2024-06-21T18:33:31,244   adding 'deepspeed/monitor/__init__.py'
2024-06-21T18:33:31,245   adding 'deepspeed/monitor/comet.py'
2024-06-21T18:33:31,247   adding 'deepspeed/monitor/config.py'
2024-06-21T18:33:31,249   adding 'deepspeed/monitor/csv_monitor.py'
2024-06-21T18:33:31,250   adding 'deepspeed/monitor/monitor.py'
2024-06-21T18:33:31,251   adding 'deepspeed/monitor/tensorboard.py'
2024-06-21T18:33:31,253   adding 'deepspeed/monitor/utils.py'
2024-06-21T18:33:31,254   adding 'deepspeed/monitor/wandb.py'
2024-06-21T18:33:31,256   adding 'deepspeed/nebula/__init__.py'
2024-06-21T18:33:31,257   adding 'deepspeed/nebula/config.py'
2024-06-21T18:33:31,258   adding 'deepspeed/nebula/constants.py'
2024-06-21T18:33:31,260   adding 'deepspeed/ops/__init__.py'
2024-06-21T18:33:31,261   adding 'deepspeed/ops/adagrad/__init__.py'
2024-06-21T18:33:31,263   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-06-21T18:33:31,264   adding 'deepspeed/ops/adam/__init__.py'
2024-06-21T18:33:31,266   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-06-21T18:33:31,268   adding 'deepspeed/ops/adam/fused_adam.py'
2024-06-21T18:33:31,269   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-06-21T18:33:31,270   adding 'deepspeed/ops/aio/__init__.py'
2024-06-21T18:33:31,273   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-06-21T18:33:31,275   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-06-21T18:33:31,276   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-06-21T18:33:31,278   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-06-21T18:33:31,279   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-06-21T18:33:31,281   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-06-21T18:33:31,284   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-06-21T18:33:31,285   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-06-21T18:33:31,286   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-06-21T18:33:31,288   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-06-21T18:33:31,289   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-06-21T18:33:31,290   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-06-21T18:33:31,292   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-06-21T18:33:31,294   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-06-21T18:33:31,295   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-06-21T18:33:31,296   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-06-21T18:33:31,297   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-06-21T18:33:31,299   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-06-21T18:33:31,300   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-06-21T18:33:31,302   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-06-21T18:33:31,303   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-06-21T18:33:31,304   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-06-21T18:33:31,305   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-06-21T18:33:31,307   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-06-21T18:33:31,309   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-06-21T18:33:31,312   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-06-21T18:33:31,315   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-06-21T18:33:31,316   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-06-21T18:33:31,318   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-06-21T18:33:31,320   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-06-21T18:33:31,322   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-06-21T18:33:31,323   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-06-21T18:33:31,325   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-06-21T18:33:31,327   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-06-21T18:33:31,335   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-06-21T18:33:31,340   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-06-21T18:33:31,342   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-06-21T18:33:31,345   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-06-21T18:33:31,346   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-06-21T18:33:31,348   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-06-21T18:33:31,350   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-06-21T18:33:31,351   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-06-21T18:33:31,354   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-06-21T18:33:31,356   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-06-21T18:33:31,358   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-06-21T18:33:31,360   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-06-21T18:33:31,367   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-06-21T18:33:31,371   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-06-21T18:33:31,373   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-06-21T18:33:31,377   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-06-21T18:33:31,380   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-06-21T18:33:31,384   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-06-21T18:33:31,386   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-06-21T18:33:31,388   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-06-21T18:33:31,390   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-06-21T18:33:31,392   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-06-21T18:33:31,394   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-06-21T18:33:31,396   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-06-21T18:33:31,398   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-06-21T18:33:31,399   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-06-21T18:33:31,402   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-06-21T18:33:31,404   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-06-21T18:33:31,405   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-06-21T18:33:31,406   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-06-21T18:33:31,408   adding 'deepspeed/ops/csrc/includes/context.h'
2024-06-21T18:33:31,410   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-06-21T18:33:31,411   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-06-21T18:33:31,413   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-06-21T18:33:31,414   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-06-21T18:33:31,415   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-06-21T18:33:31,417   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-06-21T18:33:31,419   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-06-21T18:33:31,420   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-06-21T18:33:31,422   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-06-21T18:33:31,423   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-06-21T18:33:31,425   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-06-21T18:33:31,426   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-06-21T18:33:31,428   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-06-21T18:33:31,429   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-06-21T18:33:31,431   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-06-21T18:33:31,433   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-06-21T18:33:31,434   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-06-21T18:33:31,436   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-06-21T18:33:31,437   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-06-21T18:33:31,440   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-06-21T18:33:31,441   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-06-21T18:33:31,443   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-06-21T18:33:31,444   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-06-21T18:33:31,445   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-06-21T18:33:31,447   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-06-21T18:33:31,449   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-06-21T18:33:31,451   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-06-21T18:33:31,453   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-06-21T18:33:31,454   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-06-21T18:33:31,455   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-06-21T18:33:31,457   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-06-21T18:33:31,458   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-06-21T18:33:31,461   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-06-21T18:33:31,463   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-06-21T18:33:31,465   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-06-21T18:33:31,466   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-06-21T18:33:31,468   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-06-21T18:33:31,469   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-06-21T18:33:31,471   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-06-21T18:33:31,473   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-06-21T18:33:31,474   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-06-21T18:33:31,476   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-06-21T18:33:31,478   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-06-21T18:33:31,480   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-06-21T18:33:31,482   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-06-21T18:33:31,483   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-06-21T18:33:31,485   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-06-21T18:33:31,488   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-06-21T18:33:31,492   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-06-21T18:33:31,494   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-06-21T18:33:31,496   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-06-21T18:33:31,500   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-06-21T18:33:31,503   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-06-21T18:33:31,505   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-06-21T18:33:31,508   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-06-21T18:33:31,509   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-06-21T18:33:31,512   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-06-21T18:33:31,514   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-06-21T18:33:31,516   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-06-21T18:33:31,521   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-06-21T18:33:31,523   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-06-21T18:33:31,525   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-06-21T18:33:31,527   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-06-21T18:33:31,530   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-06-21T18:33:31,533   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-06-21T18:33:31,534   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-06-21T18:33:31,536   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-06-21T18:33:31,538   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-06-21T18:33:31,540   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-06-21T18:33:31,542   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp'
2024-06-21T18:33:31,543   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp'
2024-06-21T18:33:31,544   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-06-21T18:33:31,546   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-06-21T18:33:31,548   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-06-21T18:33:31,549   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-06-21T18:33:31,551   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-06-21T18:33:31,552   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-06-21T18:33:31,554   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-06-21T18:33:31,555   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-06-21T18:33:31,557   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-06-21T18:33:31,559   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-06-21T18:33:31,560   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-06-21T18:33:31,562   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-06-21T18:33:31,563   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-06-21T18:33:31,565   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-06-21T18:33:31,566   adding 'deepspeed/ops/lamb/__init__.py'
2024-06-21T18:33:31,568   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-06-21T18:33:31,570   adding 'deepspeed/ops/lion/__init__.py'
2024-06-21T18:33:31,571   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-06-21T18:33:31,573   adding 'deepspeed/ops/lion/fused_lion.py'
2024-06-21T18:33:31,574   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-06-21T18:33:31,576   adding 'deepspeed/ops/op_builder/__init__.py'
2024-06-21T18:33:31,578   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-06-21T18:33:31,579   adding 'deepspeed/ops/op_builder/async_io.py'
2024-06-21T18:33:31,583   adding 'deepspeed/ops/op_builder/builder.py'
2024-06-21T18:33:31,584   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-06-21T18:33:31,585   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-06-21T18:33:31,586   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-06-21T18:33:31,588   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-06-21T18:33:31,589   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-06-21T18:33:31,590   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-06-21T18:33:31,592   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-06-21T18:33:31,593   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-06-21T18:33:31,594   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-06-21T18:33:31,595   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-06-21T18:33:31,597   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-06-21T18:33:31,598   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-06-21T18:33:31,600   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-06-21T18:33:31,601   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-06-21T18:33:31,602   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-06-21T18:33:31,603   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-06-21T18:33:31,605   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-06-21T18:33:31,606   adding 'deepspeed/ops/op_builder/transformer.py'
2024-06-21T18:33:31,607   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-06-21T18:33:31,609   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-06-21T18:33:31,610   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-06-21T18:33:31,612   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-06-21T18:33:31,613   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-06-21T18:33:31,614   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-06-21T18:33:31,615   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-06-21T18:33:31,617   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-06-21T18:33:31,618   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-06-21T18:33:31,619   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-06-21T18:33:31,620   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-06-21T18:33:31,622   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-06-21T18:33:31,623   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-06-21T18:33:31,625   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-06-21T18:33:31,626   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-06-21T18:33:31,627   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-06-21T18:33:31,628   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-06-21T18:33:31,629   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-06-21T18:33:31,631   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-06-21T18:33:31,632   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-06-21T18:33:31,634   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-06-21T18:33:31,636   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-06-21T18:33:31,637   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-06-21T18:33:31,638   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-06-21T18:33:31,640   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-06-21T18:33:31,641   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-06-21T18:33:31,642   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2024-06-21T18:33:31,643   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-06-21T18:33:31,645   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2024-06-21T18:33:31,646   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2024-06-21T18:33:31,647   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-06-21T18:33:31,649   adding 'deepspeed/ops/quantizer/__init__.py'
2024-06-21T18:33:31,650   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-06-21T18:33:31,652   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-06-21T18:33:31,653   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-06-21T18:33:31,655   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-06-21T18:33:31,656   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-06-21T18:33:31,660   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-06-21T18:33:31,662   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-06-21T18:33:31,664   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-06-21T18:33:31,666   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-06-21T18:33:31,669   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-06-21T18:33:31,671   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-06-21T18:33:31,672   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-06-21T18:33:31,674   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-06-21T18:33:31,675   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-06-21T18:33:31,677   adding 'deepspeed/ops/transformer/__init__.py'
2024-06-21T18:33:31,679   adding 'deepspeed/ops/transformer/transformer.py'
2024-06-21T18:33:31,681   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-06-21T18:33:31,682   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-06-21T18:33:31,684   adding 'deepspeed/ops/transformer/inference/config.py'
2024-06-21T18:33:31,685   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-06-21T18:33:31,687   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-06-21T18:33:31,688   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-06-21T18:33:31,690   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-06-21T18:33:31,692   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-06-21T18:33:31,694   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-06-21T18:33:31,695   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-06-21T18:33:31,697   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-06-21T18:33:31,698   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-06-21T18:33:31,700   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-06-21T18:33:31,701   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-06-21T18:33:31,702   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-06-21T18:33:31,704   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-06-21T18:33:31,705   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-06-21T18:33:31,706   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-06-21T18:33:31,707   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-06-21T18:33:31,709   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-06-21T18:33:31,710   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-06-21T18:33:31,712   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-06-21T18:33:31,714   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-06-21T18:33:31,715   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-06-21T18:33:31,717   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-06-21T18:33:31,719   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-06-21T18:33:31,720   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-06-21T18:33:31,721   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-06-21T18:33:31,723   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-06-21T18:33:31,725   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-06-21T18:33:31,726   adding 'deepspeed/pipe/__init__.py'
2024-06-21T18:33:31,728   adding 'deepspeed/profiling/__init__.py'
2024-06-21T18:33:31,729   adding 'deepspeed/profiling/config.py'
2024-06-21T18:33:31,730   adding 'deepspeed/profiling/constants.py'
2024-06-21T18:33:31,732   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-06-21T18:33:31,737   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-06-21T18:33:31,739   adding 'deepspeed/runtime/__init__.py'
2024-06-21T18:33:31,741   adding 'deepspeed/runtime/base_optimizer.py'
2024-06-21T18:33:31,744   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-06-21T18:33:31,745   adding 'deepspeed/runtime/compiler.py'
2024-06-21T18:33:31,749   adding 'deepspeed/runtime/config.py'
2024-06-21T18:33:31,751   adding 'deepspeed/runtime/config_utils.py'
2024-06-21T18:33:31,753   adding 'deepspeed/runtime/constants.py'
2024-06-21T18:33:31,755   adding 'deepspeed/runtime/dataloader.py'
2024-06-21T18:33:31,756   adding 'deepspeed/runtime/eigenvalue.py'
2024-06-21T18:33:31,774   adding 'deepspeed/runtime/engine.py'
2024-06-21T18:33:31,778   adding 'deepspeed/runtime/hybrid_engine.py'
2024-06-21T18:33:31,782   adding 'deepspeed/runtime/lr_schedules.py'
2024-06-21T18:33:31,783   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-06-21T18:33:31,785   adding 'deepspeed/runtime/quantize.py'
2024-06-21T18:33:31,786   adding 'deepspeed/runtime/sparse_tensor.py'
2024-06-21T18:33:31,788   adding 'deepspeed/runtime/state_dict_factory.py'
2024-06-21T18:33:31,793   adding 'deepspeed/runtime/utils.py'
2024-06-21T18:33:31,795   adding 'deepspeed/runtime/weight_quantizer.py'
2024-06-21T18:33:31,797   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-06-21T18:33:31,802   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-06-21T18:33:31,803   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-06-21T18:33:31,805   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-06-21T18:33:31,806   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-06-21T18:33:31,807   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-06-21T18:33:31,809   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-06-21T18:33:31,810   adding 'deepspeed/runtime/comm/__init__.py'
2024-06-21T18:33:31,812   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-06-21T18:33:31,813   adding 'deepspeed/runtime/comm/compressed.py'
2024-06-21T18:33:31,814   adding 'deepspeed/runtime/comm/hccl.py'
2024-06-21T18:33:31,816   adding 'deepspeed/runtime/comm/mpi.py'
2024-06-21T18:33:31,818   adding 'deepspeed/runtime/comm/nccl.py'
2024-06-21T18:33:31,819   adding 'deepspeed/runtime/compression/__init__.py'
2024-06-21T18:33:31,820   adding 'deepspeed/runtime/compression/cupy.py'
2024-06-21T18:33:31,822   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-06-21T18:33:31,823   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-06-21T18:33:31,825   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-06-21T18:33:31,826   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-06-21T18:33:31,828   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-06-21T18:33:31,829   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-06-21T18:33:31,830   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-06-21T18:33:31,832   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-06-21T18:33:31,833   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-06-21T18:33:31,835   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-06-21T18:33:31,840   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-06-21T18:33:31,842   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-06-21T18:33:31,845   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-06-21T18:33:31,846   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-06-21T18:33:31,848   adding 'deepspeed/runtime/fp16/__init__.py'
2024-06-21T18:33:31,851   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-06-21T18:33:31,853   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-06-21T18:33:31,855   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-06-21T18:33:31,857   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-06-21T18:33:31,859   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-06-21T18:33:31,862   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-06-21T18:33:31,864   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-06-21T18:33:31,866   adding 'deepspeed/runtime/pipe/__init__.py'
2024-06-21T18:33:31,873   adding 'deepspeed/runtime/pipe/engine.py'
2024-06-21T18:33:31,876   adding 'deepspeed/runtime/pipe/module.py'
2024-06-21T18:33:31,878   adding 'deepspeed/runtime/pipe/p2p.py'
2024-06-21T18:33:31,880   adding 'deepspeed/runtime/pipe/schedule.py'
2024-06-21T18:33:31,883   adding 'deepspeed/runtime/pipe/topology.py'
2024-06-21T18:33:31,885   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-06-21T18:33:31,886   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-06-21T18:33:31,887   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-06-21T18:33:31,889   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-06-21T18:33:31,892   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-06-21T18:33:31,894   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-06-21T18:33:31,896   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-06-21T18:33:31,898   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-06-21T18:33:31,900   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-06-21T18:33:31,902   adding 'deepspeed/runtime/zero/__init__.py'
2024-06-21T18:33:31,904   adding 'deepspeed/runtime/zero/config.py'
2024-06-21T18:33:31,905   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-06-21T18:33:31,907   adding 'deepspeed/runtime/zero/linear.py'
2024-06-21T18:33:31,910   adding 'deepspeed/runtime/zero/mics.py'
2024-06-21T18:33:31,911   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-06-21T18:33:31,912   adding 'deepspeed/runtime/zero/offload_config.py'
2024-06-21T18:33:31,915   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-06-21T18:33:31,926   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-06-21T18:33:31,930   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-06-21T18:33:31,932   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-06-21T18:33:31,946   adding 'deepspeed/runtime/zero/stage3.py'
2024-06-21T18:33:31,960   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-06-21T18:33:31,962   adding 'deepspeed/runtime/zero/test.py'
2024-06-21T18:33:31,964   adding 'deepspeed/runtime/zero/tiling.py'
2024-06-21T18:33:31,966   adding 'deepspeed/runtime/zero/utils.py'
2024-06-21T18:33:31,967   adding 'deepspeed/sequence/__init__.py'
2024-06-21T18:33:31,969   adding 'deepspeed/sequence/layer.py'
2024-06-21T18:33:31,970   adding 'deepspeed/utils/__init__.py'
2024-06-21T18:33:31,972   adding 'deepspeed/utils/bwc.py'
2024-06-21T18:33:31,973   adding 'deepspeed/utils/comms_logging.py'
2024-06-21T18:33:31,975   adding 'deepspeed/utils/config.py'
2024-06-21T18:33:31,976   adding 'deepspeed/utils/debug.py'
2024-06-21T18:33:31,977   adding 'deepspeed/utils/exceptions.py'
2024-06-21T18:33:31,980   adding 'deepspeed/utils/groups.py'
2024-06-21T18:33:31,981   adding 'deepspeed/utils/init_on_device.py'
2024-06-21T18:33:31,983   adding 'deepspeed/utils/logging.py'
2024-06-21T18:33:31,984   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-06-21T18:33:31,986   adding 'deepspeed/utils/numa.py'
2024-06-21T18:33:31,987   adding 'deepspeed/utils/nvtx.py'
2024-06-21T18:33:31,989   adding 'deepspeed/utils/tensor_fragment.py'
2024-06-21T18:33:31,990   adding 'deepspeed/utils/timer.py'
2024-06-21T18:33:31,992   adding 'deepspeed/utils/torch.py'
2024-06-21T18:33:31,993   adding 'deepspeed/utils/types.py'
2024-06-21T18:33:31,994   adding 'deepspeed/utils/z3_leaf_module.py'
2024-06-21T18:33:31,997   adding 'deepspeed/utils/zero_to_fp32.py'
2024-06-21T18:33:31,999   adding 'deepspeed-0.14.4.data/scripts/deepspeed'
2024-06-21T18:33:32,000   adding 'deepspeed-0.14.4.data/scripts/deepspeed.pt'
2024-06-21T18:33:32,002   adding 'deepspeed-0.14.4.data/scripts/ds'
2024-06-21T18:33:32,003   adding 'deepspeed-0.14.4.data/scripts/ds_bench'
2024-06-21T18:33:32,004   adding 'deepspeed-0.14.4.data/scripts/ds_elastic'
2024-06-21T18:33:32,005   adding 'deepspeed-0.14.4.data/scripts/ds_report'
2024-06-21T18:33:32,006   adding 'deepspeed-0.14.4.data/scripts/ds_ssh'
2024-06-21T18:33:32,008   adding 'deepspeed-0.14.4.data/scripts/dsr'
2024-06-21T18:33:32,013   adding 'deepspeed-0.14.4.dist-info/METADATA'
2024-06-21T18:33:32,014   adding 'deepspeed-0.14.4.dist-info/WHEEL'
2024-06-21T18:33:32,015   adding 'deepspeed-0.14.4.dist-info/entry_points.txt'
2024-06-21T18:33:32,016   adding 'deepspeed-0.14.4.dist-info/top_level.txt'
2024-06-21T18:33:32,030   adding 'deepspeed-0.14.4.dist-info/RECORD'
2024-06-21T18:33:32,060   removing build/bdist.linux-armv7l/wheel
2024-06-21T18:33:32,271   deepspeed build time = 11.368655681610107 secs
2024-06-21T18:33:32,391   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-06-21T18:33:32,408   Created wheel for deepspeed: filename=deepspeed-0.14.4-py3-none-any.whl size=1445467 sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855
2024-06-21T18:33:32,410   Stored in directory: /tmp/pip-ephem-wheel-cache-2u7buwut/wheels/8e/bb/99/b092ccb948b1383222922cd793a36eb783ef99b66c57d75758
2024-06-21T18:33:32,449 Successfully built deepspeed
2024-06-21T18:33:32,503 Removed build tracker: '/tmp/pip-build-tracker-dz84j4l3'