2024-06-12T19:07:18,180 Created temporary directory: /tmp/pip-build-tracker-bm2esee1
2024-06-12T19:07:18,181 Initialized build tracking at /tmp/pip-build-tracker-bm2esee1
2024-06-12T19:07:18,182 Created build tracker: /tmp/pip-build-tracker-bm2esee1
2024-06-12T19:07:18,182 Entered build tracker: /tmp/pip-build-tracker-bm2esee1
2024-06-12T19:07:18,183 Created temporary directory: /tmp/pip-wheel-11d0rxsm
2024-06-12T19:07:18,186 Created temporary directory: /tmp/pip-ephem-wheel-cache-0ieogtm_
2024-06-12T19:07:18,210 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-06-12T19:07:18,213 2 location(s) to search for versions of deepspeed:
2024-06-12T19:07:18,213 * https://pypi.org/simple/deepspeed/
2024-06-12T19:07:18,213 * https://www.piwheels.org/simple/deepspeed/
2024-06-12T19:07:18,214 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-06-12T19:07:18,215 Getting page https://pypi.org/simple/deepspeed/
2024-06-12T19:07:18,216 Found index url https://pypi.org/simple/
2024-06-12T19:07:18,362 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-06-12T19:07:18,378   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-06-12T19:07:18,379   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-06-12T19:07:18,380   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-06-12T19:07:18,380   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-06-12T19:07:18,381   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-06-12T19:07:18,382   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-06-12T19:07:18,382   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-06-12T19:07:18,383   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-06-12T19:07:18,384   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-06-12T19:07:18,384   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-06-12T19:07:18,385   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-06-12T19:07:18,385   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-06-12T19:07:18,386   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-06-12T19:07:18,388   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-06-12T19:07:18,388   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-06-12T19:07:18,389   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-06-12T19:07:18,389   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-06-12T19:07:18,390   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-06-12T19:07:18,390   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-06-12T19:07:18,391   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-06-12T19:07:18,392   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-06-12T19:07:18,392   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-06-12T19:07:18,393   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-06-12T19:07:18,394   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-06-12T19:07:18,394   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-06-12T19:07:18,395   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-06-12T19:07:18,396   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-06-12T19:07:18,397   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-06-12T19:07:18,397   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-06-12T19:07:18,398   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-06-12T19:07:18,398   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-06-12T19:07:18,399   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-06-12T19:07:18,400   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-06-12T19:07:18,400   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-06-12T19:07:18,401   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-06-12T19:07:18,402   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-06-12T19:07:18,402   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-06-12T19:07:18,403   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-06-12T19:07:18,403   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-06-12T19:07:18,404   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-06-12T19:07:18,405   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-06-12T19:07:18,405   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-06-12T19:07:18,406   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-06-12T19:07:18,407   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-06-12T19:07:18,407   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-06-12T19:07:18,408   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-06-12T19:07:18,408   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-06-12T19:07:18,409   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-06-12T19:07:18,410   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-06-12T19:07:18,410   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-06-12T19:07:18,412   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-06-12T19:07:18,412   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-06-12T19:07:18,413   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-06-12T19:07:18,414   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-06-12T19:07:18,414   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-06-12T19:07:18,415   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-06-12T19:07:18,415   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-06-12T19:07:18,416   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-06-12T19:07:18,417   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-06-12T19:07:18,418   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-06-12T19:07:18,418   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-06-12T19:07:18,419   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-06-12T19:07:18,420   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-06-12T19:07:18,420   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-06-12T19:07:18,421   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-06-12T19:07:18,422   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-06-12T19:07:18,422   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-06-12T19:07:18,423   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-06-12T19:07:18,424   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-06-12T19:07:18,425   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-06-12T19:07:18,425   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-06-12T19:07:18,426   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-06-12T19:07:18,427   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-06-12T19:07:18,427   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-06-12T19:07:18,428   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-06-12T19:07:18,429   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-06-12T19:07:18,429   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-06-12T19:07:18,430   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-06-12T19:07:18,431   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-06-12T19:07:18,431   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-06-12T19:07:18,432   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-06-12T19:07:18,433   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-06-12T19:07:18,433   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-06-12T19:07:18,434   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-06-12T19:07:18,435   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-06-12T19:07:18,435   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-06-12T19:07:18,436   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-06-12T19:07:18,437   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-06-12T19:07:18,437   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-06-12T19:07:18,438   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-06-12T19:07:18,439   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-06-12T19:07:18,439   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-06-12T19:07:18,440   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-06-12T19:07:18,440   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-06-12T19:07:18,441   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-06-12T19:07:18,442 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-06-12T19:07:18,442 Getting page https://www.piwheels.org/simple/deepspeed/
2024-06-12T19:07:18,444 Found index url https://www.piwheels.org/simple/
2024-06-12T19:07:18,608 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-06-12T19:07:18,624   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,625   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,625   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,626   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,627   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,627   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,628   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,628   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,629   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,629   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,630   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,630   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,631   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,631   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,632   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,633   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,633   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,634   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,634   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,635   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,636   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,636   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,637   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,637   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,638   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,638   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,639   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,639   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,640   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,641   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,641   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,642   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,643   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,643   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,644   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,644   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,645   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,645   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,646   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,646   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,646   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,647   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,647   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,648   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,648   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,649   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,650   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,650   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,651   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,651   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,652   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,653   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,653   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,654   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,654   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,654   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,655   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,655   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,656   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,656   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,657   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,658   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,658   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,659   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-06-12T19:07:18,659 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-06-12T19:07:18,660 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-06-12T19:07:18,690 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-06-12T19:07:18,710 Collecting deepspeed==0.14.3
2024-06-12T19:07:18,712   Created temporary directory: /tmp/pip-unpack-xt15_6r4
2024-06-12T19:07:19,162   Downloading deepspeed-0.14.3.tar.gz (1.3 MB)
2024-06-12T19:07:21,436   Added deepspeed==0.14.3 from https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz to build tracker '/tmp/pip-build-tracker-bm2esee1'
2024-06-12T19:07:21,438   Running setup.py (path:/tmp/pip-wheel-11d0rxsm/deepspeed_de7ddb655ac74b88b235f2ee08a3305f/setup.py) egg_info for package deepspeed
2024-06-12T19:07:21,439   Created temporary directory: /tmp/pip-pip-egg-info-ncfgmuf4
2024-06-12T19:07:21,440   Preparing metadata (setup.py): started
2024-06-12T19:07:21,441   Running command python setup.py egg_info
2024-06-12T19:07:22,389   fatal: not a git repository (or any of the parent directories): .git
2024-06-12T19:07:22,886   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-06-12T19:07:22,886    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-06-12T19:07:22,887   DS_BUILD_OPS=0
2024-06-12T19:07:22,887    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-06-12T19:07:22,888    [WARNING]  async_io: please install the libaio-dev package with apt
2024-06-12T19:07:22,888    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-06-12T19:07:22,889    [WARNING]  Please install torch if trying to pre-compile kernels
2024-06-12T19:07:22,889    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:22,890    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:22,890    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:22,891    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:22,891    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:22,892    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:22,892    [WARNING]  unable to import torch, please install it first
2024-06-12T19:07:22,893    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:22,894   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-06-12T19:07:22,894   version=0.14.3, git_hash=unknown, git_branch=unknown
2024-06-12T19:07:22,895   install_requires=['hjson', 'ninja', 'numpy', 'nvidia-ml-py', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm']
2024-06-12T19:07:22,895   ext_modules=[]
2024-06-12T19:07:22,896   running egg_info
2024-06-12T19:07:22,897   creating /tmp/pip-pip-egg-info-ncfgmuf4/deepspeed.egg-info
2024-06-12T19:07:22,915   writing /tmp/pip-pip-egg-info-ncfgmuf4/deepspeed.egg-info/PKG-INFO
2024-06-12T19:07:22,950   writing dependency_links to /tmp/pip-pip-egg-info-ncfgmuf4/deepspeed.egg-info/dependency_links.txt
2024-06-12T19:07:22,953   writing entry points to /tmp/pip-pip-egg-info-ncfgmuf4/deepspeed.egg-info/entry_points.txt
2024-06-12T19:07:22,971   writing requirements to /tmp/pip-pip-egg-info-ncfgmuf4/deepspeed.egg-info/requires.txt
2024-06-12T19:07:22,972   writing top-level names to /tmp/pip-pip-egg-info-ncfgmuf4/deepspeed.egg-info/top_level.txt
2024-06-12T19:07:22,973   writing manifest file '/tmp/pip-pip-egg-info-ncfgmuf4/deepspeed.egg-info/SOURCES.txt'
2024-06-12T19:07:23,189   reading manifest file '/tmp/pip-pip-egg-info-ncfgmuf4/deepspeed.egg-info/SOURCES.txt'
2024-06-12T19:07:23,190   reading manifest template 'MANIFEST.in'
2024-06-12T19:07:23,192   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-06-12T19:07:23,193   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-06-12T19:07:24,658   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-06-12T19:07:25,796   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-06-12T19:07:26,373   warning: no files found matching '*.tr' under directory 'csrc'
2024-06-12T19:07:26,484   warning: no files found matching '*.cc' under directory 'csrc'
2024-06-12T19:07:26,530   warning: no files found matching '*.py' under directory 'benchmarks'
2024-06-12T19:07:26,587   writing manifest file '/tmp/pip-pip-egg-info-ncfgmuf4/deepspeed.egg-info/SOURCES.txt'
2024-06-12T19:07:26,590   deepspeed build time = 4.196922302246094 secs
2024-06-12T19:07:26,706   Preparing metadata (setup.py): finished with status 'done'
2024-06-12T19:07:26,712   Source in /tmp/pip-wheel-11d0rxsm/deepspeed_de7ddb655ac74b88b235f2ee08a3305f has version 0.14.3, which satisfies requirement deepspeed==0.14.3 from https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz
2024-06-12T19:07:26,713   Removed deepspeed==0.14.3 from https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz from build tracker '/tmp/pip-build-tracker-bm2esee1'
2024-06-12T19:07:26,721 Created temporary directory: /tmp/pip-unpack-awrshuu9
2024-06-12T19:07:26,722 Created temporary directory: /tmp/pip-unpack-wmdjrswq
2024-06-12T19:07:26,984 Building wheels for collected packages: deepspeed
2024-06-12T19:07:26,989   Created temporary directory: /tmp/pip-wheel-e6p3tb96
2024-06-12T19:07:26,989   Building wheel for deepspeed (setup.py): started
2024-06-12T19:07:26,990   Destination directory: /tmp/pip-wheel-e6p3tb96
2024-06-12T19:07:26,991   Running command python setup.py bdist_wheel
2024-06-12T19:07:27,503   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-06-12T19:07:27,512    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-06-12T19:07:27,593   DS_BUILD_OPS=0
2024-06-12T19:07:27,709    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-06-12T19:07:27,767    [WARNING]  async_io: please install the libaio-dev package with apt
2024-06-12T19:07:27,768    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-06-12T19:07:27,768    [WARNING]  Please install torch if trying to pre-compile kernels
2024-06-12T19:07:27,769    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:27,769    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:27,770    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:27,771    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:27,777    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:27,778    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:27,779    [WARNING]  unable to import torch, please install it first
2024-06-12T19:07:27,780    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-06-12T19:07:27,780   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-06-12T19:07:27,786   fatal: not a git repository (or any of the parent directories): .git
2024-06-12T19:07:27,788   version=0.14.3, git_hash=unknown, git_branch=unknown
2024-06-12T19:07:27,789   install_requires=['hjson', 'ninja', 'numpy', 'nvidia-ml-py', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm']
2024-06-12T19:07:27,790   ext_modules=[]
2024-06-12T19:07:28,247   running bdist_wheel
2024-06-12T19:07:28,375   running build
2024-06-12T19:07:28,375   running build_py
2024-06-12T19:07:28,405   creating build
2024-06-12T19:07:28,405   creating build/lib
2024-06-12T19:07:28,406   creating build/lib/deepspeed
2024-06-12T19:07:28,407   copying deepspeed/constants.py -> build/lib/deepspeed
2024-06-12T19:07:28,409   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2024-06-12T19:07:28,411   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-06-12T19:07:28,413   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-06-12T19:07:28,416   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-06-12T19:07:28,418   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-06-12T19:07:28,421   creating build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,422   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,424   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,426   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,429   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,430   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,432   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,434   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,436   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,439   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,441   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-06-12T19:07:28,444   creating build/lib/deepspeed/utils
2024-06-12T19:07:28,445   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,446   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,449   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,451   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,454   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,456   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,458   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,460   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,462   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,464   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,466   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,468   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,470   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,473   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,474   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,476   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,478   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,480   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-06-12T19:07:28,482   creating build/lib/deepspeed/profiling
2024-06-12T19:07:28,483   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-06-12T19:07:28,485   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-06-12T19:07:28,486   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-06-12T19:07:28,488   creating build/lib/deepspeed/moe
2024-06-12T19:07:28,489   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-06-12T19:07:28,491   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-06-12T19:07:28,493   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-06-12T19:07:28,495   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-06-12T19:07:28,496   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-06-12T19:07:28,499   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-06-12T19:07:28,501   creating build/lib/deepspeed/autotuning
2024-06-12T19:07:28,502   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-06-12T19:07:28,504   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-06-12T19:07:28,507   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-06-12T19:07:28,509   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-06-12T19:07:28,512   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-06-12T19:07:28,514   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-06-12T19:07:28,516   creating build/lib/deepspeed/ops
2024-06-12T19:07:28,517   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-06-12T19:07:28,519   creating build/lib/deepspeed/monitor
2024-06-12T19:07:28,520   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-06-12T19:07:28,522   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-06-12T19:07:28,524   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-06-12T19:07:28,526   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-06-12T19:07:28,527   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-06-12T19:07:28,529   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-06-12T19:07:28,531   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-06-12T19:07:28,532   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-06-12T19:07:28,535   creating build/lib/deepspeed/compression
2024-06-12T19:07:28,536   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-06-12T19:07:28,538   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-06-12T19:07:28,540   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-06-12T19:07:28,542   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-06-12T19:07:28,544   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-06-12T19:07:28,547   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-06-12T19:07:28,549   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-06-12T19:07:28,551   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-06-12T19:07:28,554   creating build/lib/deepspeed/inference
2024-06-12T19:07:28,555   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-06-12T19:07:28,557   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-06-12T19:07:28,560   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-06-12T19:07:28,562   creating build/lib/deepspeed/runtime
2024-06-12T19:07:28,563   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,566   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,567   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,569   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,572   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,573   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,575   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,580   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,582   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,585   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,587   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,589   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,591   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,593   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,595   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,597   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,599   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,601   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-06-12T19:07:28,603   creating build/lib/deepspeed/pipe
2024-06-12T19:07:28,604   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-06-12T19:07:28,606   creating build/lib/deepspeed/elasticity
2024-06-12T19:07:28,607   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-06-12T19:07:28,610   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-06-12T19:07:28,611   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-06-12T19:07:28,613   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-06-12T19:07:28,615   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-06-12T19:07:28,616   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-06-12T19:07:28,619   creating build/lib/deepspeed/sequence
2024-06-12T19:07:28,620   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-06-12T19:07:28,622   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-06-12T19:07:28,624   creating build/lib/deepspeed/accelerator
2024-06-12T19:07:28,625   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-12T19:07:28,628   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-12T19:07:28,630   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-12T19:07:28,632   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-12T19:07:28,634   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-06-12T19:07:28,636   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-12T19:07:28,638   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-12T19:07:28,641   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-12T19:07:28,643   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-06-12T19:07:28,646   creating build/lib/deepspeed/launcher
2024-06-12T19:07:28,646   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-06-12T19:07:28,648   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-06-12T19:07:28,650   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-06-12T19:07:28,653   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-06-12T19:07:28,655   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-06-12T19:07:28,656   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-06-12T19:07:28,659   creating build/lib/deepspeed/nebula
2024-06-12T19:07:28,659   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-06-12T19:07:28,661   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-06-12T19:07:28,663   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-06-12T19:07:28,665   creating build/lib/deepspeed/linear
2024-06-12T19:07:28,666   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-06-12T19:07:28,668   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-06-12T19:07:28,669   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-06-12T19:07:28,671   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-06-12T19:07:28,674   creating build/lib/deepspeed/module_inject
2024-06-12T19:07:28,674   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,677   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,679   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,681   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,683   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,684   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,686   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,689   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,691   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,693   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,695   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,696   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,698   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-06-12T19:07:28,701   creating build/lib/deepspeed/model_implementations
2024-06-12T19:07:28,702   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-06-12T19:07:28,704   creating build/lib/deepspeed/comm
2024-06-12T19:07:28,705   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-06-12T19:07:28,707   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-06-12T19:07:28,709   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-06-12T19:07:28,711   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-06-12T19:07:28,713   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-06-12T19:07:28,715   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-06-12T19:07:28,716   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-06-12T19:07:28,718   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-06-12T19:07:28,721   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-06-12T19:07:28,723   creating build/lib/deepspeed/profiling/flops_profiler
2024-06-12T19:07:28,724   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-06-12T19:07:28,725   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-06-12T19:07:28,729   creating build/lib/deepspeed/autotuning/tuner
2024-06-12T19:07:28,730   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-06-12T19:07:28,732   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-06-12T19:07:28,733   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-06-12T19:07:28,735   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-06-12T19:07:28,736   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-06-12T19:07:28,739   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-06-12T19:07:28,741   creating build/lib/deepspeed/ops/lamb
2024-06-12T19:07:28,741   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-06-12T19:07:28,744   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-06-12T19:07:28,746   creating build/lib/deepspeed/ops/transformer
2024-06-12T19:07:28,746   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-06-12T19:07:28,748   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-06-12T19:07:28,751   creating build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,752   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,755   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,757   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,758   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,761   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,762   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,768   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,770   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,772   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,773   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,775   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,777   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,779   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,780   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,782   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,784   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,786   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,787   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,789   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,791   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,792   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,794   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,796   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-06-12T19:07:28,798   creating build/lib/deepspeed/ops/fp_quantizer
2024-06-12T19:07:28,799   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-06-12T19:07:28,801   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-06-12T19:07:28,803   creating build/lib/deepspeed/ops/deepspeed4science
2024-06-12T19:07:28,804   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-06-12T19:07:28,805   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-06-12T19:07:28,808   creating build/lib/deepspeed/ops/aio
2024-06-12T19:07:28,809   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-06-12T19:07:28,811   creating build/lib/deepspeed/ops/sparse_attention
2024-06-12T19:07:28,812   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-12T19:07:28,815   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-12T19:07:28,817   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-12T19:07:28,819   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-12T19:07:28,821   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-12T19:07:28,823   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-12T19:07:28,825   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-06-12T19:07:28,828   creating build/lib/deepspeed/ops/adam
2024-06-12T19:07:28,829   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-06-12T19:07:28,831   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-06-12T19:07:28,833   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-06-12T19:07:28,834   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-06-12T19:07:28,837   creating build/lib/deepspeed/ops/lion
2024-06-12T19:07:28,838   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-06-12T19:07:28,839   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-06-12T19:07:28,841   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-06-12T19:07:28,843   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-06-12T19:07:28,845   creating build/lib/deepspeed/ops/adagrad
2024-06-12T19:07:28,846   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-06-12T19:07:28,848   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-06-12T19:07:28,850   creating build/lib/deepspeed/ops/quantizer
2024-06-12T19:07:28,852   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-06-12T19:07:28,853   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-06-12T19:07:28,855   creating build/lib/deepspeed/ops/random_ltd
2024-06-12T19:07:28,856   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-06-12T19:07:28,859   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-06-12T19:07:28,861   creating build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,862   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,864   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,866   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,868   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,870   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,872   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,874   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,876   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,878   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,880   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-06-12T19:07:28,883   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,884   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,886   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,888   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,890   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,893   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,895   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,896   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,899   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,901   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,904   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:28,906   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,908   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,910   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,912   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,914   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,916   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,918   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,921   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,923   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,925   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,927   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:28,929   creating build/lib/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:28,930   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:28,932   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:28,934   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:28,936   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:28,937   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:28,939   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:28,941   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:28,943   creating build/lib/deepspeed/ops/op_builder/npu
2024-06-12T19:07:28,944   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-12T19:07:28,946   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-12T19:07:28,947   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-12T19:07:28,949   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-12T19:07:28,951   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-12T19:07:28,953   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-12T19:07:28,954   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-12T19:07:28,957   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-12T19:07:28,959   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-06-12T19:07:28,961   creating build/lib/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:28,962   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:28,964   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:28,966   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:28,967   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:28,970   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:28,971   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:28,974   creating build/lib/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:28,975   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:28,977   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:28,978   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:28,980   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:28,982   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:28,984   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-06-12T19:07:28,985   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-06-12T19:07:28,987   creating build/lib/deepspeed/inference/quantization
2024-06-12T19:07:28,989   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-06-12T19:07:28,991   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-06-12T19:07:28,993   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-06-12T19:07:28,995   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-06-12T19:07:28,997   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-06-12T19:07:28,999   creating build/lib/deepspeed/inference/v2
2024-06-12T19:07:29,000   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-06-12T19:07:29,003   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-06-12T19:07:29,005   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-06-12T19:07:29,007   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-06-12T19:07:29,008   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-06-12T19:07:29,010   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-06-12T19:07:29,012   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-06-12T19:07:29,014   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-06-12T19:07:29,015   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-06-12T19:07:29,018   creating build/lib/deepspeed/inference/v2/checkpoint
2024-06-12T19:07:29,019   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-06-12T19:07:29,021   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-06-12T19:07:29,023   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-06-12T19:07:29,025   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-06-12T19:07:29,027   creating build/lib/deepspeed/inference/v2/kernels
2024-06-12T19:07:29,028   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-06-12T19:07:29,030   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-06-12T19:07:29,032   creating build/lib/deepspeed/inference/v2/ragged
2024-06-12T19:07:29,033   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-12T19:07:29,036   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-12T19:07:29,038   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-12T19:07:29,040   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-12T19:07:29,043   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-12T19:07:29,045   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-12T19:07:29,047   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-06-12T19:07:29,049   creating build/lib/deepspeed/inference/v2/modules
2024-06-12T19:07:29,050   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-06-12T19:07:29,053   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-06-12T19:07:29,055   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-06-12T19:07:29,057   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-06-12T19:07:29,059   creating build/lib/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:29,060   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:29,063   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:29,066   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:29,068   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:29,070   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:29,072   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:29,074   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:29,077   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-06-12T19:07:29,078   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-06-12T19:07:29,080   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-06-12T19:07:29,081   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-06-12T19:07:29,083   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-12T19:07:29,084   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-12T19:07:29,086   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-12T19:07:29,087   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-12T19:07:29,089   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-12T19:07:29,091   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:29,092   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:29,094   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:29,096   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:29,098   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:29,100   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:29,101   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:29,103   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:29,106   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:29,107   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:29,108   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:29,111   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:29,112   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:29,114   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:29,116   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:29,117   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:29,119   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:29,121   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:29,123   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:29,125   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:29,127   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:29,128   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:29,130   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:29,132   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:29,133   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:29,136   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:29,137   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:29,139   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:29,141   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:29,142   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:29,144   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:29,146   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:29,147   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:29,149   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:29,151   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-12T19:07:29,152   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-12T19:07:29,154   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-12T19:07:29,156   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:29,158   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:29,160   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:29,162   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:29,163   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:29,165   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:29,167   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:29,168   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:29,170   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:29,172   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:29,173   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:29,175   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:29,177   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:29,178   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:29,180   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:29,182   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:29,184   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:29,185   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:29,187   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:29,189   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:29,191   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:29,193   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:29,195   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:29,197   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:29,199   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:29,201   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-06-12T19:07:29,202   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-06-12T19:07:29,205   creating build/lib/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:29,206   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:29,208   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:29,210   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:29,212   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:29,213   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:29,215   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:29,217   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:29,219   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-06-12T19:07:29,220   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-06-12T19:07:29,221   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-06-12T19:07:29,224   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-12T19:07:29,225   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-12T19:07:29,227   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-12T19:07:29,229   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-12T19:07:29,230   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-12T19:07:29,232   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-12T19:07:29,234   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-12T19:07:29,236   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-06-12T19:07:29,237   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-06-12T19:07:29,240   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-06-12T19:07:29,242   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-06-12T19:07:29,243   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-06-12T19:07:29,245   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-06-12T19:07:29,248   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-06-12T19:07:29,249   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-06-12T19:07:29,251   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-06-12T19:07:29,253   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-06-12T19:07:29,255   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-06-12T19:07:29,256   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-06-12T19:07:29,259   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-06-12T19:07:29,261   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-06-12T19:07:29,262   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-06-12T19:07:29,264   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-06-12T19:07:29,266   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-06-12T19:07:29,268   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-06-12T19:07:29,270   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:29,271   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:29,273   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:29,275   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:29,277   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:29,279   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:29,281   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:29,283   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:29,285   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:29,287   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:29,289   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-12T19:07:29,290   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-12T19:07:29,293   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-12T19:07:29,295   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-12T19:07:29,297   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-12T19:07:29,299   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-06-12T19:07:29,301   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-06-12T19:07:29,303   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-06-12T19:07:29,305   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-06-12T19:07:29,307   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-06-12T19:07:29,309   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:29,311   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:29,313   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:29,315   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:29,317   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:29,319   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:29,321   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:29,322   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:29,324   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:29,327   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:29,330   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-06-12T19:07:29,331   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-06-12T19:07:29,334   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-06-12T19:07:29,336   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-06-12T19:07:29,339   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-06-12T19:07:29,342   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-06-12T19:07:29,343   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-06-12T19:07:29,345   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-06-12T19:07:29,347   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-06-12T19:07:29,350   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-06-12T19:07:29,352   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-06-12T19:07:29,353   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-06-12T19:07:29,355   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-06-12T19:07:29,357   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-06-12T19:07:29,359   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-06-12T19:07:29,362   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-12T19:07:29,363   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-12T19:07:29,365   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-12T19:07:29,367   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-12T19:07:29,369   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-12T19:07:29,372   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-06-12T19:07:29,372   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-06-12T19:07:29,374   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-06-12T19:07:29,376   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-06-12T19:07:29,378   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-06-12T19:07:29,381   creating build/lib/deepspeed/runtime/swap_tensor
2024-06-12T19:07:29,382   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-12T19:07:29,384   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-12T19:07:29,386   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-12T19:07:29,388   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-12T19:07:29,390   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-12T19:07:29,392   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-12T19:07:29,394   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-12T19:07:29,397   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-12T19:07:29,399   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-06-12T19:07:29,402   creating build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,403   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,406   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,408   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,410   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,413   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,417   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,419   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,422   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,426   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,428   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,433   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,436   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,438   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,440   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,442   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,445   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-06-12T19:07:29,447   creating build/lib/deepspeed/runtime/compression
2024-06-12T19:07:29,448   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-06-12T19:07:29,450   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-06-12T19:07:29,452   creating build/lib/deepspeed/runtime/data_pipeline
2024-06-12T19:07:29,453   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-06-12T19:07:29,455   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-06-12T19:07:29,457   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-06-12T19:07:29,459   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-06-12T19:07:29,461   creating build/lib/deepspeed/runtime/fp16
2024-06-12T19:07:29,462   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-06-12T19:07:29,464   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-06-12T19:07:29,467   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-06-12T19:07:29,468   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-06-12T19:07:29,471   creating build/lib/deepspeed/runtime/pipe
2024-06-12T19:07:29,472   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-06-12T19:07:29,475   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-06-12T19:07:29,478   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-06-12T19:07:29,480   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-06-12T19:07:29,484   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-06-12T19:07:29,485   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-06-12T19:07:29,488   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-06-12T19:07:29,489   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-06-12T19:07:29,491   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-06-12T19:07:29,493   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-06-12T19:07:29,495   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-06-12T19:07:29,497   creating build/lib/deepspeed/runtime/comm
2024-06-12T19:07:29,498   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-06-12T19:07:29,501   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-06-12T19:07:29,502   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-06-12T19:07:29,505   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-06-12T19:07:29,507   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-06-12T19:07:29,509   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-06-12T19:07:29,512   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-06-12T19:07:29,513   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-06-12T19:07:29,515   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-06-12T19:07:29,518   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-06-12T19:07:29,521   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:29,522   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:29,524   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:29,526   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:29,528   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:29,530   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:29,532   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:29,533   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:29,535   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:29,537   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:29,540   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:29,543   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:29,546   creating build/lib/deepspeed/runtime/fp16/onebit
2024-06-12T19:07:29,547   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-06-12T19:07:29,549   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-06-12T19:07:29,551   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-06-12T19:07:29,553   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-06-12T19:07:29,557   creating build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,558   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,560   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,562   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,565   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,567   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,569   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,571   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,573   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,575   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,577   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,579   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,581   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,583   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,586   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,588   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,590   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,592   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,594   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,596   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-06-12T19:07:29,598   creating build/lib/deepspeed/module_inject/containers/features
2024-06-12T19:07:29,599   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-12T19:07:29,601   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-12T19:07:29,603   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-12T19:07:29,605   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-12T19:07:29,607   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-12T19:07:29,609   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-12T19:07:29,611   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-06-12T19:07:29,613   creating build/lib/deepspeed/model_implementations/features
2024-06-12T19:07:29,614   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-06-12T19:07:29,616   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-06-12T19:07:29,619   creating build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,620   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,622   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,624   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,625   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,627   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,630   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,631   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,633   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,635   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,637   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-06-12T19:07:29,639   creating build/lib/deepspeed/model_implementations/diffusers
2024-06-12T19:07:29,640   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-06-12T19:07:29,642   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-06-12T19:07:29,644   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-06-12T19:07:29,647   running egg_info
2024-06-12T19:07:29,675   writing deepspeed.egg-info/PKG-INFO
2024-06-12T19:07:29,709   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-06-12T19:07:29,711   writing entry points to deepspeed.egg-info/entry_points.txt
2024-06-12T19:07:29,729   writing requirements to deepspeed.egg-info/requires.txt
2024-06-12T19:07:29,730   writing top-level names to deepspeed.egg-info/top_level.txt
2024-06-12T19:07:29,846   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-06-12T19:07:29,894   reading manifest template 'MANIFEST.in'
2024-06-12T19:07:29,896   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-06-12T19:07:29,897   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-06-12T19:07:31,332   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-06-12T19:07:32,217   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-06-12T19:07:32,866   warning: no files found matching '*.tr' under directory 'csrc'
2024-06-12T19:07:32,979   warning: no files found matching '*.cc' under directory 'csrc'
2024-06-12T19:07:33,013   warning: no files found matching '*.py' under directory 'benchmarks'
2024-06-12T19:07:33,062   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-06-12T19:07:33,071   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-06-12T19:07:33,072   !!

2024-06-12T19:07:33,073           ********************************************************************************
2024-06-12T19:07:33,074           ############################
2024-06-12T19:07:33,075           # Package would be ignored #
2024-06-12T19:07:33,075           ############################
2024-06-12T19:07:33,077           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-06-12T19:07:33,078           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,080           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,082           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-06-12T19:07:33,082           to the `packages` configuration field.

2024-06-12T19:07:33,084           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,085           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,085           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,087           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,088           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,089           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-06-12T19:07:33,089           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-06-12T19:07:33,090           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,090           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,091           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,092           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,093           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,095           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,095                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,096                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,096                 directory, all directories are treated like packages.
2024-06-12T19:07:33,097           ********************************************************************************

2024-06-12T19:07:33,098   !!
2024-06-12T19:07:33,098     check.warn(importable)
2024-06-12T19:07:33,098   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-06-12T19:07:33,099   !!

2024-06-12T19:07:33,100           ********************************************************************************
2024-06-12T19:07:33,100           ############################
2024-06-12T19:07:33,101           # Package would be ignored #
2024-06-12T19:07:33,101           ############################
2024-06-12T19:07:33,101           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-06-12T19:07:33,102           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,103           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,103           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-06-12T19:07:33,103           to the `packages` configuration field.

2024-06-12T19:07:33,104           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,104           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,105           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,106           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,107           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,108           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-06-12T19:07:33,109           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-06-12T19:07:33,109           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,110           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,110           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,111           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,112           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,114           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,114                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,115                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,115                 directory, all directories are treated like packages.
2024-06-12T19:07:33,116           ********************************************************************************

2024-06-12T19:07:33,117   !!
2024-06-12T19:07:33,117     check.warn(importable)
2024-06-12T19:07:33,118   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-06-12T19:07:33,118   !!

2024-06-12T19:07:33,119           ********************************************************************************
2024-06-12T19:07:33,120           ############################
2024-06-12T19:07:33,121           # Package would be ignored #
2024-06-12T19:07:33,121           ############################
2024-06-12T19:07:33,122           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-06-12T19:07:33,122           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,123           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,124           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-06-12T19:07:33,124           to the `packages` configuration field.

2024-06-12T19:07:33,125           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,125           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,125           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,126           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,127           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,128           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-06-12T19:07:33,128           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-06-12T19:07:33,128           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,129           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,129           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,130           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,131           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,132           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,133                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,133                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,134                 directory, all directories are treated like packages.
2024-06-12T19:07:33,135           ********************************************************************************

2024-06-12T19:07:33,136   !!
2024-06-12T19:07:33,137     check.warn(importable)
2024-06-12T19:07:33,137   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-06-12T19:07:33,138   !!

2024-06-12T19:07:33,139           ********************************************************************************
2024-06-12T19:07:33,140           ############################
2024-06-12T19:07:33,140           # Package would be ignored #
2024-06-12T19:07:33,141           ############################
2024-06-12T19:07:33,141           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-06-12T19:07:33,142           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,143           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,143           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-06-12T19:07:33,143           to the `packages` configuration field.

2024-06-12T19:07:33,144           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,145           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,145           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,146           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,147           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,148           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-06-12T19:07:33,149           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-06-12T19:07:33,149           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,150           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,150           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,151           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,151           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,152           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,153                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,153                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,153                 directory, all directories are treated like packages.
2024-06-12T19:07:33,154           ********************************************************************************

2024-06-12T19:07:33,155   !!
2024-06-12T19:07:33,155     check.warn(importable)
2024-06-12T19:07:33,155   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-06-12T19:07:33,156   !!

2024-06-12T19:07:33,157           ********************************************************************************
2024-06-12T19:07:33,157           ############################
2024-06-12T19:07:33,158           # Package would be ignored #
2024-06-12T19:07:33,158           ############################
2024-06-12T19:07:33,158           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-06-12T19:07:33,159           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,160           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,161           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-06-12T19:07:33,161           to the `packages` configuration field.

2024-06-12T19:07:33,162           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,163           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,163           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,164           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,166           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,167           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-06-12T19:07:33,167           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-06-12T19:07:33,167           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,168           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,169           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,170           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,171           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,173           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,173                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,174                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,174                 directory, all directories are treated like packages.
2024-06-12T19:07:33,175           ********************************************************************************

2024-06-12T19:07:33,176   !!
2024-06-12T19:07:33,176     check.warn(importable)
2024-06-12T19:07:33,177   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-06-12T19:07:33,177   !!

2024-06-12T19:07:33,179           ********************************************************************************
2024-06-12T19:07:33,179           ############################
2024-06-12T19:07:33,179           # Package would be ignored #
2024-06-12T19:07:33,180           ############################
2024-06-12T19:07:33,180           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-06-12T19:07:33,180           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,181           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,181           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-06-12T19:07:33,182           to the `packages` configuration field.

2024-06-12T19:07:33,182           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,183           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,183           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,184           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,185           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,186           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-06-12T19:07:33,186           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-06-12T19:07:33,187           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,187           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,188           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,189           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,190           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,192           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,192                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,193                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,193                 directory, all directories are treated like packages.
2024-06-12T19:07:33,194           ********************************************************************************

2024-06-12T19:07:33,195   !!
2024-06-12T19:07:33,195     check.warn(importable)
2024-06-12T19:07:33,196   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-06-12T19:07:33,196   !!

2024-06-12T19:07:33,197           ********************************************************************************
2024-06-12T19:07:33,198           ############################
2024-06-12T19:07:33,198           # Package would be ignored #
2024-06-12T19:07:33,199           ############################
2024-06-12T19:07:33,199           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-06-12T19:07:33,200           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,201           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,201           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-06-12T19:07:33,202           to the `packages` configuration field.

2024-06-12T19:07:33,203           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,204           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,204           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,205           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,205           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,206           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-06-12T19:07:33,206           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-06-12T19:07:33,207           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,207           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,207           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,208           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,209           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,210           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,210                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,211                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,211                 directory, all directories are treated like packages.
2024-06-12T19:07:33,212           ********************************************************************************

2024-06-12T19:07:33,212   !!
2024-06-12T19:07:33,213     check.warn(importable)
2024-06-12T19:07:33,214   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-06-12T19:07:33,214   !!

2024-06-12T19:07:33,215           ********************************************************************************
2024-06-12T19:07:33,216           ############################
2024-06-12T19:07:33,216           # Package would be ignored #
2024-06-12T19:07:33,217           ############################
2024-06-12T19:07:33,217           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-06-12T19:07:33,218           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,219           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,220           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-06-12T19:07:33,220           to the `packages` configuration field.

2024-06-12T19:07:33,221           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,222           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,222           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,223           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,224           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,225           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-06-12T19:07:33,225           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-06-12T19:07:33,226           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,226           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,227           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,228           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,229           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,230           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,231                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,231                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,231                 directory, all directories are treated like packages.
2024-06-12T19:07:33,232           ********************************************************************************

2024-06-12T19:07:33,232   !!
2024-06-12T19:07:33,233     check.warn(importable)
2024-06-12T19:07:33,233   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-06-12T19:07:33,233   !!

2024-06-12T19:07:33,234           ********************************************************************************
2024-06-12T19:07:33,234           ############################
2024-06-12T19:07:33,235           # Package would be ignored #
2024-06-12T19:07:33,235           ############################
2024-06-12T19:07:33,235           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-06-12T19:07:33,236           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,236           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,237           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-06-12T19:07:33,237           to the `packages` configuration field.

2024-06-12T19:07:33,238           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,238           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,239           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,240           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,241           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,243           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-06-12T19:07:33,243           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-06-12T19:07:33,244           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,244           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,245           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,246           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,247           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,248           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,249                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,249                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,250                 directory, all directories are treated like packages.
2024-06-12T19:07:33,250           ********************************************************************************

2024-06-12T19:07:33,251   !!
2024-06-12T19:07:33,251     check.warn(importable)
2024-06-12T19:07:33,252   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-06-12T19:07:33,253   !!

2024-06-12T19:07:33,254           ********************************************************************************
2024-06-12T19:07:33,254           ############################
2024-06-12T19:07:33,255           # Package would be ignored #
2024-06-12T19:07:33,255           ############################
2024-06-12T19:07:33,256           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-06-12T19:07:33,257           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,258           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,258           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-06-12T19:07:33,259           to the `packages` configuration field.

2024-06-12T19:07:33,259           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,260           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,260           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,261           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,262           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,262           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-06-12T19:07:33,263           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-06-12T19:07:33,263           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,263           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,264           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,264           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,265           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,267           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,267                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,268                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,268                 directory, all directories are treated like packages.
2024-06-12T19:07:33,269           ********************************************************************************

2024-06-12T19:07:33,270   !!
2024-06-12T19:07:33,271     check.warn(importable)
2024-06-12T19:07:33,271   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-06-12T19:07:33,272   !!

2024-06-12T19:07:33,273           ********************************************************************************
2024-06-12T19:07:33,273           ############################
2024-06-12T19:07:33,274           # Package would be ignored #
2024-06-12T19:07:33,274           ############################
2024-06-12T19:07:33,275           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-06-12T19:07:33,275           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,276           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,277           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-06-12T19:07:33,277           to the `packages` configuration field.

2024-06-12T19:07:33,278           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,279           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,279           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,280           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,281           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,282           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-06-12T19:07:33,283           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-06-12T19:07:33,283           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,284           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,284           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,285           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,286           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,286           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,287                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,287                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,288                 directory, all directories are treated like packages.
2024-06-12T19:07:33,288           ********************************************************************************

2024-06-12T19:07:33,289   !!
2024-06-12T19:07:33,289     check.warn(importable)
2024-06-12T19:07:33,289   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-06-12T19:07:33,290   !!

2024-06-12T19:07:33,290           ********************************************************************************
2024-06-12T19:07:33,291           ############################
2024-06-12T19:07:33,291           # Package would be ignored #
2024-06-12T19:07:33,292           ############################
2024-06-12T19:07:33,292           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-06-12T19:07:33,292           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,293           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,294           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-06-12T19:07:33,294           to the `packages` configuration field.

2024-06-12T19:07:33,296           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,296           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,297           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,298           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,299           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,300           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-06-12T19:07:33,301           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-06-12T19:07:33,302           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,302           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,303           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,304           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,305           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,306           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,306                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,307                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,308                 directory, all directories are treated like packages.
2024-06-12T19:07:33,309           ********************************************************************************

2024-06-12T19:07:33,310   !!
2024-06-12T19:07:33,311     check.warn(importable)
2024-06-12T19:07:33,311   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-06-12T19:07:33,312   !!

2024-06-12T19:07:33,313           ********************************************************************************
2024-06-12T19:07:33,313           ############################
2024-06-12T19:07:33,314           # Package would be ignored #
2024-06-12T19:07:33,314           ############################
2024-06-12T19:07:33,314           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-06-12T19:07:33,315           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,316           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,316           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-06-12T19:07:33,316           to the `packages` configuration field.

2024-06-12T19:07:33,317           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,317           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,318           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,319           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,319           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,320           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-06-12T19:07:33,321           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-06-12T19:07:33,321           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,322           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,322           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,323           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,324           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,326           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,326                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,327                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,327                 directory, all directories are treated like packages.
2024-06-12T19:07:33,328           ********************************************************************************

2024-06-12T19:07:33,329   !!
2024-06-12T19:07:33,329     check.warn(importable)
2024-06-12T19:07:33,330   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-06-12T19:07:33,331   !!

2024-06-12T19:07:33,331           ********************************************************************************
2024-06-12T19:07:33,332           ############################
2024-06-12T19:07:33,332           # Package would be ignored #
2024-06-12T19:07:33,333           ############################
2024-06-12T19:07:33,333           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-06-12T19:07:33,334           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,334           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,335           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-06-12T19:07:33,336           to the `packages` configuration field.

2024-06-12T19:07:33,337           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,337           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,337           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,339           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,340           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,340           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-06-12T19:07:33,341           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-06-12T19:07:33,341           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,341           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,341           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,342           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,343           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,344           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,344                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,345                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,345                 directory, all directories are treated like packages.
2024-06-12T19:07:33,345           ********************************************************************************

2024-06-12T19:07:33,346   !!
2024-06-12T19:07:33,346     check.warn(importable)
2024-06-12T19:07:33,347   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-06-12T19:07:33,347   !!

2024-06-12T19:07:33,348           ********************************************************************************
2024-06-12T19:07:33,349           ############################
2024-06-12T19:07:33,349           # Package would be ignored #
2024-06-12T19:07:33,350           ############################
2024-06-12T19:07:33,350           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-06-12T19:07:33,351           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,352           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,352           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-06-12T19:07:33,353           to the `packages` configuration field.

2024-06-12T19:07:33,354           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,355           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,355           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,356           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,357           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,358           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-06-12T19:07:33,358           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-06-12T19:07:33,359           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,359           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,360           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,361           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,362           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,363           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,364                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,364                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,365                 directory, all directories are treated like packages.
2024-06-12T19:07:33,365           ********************************************************************************

2024-06-12T19:07:33,366   !!
2024-06-12T19:07:33,366     check.warn(importable)
2024-06-12T19:07:33,367   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-06-12T19:07:33,367   !!

2024-06-12T19:07:33,368           ********************************************************************************
2024-06-12T19:07:33,368           ############################
2024-06-12T19:07:33,368           # Package would be ignored #
2024-06-12T19:07:33,369           ############################
2024-06-12T19:07:33,369           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-06-12T19:07:33,369           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,370           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,370           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-06-12T19:07:33,371           to the `packages` configuration field.

2024-06-12T19:07:33,371           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,372           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,372           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,373           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,374           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,375           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-06-12T19:07:33,375           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-06-12T19:07:33,376           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,376           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,377           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,378           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,379           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,380           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,381                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,381                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,382                 directory, all directories are treated like packages.
2024-06-12T19:07:33,382           ********************************************************************************

2024-06-12T19:07:33,383   !!
2024-06-12T19:07:33,384     check.warn(importable)
2024-06-12T19:07:33,384   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-06-12T19:07:33,384   !!

2024-06-12T19:07:33,385           ********************************************************************************
2024-06-12T19:07:33,386           ############################
2024-06-12T19:07:33,386           # Package would be ignored #
2024-06-12T19:07:33,387           ############################
2024-06-12T19:07:33,387           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-06-12T19:07:33,388           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,389           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,390           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-06-12T19:07:33,391           to the `packages` configuration field.

2024-06-12T19:07:33,391           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,392           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,392           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,393           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,393           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,394           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-06-12T19:07:33,394           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-06-12T19:07:33,395           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,395           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,395           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,396           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,397           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,398           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,398                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,398                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,399                 directory, all directories are treated like packages.
2024-06-12T19:07:33,399           ********************************************************************************

2024-06-12T19:07:33,400   !!
2024-06-12T19:07:33,401     check.warn(importable)
2024-06-12T19:07:33,401   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-06-12T19:07:33,402   !!

2024-06-12T19:07:33,403           ********************************************************************************
2024-06-12T19:07:33,404           ############################
2024-06-12T19:07:33,404           # Package would be ignored #
2024-06-12T19:07:33,405           ############################
2024-06-12T19:07:33,405           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-06-12T19:07:33,406           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,407           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,407           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-06-12T19:07:33,407           to the `packages` configuration field.

2024-06-12T19:07:33,408           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,409           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,409           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,410           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,411           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,412           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-06-12T19:07:33,413           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-06-12T19:07:33,413           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,414           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,415           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,415           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,416           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,417           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,417                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,417                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,418                 directory, all directories are treated like packages.
2024-06-12T19:07:33,418           ********************************************************************************

2024-06-12T19:07:33,419   !!
2024-06-12T19:07:33,419     check.warn(importable)
2024-06-12T19:07:33,419   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-06-12T19:07:33,420   !!

2024-06-12T19:07:33,420           ********************************************************************************
2024-06-12T19:07:33,421           ############################
2024-06-12T19:07:33,421           # Package would be ignored #
2024-06-12T19:07:33,421           ############################
2024-06-12T19:07:33,422           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-06-12T19:07:33,422           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,423           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,424           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-06-12T19:07:33,424           to the `packages` configuration field.

2024-06-12T19:07:33,425           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,426           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,426           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,427           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,428           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,429           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-06-12T19:07:33,430           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-06-12T19:07:33,430           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,431           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,431           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,432           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,433           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,434           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,435                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,435                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,436                 directory, all directories are treated like packages.
2024-06-12T19:07:33,436           ********************************************************************************

2024-06-12T19:07:33,437   !!
2024-06-12T19:07:33,438     check.warn(importable)
2024-06-12T19:07:33,438   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-06-12T19:07:33,439   !!

2024-06-12T19:07:33,440           ********************************************************************************
2024-06-12T19:07:33,440           ############################
2024-06-12T19:07:33,441           # Package would be ignored #
2024-06-12T19:07:33,441           ############################
2024-06-12T19:07:33,441           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-06-12T19:07:33,442           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,442           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,443           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-06-12T19:07:33,443           to the `packages` configuration field.

2024-06-12T19:07:33,444           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,444           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,444           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,445           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,446           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,446           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-06-12T19:07:33,447           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-06-12T19:07:33,447           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,448           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,448           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,449           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,451           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,452           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,453                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,454                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,454                 directory, all directories are treated like packages.
2024-06-12T19:07:33,455           ********************************************************************************

2024-06-12T19:07:33,456   !!
2024-06-12T19:07:33,457     check.warn(importable)
2024-06-12T19:07:33,458   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-06-12T19:07:33,458   !!

2024-06-12T19:07:33,460           ********************************************************************************
2024-06-12T19:07:33,460           ############################
2024-06-12T19:07:33,461           # Package would be ignored #
2024-06-12T19:07:33,461           ############################
2024-06-12T19:07:33,462           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-06-12T19:07:33,462           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,464           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,464           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-06-12T19:07:33,465           to the `packages` configuration field.

2024-06-12T19:07:33,466           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,466           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,467           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,468           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,469           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,469           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-06-12T19:07:33,470           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-06-12T19:07:33,470           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,471           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,471           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,472           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,473           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,474           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,475                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,475                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,476                 directory, all directories are treated like packages.
2024-06-12T19:07:33,476           ********************************************************************************

2024-06-12T19:07:33,478   !!
2024-06-12T19:07:33,478     check.warn(importable)
2024-06-12T19:07:33,479   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-06-12T19:07:33,479   !!

2024-06-12T19:07:33,480           ********************************************************************************
2024-06-12T19:07:33,481           ############################
2024-06-12T19:07:33,482           # Package would be ignored #
2024-06-12T19:07:33,482           ############################
2024-06-12T19:07:33,483           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-06-12T19:07:33,484           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,485           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,486           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-06-12T19:07:33,486           to the `packages` configuration field.

2024-06-12T19:07:33,487           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,488           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,488           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,490           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,491           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,492           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-06-12T19:07:33,493           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-06-12T19:07:33,493           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,494           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,494           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,496           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,497           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,499           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,499                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,500                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,500                 directory, all directories are treated like packages.
2024-06-12T19:07:33,500           ********************************************************************************

2024-06-12T19:07:33,501   !!
2024-06-12T19:07:33,502     check.warn(importable)
2024-06-12T19:07:33,502   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-06-12T19:07:33,503   !!

2024-06-12T19:07:33,503           ********************************************************************************
2024-06-12T19:07:33,504           ############################
2024-06-12T19:07:33,504           # Package would be ignored #
2024-06-12T19:07:33,505           ############################
2024-06-12T19:07:33,505           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-06-12T19:07:33,506           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,507           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,507           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-06-12T19:07:33,508           to the `packages` configuration field.

2024-06-12T19:07:33,509           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,510           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,510           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,511           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,512           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,514           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-06-12T19:07:33,514           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-06-12T19:07:33,515           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,515           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,516           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,517           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,518           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,520           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,520                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,521                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,522                 directory, all directories are treated like packages.
2024-06-12T19:07:33,522           ********************************************************************************

2024-06-12T19:07:33,523   !!
2024-06-12T19:07:33,524     check.warn(importable)
2024-06-12T19:07:33,525   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-06-12T19:07:33,525   !!

2024-06-12T19:07:33,528           ********************************************************************************
2024-06-12T19:07:33,529           ############################
2024-06-12T19:07:33,530           # Package would be ignored #
2024-06-12T19:07:33,531           ############################
2024-06-12T19:07:33,531           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-06-12T19:07:33,531           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,532           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,533           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-06-12T19:07:33,533           to the `packages` configuration field.

2024-06-12T19:07:33,534           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,535           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,535           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,536           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,537           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,538           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-06-12T19:07:33,538           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-06-12T19:07:33,539           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,539           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,540           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,541           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,542           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,544           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,544                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,545                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,546                 directory, all directories are treated like packages.
2024-06-12T19:07:33,546           ********************************************************************************

2024-06-12T19:07:33,547   !!
2024-06-12T19:07:33,548     check.warn(importable)
2024-06-12T19:07:33,549   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-06-12T19:07:33,550   !!

2024-06-12T19:07:33,551           ********************************************************************************
2024-06-12T19:07:33,552           ############################
2024-06-12T19:07:33,552           # Package would be ignored #
2024-06-12T19:07:33,553           ############################
2024-06-12T19:07:33,553           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-06-12T19:07:33,554           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,555           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,556           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-06-12T19:07:33,557           to the `packages` configuration field.

2024-06-12T19:07:33,558           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,559           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,559           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,560           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,562           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,563           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-06-12T19:07:33,564           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-06-12T19:07:33,565           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,565           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,566           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,567           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,568           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,570           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,570                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,571                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,571                 directory, all directories are treated like packages.
2024-06-12T19:07:33,572           ********************************************************************************

2024-06-12T19:07:33,573   !!
2024-06-12T19:07:33,574     check.warn(importable)
2024-06-12T19:07:33,574   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-06-12T19:07:33,575   !!

2024-06-12T19:07:33,576           ********************************************************************************
2024-06-12T19:07:33,577           ############################
2024-06-12T19:07:33,577           # Package would be ignored #
2024-06-12T19:07:33,578           ############################
2024-06-12T19:07:33,579           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-06-12T19:07:33,579           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,580           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,581           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-06-12T19:07:33,582           to the `packages` configuration field.

2024-06-12T19:07:33,583           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,584           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,584           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,585           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,587           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,589           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-06-12T19:07:33,589           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-06-12T19:07:33,590           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,591           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,591           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,593           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,594           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,596           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,597                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,597                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,598                 directory, all directories are treated like packages.
2024-06-12T19:07:33,599           ********************************************************************************

2024-06-12T19:07:33,600   !!
2024-06-12T19:07:33,601     check.warn(importable)
2024-06-12T19:07:33,602   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-06-12T19:07:33,602   !!

2024-06-12T19:07:33,604           ********************************************************************************
2024-06-12T19:07:33,604           ############################
2024-06-12T19:07:33,605           # Package would be ignored #
2024-06-12T19:07:33,605           ############################
2024-06-12T19:07:33,606           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-06-12T19:07:33,606           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,608           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,608           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-06-12T19:07:33,609           to the `packages` configuration field.

2024-06-12T19:07:33,611           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,612           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,612           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,613           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,615           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,616           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-06-12T19:07:33,616           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-06-12T19:07:33,617           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,618           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,618           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,620           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,621           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,623           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,623                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,624                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,625                 directory, all directories are treated like packages.
2024-06-12T19:07:33,625           ********************************************************************************

2024-06-12T19:07:33,626   !!
2024-06-12T19:07:33,627     check.warn(importable)
2024-06-12T19:07:33,628   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-06-12T19:07:33,628   !!

2024-06-12T19:07:33,630           ********************************************************************************
2024-06-12T19:07:33,630           ############################
2024-06-12T19:07:33,631           # Package would be ignored #
2024-06-12T19:07:33,631           ############################
2024-06-12T19:07:33,632           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-06-12T19:07:33,633           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,634           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,635           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-06-12T19:07:33,635           to the `packages` configuration field.

2024-06-12T19:07:33,637           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,637           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,638           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,639           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,640           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,642           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-06-12T19:07:33,642           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-06-12T19:07:33,642           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,643           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,644           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,645           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,646           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,648           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,649                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,649                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,650                 directory, all directories are treated like packages.
2024-06-12T19:07:33,650           ********************************************************************************

2024-06-12T19:07:33,651   !!
2024-06-12T19:07:33,652     check.warn(importable)
2024-06-12T19:07:33,653   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-06-12T19:07:33,653   !!

2024-06-12T19:07:33,654           ********************************************************************************
2024-06-12T19:07:33,655           ############################
2024-06-12T19:07:33,655           # Package would be ignored #
2024-06-12T19:07:33,656           ############################
2024-06-12T19:07:33,656           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-06-12T19:07:33,657           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,658           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,658           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-06-12T19:07:33,659           to the `packages` configuration field.

2024-06-12T19:07:33,660           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,660           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,661           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,662           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,663           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,664           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-06-12T19:07:33,664           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-06-12T19:07:33,665           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,665           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,666           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,667           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,668           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,670           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,670                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,671                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,671                 directory, all directories are treated like packages.
2024-06-12T19:07:33,672           ********************************************************************************

2024-06-12T19:07:33,673   !!
2024-06-12T19:07:33,673     check.warn(importable)
2024-06-12T19:07:33,674   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-06-12T19:07:33,674   !!

2024-06-12T19:07:33,675           ********************************************************************************
2024-06-12T19:07:33,675           ############################
2024-06-12T19:07:33,676           # Package would be ignored #
2024-06-12T19:07:33,676           ############################
2024-06-12T19:07:33,677           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-06-12T19:07:33,677           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,678           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,679           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-06-12T19:07:33,679           to the `packages` configuration field.

2024-06-12T19:07:33,680           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,680           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,681           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,682           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,683           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,684           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-06-12T19:07:33,684           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-06-12T19:07:33,685           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,685           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,686           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,687           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,687           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,689           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,689                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,690                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,690                 directory, all directories are treated like packages.
2024-06-12T19:07:33,691           ********************************************************************************

2024-06-12T19:07:33,692   !!
2024-06-12T19:07:33,693     check.warn(importable)
2024-06-12T19:07:33,693   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-06-12T19:07:33,694   !!

2024-06-12T19:07:33,695           ********************************************************************************
2024-06-12T19:07:33,695           ############################
2024-06-12T19:07:33,696           # Package would be ignored #
2024-06-12T19:07:33,696           ############################
2024-06-12T19:07:33,697           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-06-12T19:07:33,697           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,699           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,699           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-06-12T19:07:33,700           to the `packages` configuration field.

2024-06-12T19:07:33,701           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,701           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,701           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,702           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,703           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,704           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-06-12T19:07:33,704           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-06-12T19:07:33,705           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,705           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,706           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,707           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,707           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,709           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,709                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,710                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,711                 directory, all directories are treated like packages.
2024-06-12T19:07:33,711           ********************************************************************************

2024-06-12T19:07:33,712   !!
2024-06-12T19:07:33,712     check.warn(importable)
2024-06-12T19:07:33,713   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-06-12T19:07:33,713   !!

2024-06-12T19:07:33,714           ********************************************************************************
2024-06-12T19:07:33,715           ############################
2024-06-12T19:07:33,715           # Package would be ignored #
2024-06-12T19:07:33,716           ############################
2024-06-12T19:07:33,716           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-06-12T19:07:33,717           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,718           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,719           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-06-12T19:07:33,719           to the `packages` configuration field.

2024-06-12T19:07:33,720           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,721           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,721           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,722           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,723           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,725           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-06-12T19:07:33,725           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-06-12T19:07:33,726           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,727           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,727           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,729           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,730           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,731           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,732                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,732                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,733                 directory, all directories are treated like packages.
2024-06-12T19:07:33,733           ********************************************************************************

2024-06-12T19:07:33,734   !!
2024-06-12T19:07:33,735     check.warn(importable)
2024-06-12T19:07:33,735   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-06-12T19:07:33,736   !!

2024-06-12T19:07:33,737           ********************************************************************************
2024-06-12T19:07:33,737           ############################
2024-06-12T19:07:33,738           # Package would be ignored #
2024-06-12T19:07:33,739           ############################
2024-06-12T19:07:33,740           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-06-12T19:07:33,740           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,741           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,741           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-06-12T19:07:33,742           to the `packages` configuration field.

2024-06-12T19:07:33,743           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,743           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,744           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,745           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,746           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,747           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-06-12T19:07:33,747           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-06-12T19:07:33,748           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,749           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,750           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,751           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,753           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,755           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,755                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,756                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,756                 directory, all directories are treated like packages.
2024-06-12T19:07:33,757           ********************************************************************************

2024-06-12T19:07:33,758   !!
2024-06-12T19:07:33,759     check.warn(importable)
2024-06-12T19:07:33,759   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-06-12T19:07:33,760   !!

2024-06-12T19:07:33,761           ********************************************************************************
2024-06-12T19:07:33,762           ############################
2024-06-12T19:07:33,762           # Package would be ignored #
2024-06-12T19:07:33,763           ############################
2024-06-12T19:07:33,763           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-06-12T19:07:33,764           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,764           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,765           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-06-12T19:07:33,765           to the `packages` configuration field.

2024-06-12T19:07:33,766           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,766           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,767           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,768           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,769           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,770           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-06-12T19:07:33,770           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-06-12T19:07:33,771           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,771           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,772           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,773           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,774           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,775           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,776                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,776                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,777                 directory, all directories are treated like packages.
2024-06-12T19:07:33,777           ********************************************************************************

2024-06-12T19:07:33,778   !!
2024-06-12T19:07:33,779     check.warn(importable)
2024-06-12T19:07:33,779   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-06-12T19:07:33,780   !!

2024-06-12T19:07:33,781           ********************************************************************************
2024-06-12T19:07:33,781           ############################
2024-06-12T19:07:33,782           # Package would be ignored #
2024-06-12T19:07:33,782           ############################
2024-06-12T19:07:33,783           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-06-12T19:07:33,784           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,784           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,785           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-06-12T19:07:33,785           to the `packages` configuration field.

2024-06-12T19:07:33,786           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,787           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,792           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,793           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,794           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,795           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-06-12T19:07:33,795           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-06-12T19:07:33,796           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,796           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,797           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,798           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,798           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,800           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,800                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,801                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,801                 directory, all directories are treated like packages.
2024-06-12T19:07:33,802           ********************************************************************************

2024-06-12T19:07:33,803   !!
2024-06-12T19:07:33,803     check.warn(importable)
2024-06-12T19:07:33,803   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-06-12T19:07:33,804   !!

2024-06-12T19:07:33,805           ********************************************************************************
2024-06-12T19:07:33,805           ############################
2024-06-12T19:07:33,806           # Package would be ignored #
2024-06-12T19:07:33,806           ############################
2024-06-12T19:07:33,807           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-06-12T19:07:33,807           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,808           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,809           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-06-12T19:07:33,809           to the `packages` configuration field.

2024-06-12T19:07:33,810           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,811           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,811           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,812           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,813           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,814           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-06-12T19:07:33,815           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-06-12T19:07:33,815           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,816           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,817           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,818           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,819           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,820           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,820                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,821                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,821                 directory, all directories are treated like packages.
2024-06-12T19:07:33,822           ********************************************************************************

2024-06-12T19:07:33,823   !!
2024-06-12T19:07:33,824     check.warn(importable)
2024-06-12T19:07:33,824   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-06-12T19:07:33,825   !!

2024-06-12T19:07:33,825           ********************************************************************************
2024-06-12T19:07:33,826           ############################
2024-06-12T19:07:33,826           # Package would be ignored #
2024-06-12T19:07:33,827           ############################
2024-06-12T19:07:33,827           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-06-12T19:07:33,827           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,828           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,829           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-06-12T19:07:33,829           to the `packages` configuration field.

2024-06-12T19:07:33,830           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,831           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,831           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,832           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,833           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,834           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-06-12T19:07:33,834           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-06-12T19:07:33,835           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,835           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,836           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,837           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,838           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,839           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,840                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,840                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,841                 directory, all directories are treated like packages.
2024-06-12T19:07:33,841           ********************************************************************************

2024-06-12T19:07:33,842   !!
2024-06-12T19:07:33,843     check.warn(importable)
2024-06-12T19:07:33,843   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-06-12T19:07:33,843   !!

2024-06-12T19:07:33,844           ********************************************************************************
2024-06-12T19:07:33,845           ############################
2024-06-12T19:07:33,846           # Package would be ignored #
2024-06-12T19:07:33,846           ############################
2024-06-12T19:07:33,847           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-06-12T19:07:33,847           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,848           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,849           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-06-12T19:07:33,849           to the `packages` configuration field.

2024-06-12T19:07:33,850           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,851           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,851           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,852           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,852           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,853           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-06-12T19:07:33,854           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-06-12T19:07:33,854           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,854           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,855           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,856           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,857           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,858           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,858                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,859                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,859                 directory, all directories are treated like packages.
2024-06-12T19:07:33,860           ********************************************************************************

2024-06-12T19:07:33,861   !!
2024-06-12T19:07:33,861     check.warn(importable)
2024-06-12T19:07:33,862   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-06-12T19:07:33,862   !!

2024-06-12T19:07:33,863           ********************************************************************************
2024-06-12T19:07:33,864           ############################
2024-06-12T19:07:33,864           # Package would be ignored #
2024-06-12T19:07:33,865           ############################
2024-06-12T19:07:33,865           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-06-12T19:07:33,866           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,867           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,867           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-06-12T19:07:33,868           to the `packages` configuration field.

2024-06-12T19:07:33,869           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,870           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,870           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,871           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,872           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,873           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-06-12T19:07:33,873           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-06-12T19:07:33,874           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,875           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,875           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,876           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,877           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,878           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,879                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,879                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,880                 directory, all directories are treated like packages.
2024-06-12T19:07:33,880           ********************************************************************************

2024-06-12T19:07:33,881   !!
2024-06-12T19:07:33,881     check.warn(importable)
2024-06-12T19:07:33,882   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-06-12T19:07:33,882   !!

2024-06-12T19:07:33,883           ********************************************************************************
2024-06-12T19:07:33,883           ############################
2024-06-12T19:07:33,884           # Package would be ignored #
2024-06-12T19:07:33,884           ############################
2024-06-12T19:07:33,885           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-06-12T19:07:33,885           but it is absent from setuptools' `packages` configuration.

2024-06-12T19:07:33,886           This leads to an ambiguous overall configuration. If you want to distribute this
2024-06-12T19:07:33,887           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-06-12T19:07:33,887           to the `packages` configuration field.

2024-06-12T19:07:33,888           Alternatively, you can also rely on setuptools' discovery methods
2024-06-12T19:07:33,889           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-06-12T19:07:33,889           instead of `find_packages(...)`/`find:`).

2024-06-12T19:07:33,890           You can read more about "package discovery" on setuptools documentation page:

2024-06-12T19:07:33,891           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-06-12T19:07:33,892           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-06-12T19:07:33,893           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-06-12T19:07:33,893           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-06-12T19:07:33,893           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-06-12T19:07:33,894           combination with a more fine grained `package-data` configuration.

2024-06-12T19:07:33,895           You can read more about "package data files" on setuptools documentation page:

2024-06-12T19:07:33,896           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-06-12T19:07:33,898           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-06-12T19:07:33,898                 even if it does not contain any `.py` files.
2024-06-12T19:07:33,899                 On the other hand, currently there is no concept of package data
2024-06-12T19:07:33,899                 directory, all directories are treated like packages.
2024-06-12T19:07:33,900           ********************************************************************************

2024-06-12T19:07:33,901   !!
2024-06-12T19:07:33,901     check.warn(importable)
2024-06-12T19:07:33,902   creating build/lib/deepspeed/autotuning/config_templates
2024-06-12T19:07:33,902   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-06-12T19:07:33,903   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-06-12T19:07:33,904   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-06-12T19:07:33,904   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-06-12T19:07:33,905   creating build/lib/deepspeed/ops/csrc
2024-06-12T19:07:33,905   creating build/lib/deepspeed/ops/csrc/adagrad
2024-06-12T19:07:33,905   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-06-12T19:07:33,906   creating build/lib/deepspeed/ops/csrc/adam
2024-06-12T19:07:33,906   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-06-12T19:07:33,907   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-06-12T19:07:33,907   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-06-12T19:07:33,908   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-06-12T19:07:33,908   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-06-12T19:07:33,909   creating build/lib/deepspeed/ops/csrc/aio
2024-06-12T19:07:33,909   creating build/lib/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:33,909   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:33,910   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:33,910   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:33,911   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:33,911   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:33,911   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:33,912   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,913   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,913   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,913   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,914   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,914   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,915   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,915   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,916   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,916   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,917   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,917   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:33,918   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-06-12T19:07:33,918   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-06-12T19:07:33,919   creating build/lib/deepspeed/ops/csrc/cpu
2024-06-12T19:07:33,919   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-06-12T19:07:33,920   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-06-12T19:07:33,920   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-06-12T19:07:33,921   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-06-12T19:07:33,921   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-06-12T19:07:33,922   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-06-12T19:07:33,922   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-06-12T19:07:33,923   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-06-12T19:07:33,923   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-06-12T19:07:33,923   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-06-12T19:07:33,924   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:33,924   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:33,925   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:33,925   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:33,925   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:33,926   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:33,926   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:33,927   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-12T19:07:33,927   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-12T19:07:33,928   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-12T19:07:33,928   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-12T19:07:33,929   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-12T19:07:33,929   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:33,930   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:33,930   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:33,931   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:33,931   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:33,932   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:33,932   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:33,933   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:33,933   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:33,934   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:33,934   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:33,935   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:33,935   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:33,936   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:33,936   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:33,937   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:33,937   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-12T19:07:33,937   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-12T19:07:33,938   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-12T19:07:33,938   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-06-12T19:07:33,939   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-06-12T19:07:33,939   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-06-12T19:07:33,940   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-12T19:07:33,940   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-12T19:07:33,941   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-12T19:07:33,941   creating build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,942   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,942   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,943   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,943   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,944   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,944   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,945   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,945   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,945   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,946   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,947   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,947   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,948   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,948   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,949   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,949   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,950   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,950   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,950   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,951   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,951   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,952   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,952   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,952   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,953   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,953   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,954   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,954   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,955   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-06-12T19:07:33,955   creating build/lib/deepspeed/ops/csrc/lamb
2024-06-12T19:07:33,956   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-06-12T19:07:33,956   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-06-12T19:07:33,957   creating build/lib/deepspeed/ops/csrc/lion
2024-06-12T19:07:33,957   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-06-12T19:07:33,958   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-06-12T19:07:33,959   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-06-12T19:07:33,959   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-06-12T19:07:33,960   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-06-12T19:07:33,960   creating build/lib/deepspeed/ops/csrc/quantization
2024-06-12T19:07:33,961   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-12T19:07:33,961   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-12T19:07:33,962   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-06-12T19:07:33,963   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-12T19:07:33,966   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-12T19:07:33,968   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-12T19:07:33,971   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-06-12T19:07:33,973   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-06-12T19:07:33,974   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-06-12T19:07:33,977   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-06-12T19:07:33,980   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-06-12T19:07:33,982   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-06-12T19:07:33,984   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-06-12T19:07:33,985   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-06-12T19:07:33,987   creating build/lib/deepspeed/ops/csrc/spatial
2024-06-12T19:07:33,988   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-06-12T19:07:33,989   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-06-12T19:07:33,991   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-06-12T19:07:33,993   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-06-12T19:07:33,994   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-06-12T19:07:33,996   creating build/lib/deepspeed/ops/csrc/transformer
2024-06-12T19:07:33,996   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-12T19:07:33,999   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,002   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,005   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,008   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,010   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,014   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,017   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,020   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-06-12T19:07:34,021   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,022   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,024   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,027   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,030   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,033   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,035   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,040   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,043   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,045   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,049   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,052   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-06-12T19:07:34,053   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-06-12T19:07:34,055   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-06-12T19:07:34,058   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-06-12T19:07:34,061   creating build/lib/deepspeed/ops/csrc/utils
2024-06-12T19:07:34,062   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-06-12T19:07:34,064   creating build/lib/deepspeed/ops/csrc/xpu
2024-06-12T19:07:34,064   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-06-12T19:07:34,065   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-06-12T19:07:34,068   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,069   copying deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,072   copying deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,076   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,078   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,082   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,085   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-06-12T19:07:34,086   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-06-12T19:07:34,089   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,090   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,093   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,095   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,098   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,100   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,103   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-06-12T19:07:34,104   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-06-12T19:07:34,107   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-06-12T19:07:34,110   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-06-12T19:07:34,112   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-06-12T19:07:34,114   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:34,115   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:34,118   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:34,121   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:34,123   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:34,126   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:34,129   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-06-12T19:07:34,131   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-06-12T19:07:34,133   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-06-12T19:07:34,135   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-06-12T19:07:34,136   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-06-12T19:07:34,139   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-06-12T19:07:34,141   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-06-12T19:07:34,144   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-06-12T19:07:34,145   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-06-12T19:07:34,147   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-12T19:07:34,148   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-12T19:07:34,151   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-12T19:07:34,153   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-12T19:07:34,155   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-12T19:07:34,158   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-06-12T19:07:34,159   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-06-12T19:07:34,161   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-12T19:07:34,164   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-12T19:07:34,167   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:34,170   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:34,173   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:34,176   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:34,179   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:34,181   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:34,184   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:34,186   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:34,187   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:34,191   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:34,194   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:34,196   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:34,199   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:34,201   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:34,204   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:34,207   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:34,209   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:34,212   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:34,214   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:34,216   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:34,219   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:34,221   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:34,223   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:34,226   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:34,229   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:34,231   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:34,234   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:34,237   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:34,240   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:34,242   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:34,245   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:34,248   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:34,250   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:34,253   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:34,256   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:34,258   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:34,260   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:34,262   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:34,265   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:34,267   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:34,270   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:34,272   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:34,274   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-12T19:07:34,277   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-12T19:07:34,279   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:34,282   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:34,284   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:34,286   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:34,288   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:34,291   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:34,293   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:34,296   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:34,299   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:34,301   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:34,303   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:34,306   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:34,309   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:34,311   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:34,314   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:34,316   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:34,318   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:34,321   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:34,371   running build_scripts
2024-06-12T19:07:34,372   creating build/scripts-3.11
2024-06-12T19:07:34,373   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-06-12T19:07:34,375   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-06-12T19:07:34,377   copying and adjusting bin/ds -> build/scripts-3.11
2024-06-12T19:07:34,379   copying bin/ds_ssh -> build/scripts-3.11
2024-06-12T19:07:34,381   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-06-12T19:07:34,383   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-06-12T19:07:34,384   copying and adjusting bin/dsr -> build/scripts-3.11
2024-06-12T19:07:34,386   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-06-12T19:07:34,387   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-06-12T19:07:34,388   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-06-12T19:07:34,389   changing mode of build/scripts-3.11/ds from 644 to 755
2024-06-12T19:07:34,390   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-06-12T19:07:34,390   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-06-12T19:07:34,391   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-06-12T19:07:34,392   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-06-12T19:07:34,419   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-06-12T19:07:34,419   !!

2024-06-12T19:07:34,421           ********************************************************************************
2024-06-12T19:07:34,421           Please avoid running ``setup.py`` directly.
2024-06-12T19:07:34,422           Instead, use pypa/build, pypa/installer or other
2024-06-12T19:07:34,422           standards-based tools.

2024-06-12T19:07:34,424           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-06-12T19:07:34,424           ********************************************************************************

2024-06-12T19:07:34,425   !!
2024-06-12T19:07:34,426     self.initialize_options()
2024-06-12T19:07:34,450   installing to build/bdist.linux-armv7l/wheel
2024-06-12T19:07:34,451   running install
2024-06-12T19:07:34,476   running install_lib
2024-06-12T19:07:34,503   creating build/bdist.linux-armv7l
2024-06-12T19:07:34,504   creating build/bdist.linux-armv7l/wheel
2024-06-12T19:07:34,506   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-06-12T19:07:34,508   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,510   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,512   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,515   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,518   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,520   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,522   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,524   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,527   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,530   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,532   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-06-12T19:07:34,535   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,536   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,538   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,541   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,543   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,546   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,548   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,550   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,553   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,555   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,557   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,559   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,562   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,564   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,567   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,569   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,572   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,574   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,577   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-06-12T19:07:34,580   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-06-12T19:07:34,582   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-06-12T19:07:34,584   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-06-12T19:07:34,586   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-06-12T19:07:34,588   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-06-12T19:07:34,590   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-06-12T19:07:34,593   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-06-12T19:07:34,597   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-12T19:07:34,598   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-12T19:07:34,600   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-12T19:07:34,603   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-12T19:07:34,605   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-12T19:07:34,607   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-12T19:07:34,610   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-06-12T19:07:34,613   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-12T19:07:34,614   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-06-12T19:07:34,616   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-06-12T19:07:34,618   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-06-12T19:07:34,620   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-06-12T19:07:34,623   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-06-12T19:07:34,625   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-12T19:07:34,627   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-12T19:07:34,631   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-12T19:07:34,633   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-12T19:07:34,637   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-12T19:07:34,640   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-06-12T19:07:34,643   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-12T19:07:34,644   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-12T19:07:34,646   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-12T19:07:34,649   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-12T19:07:34,651   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-12T19:07:34,653   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-12T19:07:34,656   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-06-12T19:07:34,659   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-06-12T19:07:34,661   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-06-12T19:07:34,662   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-06-12T19:07:34,665   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-06-12T19:07:34,668   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-06-12T19:07:34,670   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-06-12T19:07:34,671   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-06-12T19:07:34,673   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-06-12T19:07:34,677   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,678   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,682   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,686   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,689   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-06-12T19:07:34,691   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,692   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,696   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,699   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,702   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,705   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,709   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,711   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,714   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,717   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,720   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-06-12T19:07:34,725   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-06-12T19:07:34,727   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-06-12T19:07:34,730   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-06-12T19:07:34,733   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-06-12T19:07:34,736   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,740   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,744   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,746   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,749   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-06-12T19:07:34,753   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-06-12T19:07:34,753   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-06-12T19:07:34,756   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-06-12T19:07:34,757   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-12T19:07:34,758   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-12T19:07:34,761   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-06-12T19:07:34,763   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-06-12T19:07:34,765   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-06-12T19:07:34,769   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,770   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,772   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,776   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,778   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,780   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,782   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,785   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,787   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,790   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,792   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,794   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,796   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,798   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,800   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,802   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,804   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,806   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,808   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,810   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,812   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,814   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,816   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,818   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,820   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,823   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,825   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,826   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,829   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,830   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-06-12T19:07:34,832   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-06-12T19:07:34,834   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:34,835   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-12T19:07:34,836   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-12T19:07:34,839   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-06-12T19:07:34,841   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:34,843   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:34,846   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:34,848   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:34,849   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:34,853   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:34,855   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:34,858   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:34,860   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:34,863   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:34,865   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-06-12T19:07:34,869   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:34,870   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:34,874   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:34,876   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:34,878   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:34,880   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:34,883   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:34,886   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-06-12T19:07:34,888   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:34,892   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:34,894   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-06-12T19:07:34,898   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-12T19:07:34,899   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-12T19:07:34,902   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-12T19:07:34,904   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-12T19:07:34,907   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-06-12T19:07:34,910   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-06-12T19:07:34,911   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-06-12T19:07:34,912   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-06-12T19:07:34,914   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-06-12T19:07:34,917   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-06-12T19:07:34,918   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-06-12T19:07:34,920   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-06-12T19:07:34,921   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-06-12T19:07:34,922   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-06-12T19:07:34,924   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,925   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,927   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,929   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,932   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,934   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-06-12T19:07:34,936   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,937   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,940   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,942   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,944   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,946   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-06-12T19:07:34,948   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-06-12T19:07:34,949   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-06-12T19:07:34,952   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-06-12T19:07:34,953   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-06-12T19:07:34,956   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-12T19:07:34,956   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-12T19:07:34,959   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-12T19:07:34,961   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-12T19:07:34,963   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-12T19:07:34,966   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-12T19:07:34,969   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-12T19:07:34,970   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-06-12T19:07:34,973   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-06-12T19:07:34,974   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-06-12T19:07:34,975   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-06-12T19:07:34,977   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,978   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,980   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,982   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,984   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,985   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,987   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,989   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,991   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,993   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,995   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,997   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-06-12T19:07:34,999   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:35,000   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:35,003   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:35,005   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:35,006   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:35,009   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:35,011   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-06-12T19:07:35,014   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-06-12T19:07:35,015   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-06-12T19:07:35,017   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-12T19:07:35,018   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-12T19:07:35,021   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-12T19:07:35,023   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-12T19:07:35,025   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-12T19:07:35,027   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-06-12T19:07:35,029   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-06-12T19:07:35,030   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-06-12T19:07:35,031   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-06-12T19:07:35,034   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-06-12T19:07:35,034   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-06-12T19:07:35,037   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-06-12T19:07:35,038   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-06-12T19:07:35,040   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-06-12T19:07:35,043   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-06-12T19:07:35,044   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-06-12T19:07:35,047   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-12T19:07:35,048   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-12T19:07:35,049   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-12T19:07:35,051   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-12T19:07:35,053   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-12T19:07:35,056   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-06-12T19:07:35,058   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-06-12T19:07:35,059   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-06-12T19:07:35,062   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-06-12T19:07:35,063   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-06-12T19:07:35,066   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-06-12T19:07:35,068   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-06-12T19:07:35,071   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-06-12T19:07:35,074   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-06-12T19:07:35,076   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,077   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,081   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,083   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,086   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,087   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,089   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,093   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,095   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,099   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,102   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,104   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,108   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,111   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,114   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-06-12T19:07:35,117   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,120   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,122   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,126   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,127   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,129   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,132   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,134   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,137   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,139   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,141   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,144   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,146   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,148   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-06-12T19:07:35,151   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,154   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,156   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,158   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-06-12T19:07:35,160   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-06-12T19:07:35,162   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-06-12T19:07:35,166   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,167   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,171   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,173   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,176   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,178   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,180   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,182   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,185   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,188   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:35,189   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:35,192   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:35,194   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:35,196   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:35,199   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:35,201   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:35,203   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-06-12T19:07:35,205   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,208   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,210   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,213   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-12T19:07:35,214   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-12T19:07:35,217   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-12T19:07:35,219   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-12T19:07:35,221   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-12T19:07:35,223   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-12T19:07:35,225   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-12T19:07:35,228   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-12T19:07:35,231   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-12T19:07:35,233   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-06-12T19:07:35,235   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,237   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,239   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,241   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,244   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:35,245   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:35,247   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:35,249   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:35,251   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:35,253   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:35,255   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-06-12T19:07:35,258   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,260   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,262   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,264   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,266   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,268   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,270   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:35,271   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:35,273   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:35,275   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:35,276   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:35,278   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-06-12T19:07:35,280   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,281   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-06-12T19:07:35,284   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-06-12T19:07:35,285   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-06-12T19:07:35,287   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-06-12T19:07:35,290   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-06-12T19:07:35,291   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-06-12T19:07:35,293   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-06-12T19:07:35,295   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-06-12T19:07:35,296   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-06-12T19:07:35,298   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-06-12T19:07:35,300   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-12T19:07:35,301   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-12T19:07:35,304   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-12T19:07:35,306   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-12T19:07:35,309   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-12T19:07:35,312   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-12T19:07:35,313   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-12T19:07:35,316   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-06-12T19:07:35,317   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-06-12T19:07:35,319   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-06-12T19:07:35,322   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-06-12T19:07:35,324   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-06-12T19:07:35,326   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-06-12T19:07:35,329   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-06-12T19:07:35,330   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-06-12T19:07:35,332   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-06-12T19:07:35,334   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-06-12T19:07:35,336   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-06-12T19:07:35,338   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-06-12T19:07:35,339   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-06-12T19:07:35,341   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-06-12T19:07:35,343   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-06-12T19:07:35,345   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-06-12T19:07:35,347   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-06-12T19:07:35,348   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-06-12T19:07:35,350   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-06-12T19:07:35,353   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-06-12T19:07:35,354   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-06-12T19:07:35,356   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-06-12T19:07:35,358   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-06-12T19:07:35,359   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-06-12T19:07:35,361   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-06-12T19:07:35,363   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-12T19:07:35,365   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-12T19:07:35,367   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-12T19:07:35,368   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-12T19:07:35,370   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-12T19:07:35,372   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-12T19:07:35,374   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-12T19:07:35,376   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-12T19:07:35,378   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-12T19:07:35,380   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-12T19:07:35,382   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-06-12T19:07:35,384   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-12T19:07:35,385   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-12T19:07:35,388   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-12T19:07:35,390   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-12T19:07:35,392   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-12T19:07:35,395   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-12T19:07:35,397   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-12T19:07:35,400   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-12T19:07:35,401   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-06-12T19:07:35,404   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-06-12T19:07:35,405   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-06-12T19:07:35,408   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-06-12T19:07:35,411   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-12T19:07:35,412   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-12T19:07:35,414   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-12T19:07:35,416   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-12T19:07:35,418   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-12T19:07:35,420   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-06-12T19:07:35,422   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-06-12T19:07:35,424   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-12T19:07:35,426   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-06-12T19:07:35,427   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-06-12T19:07:35,429   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-06-12T19:07:35,431   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-06-12T19:07:35,433   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-06-12T19:07:35,434   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-12T19:07:35,437   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-06-12T19:07:35,439   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:35,440   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:35,442   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:35,444   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:35,447   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:35,449   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-06-12T19:07:35,452   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-06-12T19:07:35,453   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-12T19:07:35,454   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-12T19:07:35,456   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-12T19:07:35,458   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-12T19:07:35,460   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-06-12T19:07:35,462   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:35,463   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:35,465   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:35,467   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:35,469   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:35,471   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:35,472   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:35,474   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-06-12T19:07:35,475   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-06-12T19:07:35,477   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-06-12T19:07:35,479   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:35,480   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:35,482   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:35,483   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:35,486   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:35,488   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:35,490   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:35,493   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:35,495   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:35,497   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:35,499   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:35,501   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-06-12T19:07:35,502   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:35,504   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:35,507   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:35,509   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:35,511   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-06-12T19:07:35,513   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:35,514   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:35,516   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:35,518   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:35,521   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:35,522   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-06-12T19:07:35,525   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:35,526   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:35,528   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:35,530   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:35,532   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:35,534   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-06-12T19:07:35,536   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:35,537   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:35,539   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:35,541   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:35,542   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:35,544   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:35,546   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:35,548   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:35,550   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-06-12T19:07:35,552   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-06-12T19:07:35,554   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-06-12T19:07:35,556   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-06-12T19:07:35,557   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-06-12T19:07:35,559   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:35,560   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:35,563   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:35,565   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:35,567   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:35,569   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:35,571   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:35,572   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:35,574   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-06-12T19:07:35,577   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-06-12T19:07:35,578   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-06-12T19:07:35,580   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:35,581   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:35,583   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:35,585   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:35,587   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:35,588   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:35,590   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-06-12T19:07:35,593   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-12T19:07:35,594   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-12T19:07:35,595   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-12T19:07:35,597   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-06-12T19:07:35,599   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:35,600   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:35,602   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:35,604   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:35,606   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:35,609   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:35,611   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-06-12T19:07:35,613   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:35,614   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:35,616   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:35,618   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:35,619   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:35,621   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:35,623   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-06-12T19:07:35,625   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-06-12T19:07:35,627   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-12T19:07:35,628   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-12T19:07:35,630   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-12T19:07:35,632   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-12T19:07:35,633   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-06-12T19:07:35,636   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:35,636   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:35,638   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:35,640   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:35,642   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:35,644   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:35,646   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-06-12T19:07:35,649   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:35,649   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:35,651   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:35,653   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:35,655   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:35,657   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:35,659   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-06-12T19:07:35,661   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:35,662   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:35,664   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:35,666   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:35,668   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:35,669   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:35,672   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-06-12T19:07:35,674   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-12T19:07:35,675   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-06-12T19:07:35,676   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-06-12T19:07:35,678   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-12T19:07:35,681   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:35,681   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:35,684   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:35,686   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:35,687   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:35,689   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-06-12T19:07:35,692   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:35,692   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:35,694   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:35,696   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:35,698   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:35,700   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:35,702   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-06-12T19:07:35,704   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-06-12T19:07:35,705   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-12T19:07:35,707   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-12T19:07:35,709   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-12T19:07:35,711   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-12T19:07:35,713   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-12T19:07:35,715   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-12T19:07:35,716   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-06-12T19:07:35,717   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-06-12T19:07:35,719   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-06-12T19:07:35,721   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-12T19:07:35,724   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-12T19:07:35,726   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-06-12T19:07:35,727   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-06-12T19:07:35,729   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-12T19:07:35,732   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-12T19:07:35,734   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-12T19:07:35,736   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-12T19:07:35,739   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-06-12T19:07:35,740   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-12T19:07:35,743   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-06-12T19:07:35,744   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-06-12T19:07:35,746   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:35,747   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:35,749   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:35,751   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:35,753   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:35,754   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:35,756   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:35,758   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:35,760   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-06-12T19:07:35,762   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-06-12T19:07:35,763   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-06-12T19:07:35,764   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-06-12T19:07:35,766   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-06-12T19:07:35,769   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-12T19:07:35,770   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-12T19:07:35,772   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-06-12T19:07:35,775   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-12T19:07:35,776   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-12T19:07:35,778   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-12T19:07:35,780   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-06-12T19:07:35,782   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-06-12T19:07:35,783   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-06-12T19:07:35,785   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-06-12T19:07:35,786   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-06-12T19:07:35,788   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-06-12T19:07:35,789   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-06-12T19:07:35,792   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-06-12T19:07:35,794   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-06-12T19:07:35,794   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-06-12T19:07:35,797   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-06-12T19:07:35,799   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-06-12T19:07:35,801   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-06-12T19:07:35,802   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-06-12T19:07:35,804   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-06-12T19:07:35,806   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-06-12T19:07:35,808   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-06-12T19:07:35,810   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-06-12T19:07:35,812   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:35,813   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:35,815   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:35,817   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:35,819   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:35,820   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:35,822   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:35,824   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-06-12T19:07:35,827   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:35,828   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-06-12T19:07:35,829   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-06-12T19:07:35,831   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-06-12T19:07:35,833   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-06-12T19:07:35,835   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-06-12T19:07:35,837   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:35,838   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:35,840   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:35,842   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:35,844   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:35,846   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:35,848   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:35,850   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:35,852   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:35,853   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-06-12T19:07:35,856   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-12T19:07:35,857   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-12T19:07:35,859   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-12T19:07:35,861   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-12T19:07:35,863   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-06-12T19:07:35,865   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:35,867   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:35,870   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-06-12T19:07:35,871   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-06-12T19:07:35,873   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-06-12T19:07:35,874   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-06-12T19:07:35,876   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-06-12T19:07:35,878   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:35,880   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:35,883   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:35,884   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:35,886   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:35,888   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:35,890   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:35,892   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:35,894   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:35,896   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:35,897   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:35,899   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-06-12T19:07:35,901   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-06-12T19:07:35,902   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-06-12T19:07:35,904   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-06-12T19:07:35,906   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-06-12T19:07:35,909   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-06-12T19:07:35,911   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-06-12T19:07:35,912   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-06-12T19:07:35,914   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-06-12T19:07:35,916   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-06-12T19:07:35,917   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-06-12T19:07:35,919   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:35,922   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-06-12T19:07:35,922   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-06-12T19:07:35,924   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-06-12T19:07:35,926   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-06-12T19:07:35,928   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-06-12T19:07:35,930   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:35,932   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-06-12T19:07:35,935   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-12T19:07:35,936   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-12T19:07:35,938   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-12T19:07:35,940   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-12T19:07:35,942   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-06-12T19:07:35,945   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-06-12T19:07:35,946   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-06-12T19:07:35,948   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-06-12T19:07:35,949   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-06-12T19:07:35,952   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-06-12T19:07:35,953   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-12T19:07:35,955   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-06-12T19:07:35,958   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:35,959   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-12T19:07:35,960   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-12T19:07:35,962   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-12T19:07:35,964   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-12T19:07:35,966   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-12T19:07:35,968   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-12T19:07:35,970   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-12T19:07:35,972   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-12T19:07:35,974   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-12T19:07:35,977   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-06-12T19:07:35,979   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:35,982   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:35,984   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:35,986   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:35,989   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:35,990   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:35,993   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:35,994   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:35,997   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:35,999   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,001   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,004   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,008   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,010   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,012   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,016   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,019   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,023   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,026   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,028   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,030   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,032   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,035   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-06-12T19:07:36,036   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,043   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-06-12T19:07:36,044   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-06-12T19:07:36,046   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-06-12T19:07:36,048   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,051   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,054   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,056   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,060   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-06-12T19:07:36,061   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-06-12T19:07:36,064   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-06-12T19:07:36,066   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-06-12T19:07:36,069   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:36,071   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:36,075   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:36,078   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:36,081   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:36,084   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-06-12T19:07:36,086   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-06-12T19:07:36,089   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:36,090   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:36,092   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:36,095   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:36,101   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:36,105   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-06-12T19:07:36,110   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-06-12T19:07:36,113   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-06-12T19:07:36,114   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-06-12T19:07:36,118   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-06-12T19:07:36,124   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-06-12T19:07:36,126   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-06-12T19:07:36,129   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-06-12T19:07:36,132   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-06-12T19:07:36,135   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-06-12T19:07:36,137   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-06-12T19:07:36,141   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-12T19:07:36,143   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-12T19:07:36,146   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-12T19:07:36,149   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-12T19:07:36,152   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-12T19:07:36,157   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-12T19:07:36,159   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-06-12T19:07:36,162   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,164   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,166   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,169   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,172   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,175   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,178   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-06-12T19:07:36,179   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-06-12T19:07:36,182   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-06-12T19:07:36,184   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-06-12T19:07:36,186   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-06-12T19:07:36,189   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-12T19:07:36,190   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-12T19:07:36,193   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-12T19:07:36,195   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-12T19:07:36,197   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-12T19:07:36,200   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-12T19:07:36,203   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-06-12T19:07:36,206   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-06-12T19:07:36,207   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-06-12T19:07:36,210   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-06-12T19:07:36,213   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-06-12T19:07:36,216   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-06-12T19:07:36,218   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-06-12T19:07:36,220   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-06-12T19:07:36,222   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-12T19:07:36,223   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-12T19:07:36,226   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-12T19:07:36,228   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-12T19:07:36,231   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-12T19:07:36,233   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-12T19:07:36,235   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-06-12T19:07:36,238   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-12T19:07:36,243   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-12T19:07:36,246   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-06-12T19:07:36,248   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-06-12T19:07:36,250   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-06-12T19:07:36,253   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-12T19:07:36,254   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-12T19:07:36,258   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-12T19:07:36,261   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-12T19:07:36,263   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-12T19:07:36,266   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-12T19:07:36,268   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-12T19:07:36,271   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-12T19:07:36,274   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-12T19:07:36,276   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-06-12T19:07:36,279   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-12T19:07:36,282   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-12T19:07:36,284   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-12T19:07:36,286   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-12T19:07:36,290   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-12T19:07:36,293   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-12T19:07:36,295   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-12T19:07:36,297   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-06-12T19:07:36,301   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-06-12T19:07:36,302   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-06-12T19:07:36,304   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-06-12T19:07:36,307   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-06-12T19:07:36,311   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-06-12T19:07:36,312   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-06-12T19:07:36,315   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-06-12T19:07:36,317   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-06-12T19:07:36,320   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-06-12T19:07:36,324   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,539   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,542   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,545   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,549   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,552   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,553   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,556   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,559   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,561   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,564   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,566   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,569   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,573   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-12T19:07:36,574   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-12T19:07:36,577   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-12T19:07:36,580   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-12T19:07:36,583   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-12T19:07:36,587   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-12T19:07:36,589   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-12T19:07:36,592   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-06-12T19:07:36,596   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,598   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,601   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,605   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,608   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,611   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,614   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,618   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,622   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,625   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,627   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,630   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-06-12T19:07:36,632   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,634   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,637   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,640   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,643   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,645   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,648   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,650   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,653   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-06-12T19:07:36,656   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-06-12T19:07:36,658   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-06-12T19:07:36,660   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-06-12T19:07:36,661   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-06-12T19:07:36,664   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-06-12T19:07:36,666   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-06-12T19:07:36,668   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,670   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,672   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,674   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,677   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,680   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,683   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,686   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,689   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,691   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,694   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-06-12T19:07:36,698   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-06-12T19:07:36,699   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-06-12T19:07:36,702   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-06-12T19:07:36,705   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-06-12T19:07:36,709   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-12T19:07:36,711   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-12T19:07:36,714   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-12T19:07:36,716   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-12T19:07:36,720   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-12T19:07:36,724   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-12T19:07:36,727   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-12T19:07:36,729   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-12T19:07:36,732   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-12T19:07:36,736   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-06-12T19:07:36,739   running install_egg_info
2024-06-12T19:07:36,785   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.14.3-py3.11.egg-info
2024-06-12T19:07:36,800   running install_scripts
2024-06-12T19:07:36,802   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data
2024-06-12T19:07:36,802   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts
2024-06-12T19:07:36,804   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts
2024-06-12T19:07:36,806   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts
2024-06-12T19:07:36,809   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts
2024-06-12T19:07:36,811   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts
2024-06-12T19:07:36,813   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts
2024-06-12T19:07:36,816   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts
2024-06-12T19:07:36,819   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts
2024-06-12T19:07:36,821   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts
2024-06-12T19:07:36,823   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts/deepspeed.pt to 755
2024-06-12T19:07:36,824   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts/deepspeed to 755
2024-06-12T19:07:36,824   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts/ds_ssh to 755
2024-06-12T19:07:36,825   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts/ds_elastic to 755
2024-06-12T19:07:36,826   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts/ds_bench to 755
2024-06-12T19:07:36,827   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts/ds_report to 755
2024-06-12T19:07:36,828   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts/ds to 755
2024-06-12T19:07:36,829   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.data/scripts/dsr to 755
2024-06-12T19:07:36,873   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.3.dist-info/WHEEL
2024-06-12T19:07:36,875   creating '/tmp/pip-wheel-e6p3tb96/deepspeed-0.14.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-06-12T19:07:36,878   adding 'deepspeed/__init__.py'
2024-06-12T19:07:36,880   adding 'deepspeed/constants.py'
2024-06-12T19:07:36,882   adding 'deepspeed/env_report.py'
2024-06-12T19:07:36,883   adding 'deepspeed/git_version_info.py'
2024-06-12T19:07:36,884   adding 'deepspeed/git_version_info_installed.py'
2024-06-12T19:07:36,885   adding 'deepspeed/pydantic_v1.py'
2024-06-12T19:07:36,887   adding 'deepspeed/accelerator/__init__.py'
2024-06-12T19:07:36,889   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-06-12T19:07:36,890   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-06-12T19:07:36,894   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-06-12T19:07:36,895   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-06-12T19:07:36,897   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-06-12T19:07:36,898   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-06-12T19:07:36,900   adding 'deepspeed/accelerator/real_accelerator.py'
2024-06-12T19:07:36,902   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-06-12T19:07:36,904   adding 'deepspeed/autotuning/__init__.py'
2024-06-12T19:07:36,909   adding 'deepspeed/autotuning/autotuner.py'
2024-06-12T19:07:36,911   adding 'deepspeed/autotuning/config.py'
2024-06-12T19:07:36,912   adding 'deepspeed/autotuning/constants.py'
2024-06-12T19:07:36,915   adding 'deepspeed/autotuning/scheduler.py'
2024-06-12T19:07:36,917   adding 'deepspeed/autotuning/utils.py'
2024-06-12T19:07:36,919   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-06-12T19:07:36,920   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-06-12T19:07:36,921   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-06-12T19:07:36,922   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-06-12T19:07:36,924   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-06-12T19:07:36,925   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-06-12T19:07:36,927   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-06-12T19:07:36,928   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-06-12T19:07:36,929   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-06-12T19:07:36,931   adding 'deepspeed/autotuning/tuner/utils.py'
2024-06-12T19:07:36,932   adding 'deepspeed/checkpoint/__init__.py'
2024-06-12T19:07:36,934   adding 'deepspeed/checkpoint/constants.py'
2024-06-12T19:07:36,936   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-06-12T19:07:36,938   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-06-12T19:07:36,940   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-06-12T19:07:36,942   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-06-12T19:07:36,943   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-06-12T19:07:36,945   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-06-12T19:07:36,946   adding 'deepspeed/checkpoint/utils.py'
2024-06-12T19:07:36,948   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-06-12T19:07:36,949   adding 'deepspeed/comm/__init__.py'
2024-06-12T19:07:36,951   adding 'deepspeed/comm/backend.py'
2024-06-12T19:07:36,952   adding 'deepspeed/comm/ccl.py'
2024-06-12T19:07:36,956   adding 'deepspeed/comm/comm.py'
2024-06-12T19:07:36,958   adding 'deepspeed/comm/config.py'
2024-06-12T19:07:36,959   adding 'deepspeed/comm/constants.py'
2024-06-12T19:07:36,960   adding 'deepspeed/comm/reduce_op.py'
2024-06-12T19:07:36,962   adding 'deepspeed/comm/torch.py'
2024-06-12T19:07:36,964   adding 'deepspeed/comm/utils.py'
2024-06-12T19:07:36,965   adding 'deepspeed/compression/__init__.py'
2024-06-12T19:07:36,968   adding 'deepspeed/compression/basic_layer.py'
2024-06-12T19:07:36,971   adding 'deepspeed/compression/compress.py'
2024-06-12T19:07:36,973   adding 'deepspeed/compression/config.py'
2024-06-12T19:07:36,974   adding 'deepspeed/compression/constants.py'
2024-06-12T19:07:36,976   adding 'deepspeed/compression/helper.py'
2024-06-12T19:07:36,977   adding 'deepspeed/compression/scheduler.py'
2024-06-12T19:07:36,979   adding 'deepspeed/compression/utils.py'
2024-06-12T19:07:36,980   adding 'deepspeed/elasticity/__init__.py'
2024-06-12T19:07:36,982   adding 'deepspeed/elasticity/config.py'
2024-06-12T19:07:36,983   adding 'deepspeed/elasticity/constants.py'
2024-06-12T19:07:36,984   adding 'deepspeed/elasticity/elastic_agent.py'
2024-06-12T19:07:36,987   adding 'deepspeed/elasticity/elasticity.py'
2024-06-12T19:07:36,988   adding 'deepspeed/elasticity/utils.py'
2024-06-12T19:07:36,990   adding 'deepspeed/inference/__init__.py'
2024-06-12T19:07:36,991   adding 'deepspeed/inference/config.py'
2024-06-12T19:07:36,995   adding 'deepspeed/inference/engine.py'
2024-06-12T19:07:36,997   adding 'deepspeed/inference/quantization/__init__.py'
2024-06-12T19:07:36,998   adding 'deepspeed/inference/quantization/layers.py'
2024-06-12T19:07:36,999   adding 'deepspeed/inference/quantization/quantization.py'
2024-06-12T19:07:37,000   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-06-12T19:07:37,002   adding 'deepspeed/inference/quantization/utils.py'
2024-06-12T19:07:37,004   adding 'deepspeed/inference/v2/__init__.py'
2024-06-12T19:07:37,006   adding 'deepspeed/inference/v2/allocator.py'
2024-06-12T19:07:37,007   adding 'deepspeed/inference/v2/config_v2.py'
2024-06-12T19:07:37,008   adding 'deepspeed/inference/v2/engine_factory.py'
2024-06-12T19:07:37,010   adding 'deepspeed/inference/v2/engine_v2.py'
2024-06-12T19:07:37,011   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-06-12T19:07:37,013   adding 'deepspeed/inference/v2/inference_utils.py'
2024-06-12T19:07:37,014   adding 'deepspeed/inference/v2/logging.py'
2024-06-12T19:07:37,015   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-06-12T19:07:37,017   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-06-12T19:07:37,018   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-06-12T19:07:37,020   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-06-12T19:07:37,021   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-06-12T19:07:37,023   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-06-12T19:07:37,024   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-06-12T19:07:37,026   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-06-12T19:07:37,027   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-06-12T19:07:37,029   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-06-12T19:07:37,030   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-06-12T19:07:37,031   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-06-12T19:07:37,033   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-06-12T19:07:37,034   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-06-12T19:07:37,036   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-06-12T19:07:37,037   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-06-12T19:07:37,039   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-06-12T19:07:37,040   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-06-12T19:07:37,042   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-06-12T19:07:37,043   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-06-12T19:07:37,045   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-06-12T19:07:37,046   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-06-12T19:07:37,047   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-06-12T19:07:37,048   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-06-12T19:07:37,049   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-06-12T19:07:37,051   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-06-12T19:07:37,053   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-06-12T19:07:37,055   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-06-12T19:07:37,057   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-06-12T19:07:37,058   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-06-12T19:07:37,060   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-06-12T19:07:37,061   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-06-12T19:07:37,063   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-06-12T19:07:37,065   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-06-12T19:07:37,066   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-06-12T19:07:37,067   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-06-12T19:07:37,069   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-06-12T19:07:37,070   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-06-12T19:07:37,072   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-06-12T19:07:37,073   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-06-12T19:07:37,075   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-06-12T19:07:37,077   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-06-12T19:07:37,078   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-06-12T19:07:37,080   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-06-12T19:07:37,081   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-06-12T19:07:37,082   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-06-12T19:07:37,084   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-06-12T19:07:37,085   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-06-12T19:07:37,087   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-06-12T19:07:37,088   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-06-12T19:07:37,090   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-06-12T19:07:37,091   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-06-12T19:07:37,092   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-06-12T19:07:37,094   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-06-12T19:07:37,095   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-06-12T19:07:37,097   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-06-12T19:07:37,098   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-06-12T19:07:37,099   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-06-12T19:07:37,101   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-06-12T19:07:37,102   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-06-12T19:07:37,104   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-06-12T19:07:37,105   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-06-12T19:07:37,107   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-06-12T19:07:37,108   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-06-12T19:07:37,109   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-06-12T19:07:37,110   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-06-12T19:07:37,112   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-06-12T19:07:37,114   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-06-12T19:07:37,115   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-06-12T19:07:37,116   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-06-12T19:07:37,119   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-06-12T19:07:37,122   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-06-12T19:07:37,124   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-06-12T19:07:37,125   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-06-12T19:07:37,127   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-06-12T19:07:37,128   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-06-12T19:07:37,129   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-06-12T19:07:37,131   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-06-12T19:07:37,133   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-06-12T19:07:37,134   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-06-12T19:07:37,135   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-06-12T19:07:37,136   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-06-12T19:07:37,138   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-06-12T19:07:37,139   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-06-12T19:07:37,141   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-06-12T19:07:37,142   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-06-12T19:07:37,143   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-06-12T19:07:37,144   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-06-12T19:07:37,146   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-06-12T19:07:37,147   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-06-12T19:07:37,149   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-06-12T19:07:37,151   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-06-12T19:07:37,152   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-06-12T19:07:37,154   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-06-12T19:07:37,155   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-06-12T19:07:37,156   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-06-12T19:07:37,158   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-06-12T19:07:37,160   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-06-12T19:07:37,161   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-06-12T19:07:37,163   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-06-12T19:07:37,164   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-06-12T19:07:37,165   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-06-12T19:07:37,166   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-06-12T19:07:37,168   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-06-12T19:07:37,169   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-06-12T19:07:37,171   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-06-12T19:07:37,172   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-06-12T19:07:37,173   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-06-12T19:07:37,174   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-06-12T19:07:37,176   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-06-12T19:07:37,177   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-06-12T19:07:37,179   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-06-12T19:07:37,180   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-06-12T19:07:37,181   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-06-12T19:07:37,182   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-06-12T19:07:37,184   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-06-12T19:07:37,185   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-06-12T19:07:37,187   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-06-12T19:07:37,188   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-06-12T19:07:37,190   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-06-12T19:07:37,191   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-06-12T19:07:37,193   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-06-12T19:07:37,194   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-06-12T19:07:37,195   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-06-12T19:07:37,196   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-06-12T19:07:37,198   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-06-12T19:07:37,200   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-06-12T19:07:37,202   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-06-12T19:07:37,204   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-06-12T19:07:37,206   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-06-12T19:07:37,208   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-06-12T19:07:37,211   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-06-12T19:07:37,213   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-06-12T19:07:37,215   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-06-12T19:07:37,216   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-06-12T19:07:37,217   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-06-12T19:07:37,219   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-06-12T19:07:37,220   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-06-12T19:07:37,221   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-06-12T19:07:37,223   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-06-12T19:07:37,224   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-06-12T19:07:37,225   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-06-12T19:07:37,227   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-06-12T19:07:37,228   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-06-12T19:07:37,230   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-06-12T19:07:37,231   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-06-12T19:07:37,233   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-06-12T19:07:37,234   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-06-12T19:07:37,236   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-06-12T19:07:37,237   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-06-12T19:07:37,238   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-06-12T19:07:37,240   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-06-12T19:07:37,241   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-06-12T19:07:37,242   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-06-12T19:07:37,244   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-06-12T19:07:37,245   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-06-12T19:07:37,247   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-06-12T19:07:37,248   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-06-12T19:07:37,250   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-06-12T19:07:37,251   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-06-12T19:07:37,253   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-06-12T19:07:37,254   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-06-12T19:07:37,256   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-06-12T19:07:37,257   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-06-12T19:07:37,259   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-06-12T19:07:37,260   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-06-12T19:07:37,262   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-06-12T19:07:37,263   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-06-12T19:07:37,265   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-06-12T19:07:37,266   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-06-12T19:07:37,268   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-06-12T19:07:37,269   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-06-12T19:07:37,271   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-06-12T19:07:37,272   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-06-12T19:07:37,274   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-06-12T19:07:37,275   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-06-12T19:07:37,277   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-06-12T19:07:37,278   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-06-12T19:07:37,279   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-06-12T19:07:37,281   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-06-12T19:07:37,282   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-06-12T19:07:37,283   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-06-12T19:07:37,285   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-06-12T19:07:37,286   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-06-12T19:07:37,287   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-06-12T19:07:37,289   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-06-12T19:07:37,290   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-06-12T19:07:37,292   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-06-12T19:07:37,293   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-06-12T19:07:37,295   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-06-12T19:07:37,296   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-06-12T19:07:37,297   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-06-12T19:07:37,298   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-06-12T19:07:37,300   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-06-12T19:07:37,302   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-06-12T19:07:37,303   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-06-12T19:07:37,305   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-06-12T19:07:37,307   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-06-12T19:07:37,308   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-06-12T19:07:37,310   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-06-12T19:07:37,311   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-06-12T19:07:37,313   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-06-12T19:07:37,315   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-06-12T19:07:37,317   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-06-12T19:07:37,318   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-06-12T19:07:37,320   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-06-12T19:07:37,321   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-06-12T19:07:37,323   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-06-12T19:07:37,324   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-06-12T19:07:37,326   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-06-12T19:07:37,328   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-06-12T19:07:37,329   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-06-12T19:07:37,331   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-06-12T19:07:37,332   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-06-12T19:07:37,333   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-06-12T19:07:37,335   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-06-12T19:07:37,338   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-06-12T19:07:37,339   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-06-12T19:07:37,341   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-06-12T19:07:37,343   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-06-12T19:07:37,344   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-06-12T19:07:37,346   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-06-12T19:07:37,347   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-06-12T19:07:37,349   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-06-12T19:07:37,351   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-06-12T19:07:37,353   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-06-12T19:07:37,354   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-06-12T19:07:37,355   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-06-12T19:07:37,357   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-06-12T19:07:37,359   adding 'deepspeed/launcher/__init__.py'
2024-06-12T19:07:37,360   adding 'deepspeed/launcher/constants.py'
2024-06-12T19:07:37,362   adding 'deepspeed/launcher/launch.py'
2024-06-12T19:07:37,364   adding 'deepspeed/launcher/launcher_helper.py'
2024-06-12T19:07:37,366   adding 'deepspeed/launcher/multinode_runner.py'
2024-06-12T19:07:37,369   adding 'deepspeed/launcher/runner.py'
2024-06-12T19:07:37,370   adding 'deepspeed/linear/__init__.py'
2024-06-12T19:07:37,371   adding 'deepspeed/linear/config.py'
2024-06-12T19:07:37,373   adding 'deepspeed/linear/optimized_linear.py'
2024-06-12T19:07:37,374   adding 'deepspeed/linear/quantization.py'
2024-06-12T19:07:37,376   adding 'deepspeed/model_implementations/__init__.py'
2024-06-12T19:07:37,378   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-06-12T19:07:37,379   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-06-12T19:07:37,381   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-06-12T19:07:37,382   adding 'deepspeed/model_implementations/features/__init__.py'
2024-06-12T19:07:37,383   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-06-12T19:07:37,385   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-06-12T19:07:37,386   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-06-12T19:07:37,388   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-06-12T19:07:37,389   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-06-12T19:07:37,390   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-06-12T19:07:37,391   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-06-12T19:07:37,393   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-06-12T19:07:37,394   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-06-12T19:07:37,395   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-06-12T19:07:37,397   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-06-12T19:07:37,399   adding 'deepspeed/module_inject/__init__.py'
2024-06-12T19:07:37,401   adding 'deepspeed/module_inject/auto_tp.py'
2024-06-12T19:07:37,403   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-06-12T19:07:37,405   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-06-12T19:07:37,406   adding 'deepspeed/module_inject/inject.py'
2024-06-12T19:07:37,408   adding 'deepspeed/module_inject/layers.py'
2024-06-12T19:07:37,409   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-06-12T19:07:37,411   adding 'deepspeed/module_inject/module_quantize.py'
2024-06-12T19:07:37,413   adding 'deepspeed/module_inject/policy.py'
2024-06-12T19:07:37,416   adding 'deepspeed/module_inject/replace_module.py'
2024-06-12T19:07:37,417   adding 'deepspeed/module_inject/replace_policy.py'
2024-06-12T19:07:37,419   adding 'deepspeed/module_inject/tp_shard.py'
2024-06-12T19:07:37,420   adding 'deepspeed/module_inject/utils.py'
2024-06-12T19:07:37,422   adding 'deepspeed/module_inject/containers/__init__.py'
2024-06-12T19:07:37,424   adding 'deepspeed/module_inject/containers/base.py'
2024-06-12T19:07:37,425   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-06-12T19:07:37,426   adding 'deepspeed/module_inject/containers/bert.py'
2024-06-12T19:07:37,428   adding 'deepspeed/module_inject/containers/bloom.py'
2024-06-12T19:07:37,429   adding 'deepspeed/module_inject/containers/clip.py'
2024-06-12T19:07:37,430   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-06-12T19:07:37,431   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-06-12T19:07:37,433   adding 'deepspeed/module_inject/containers/gptj.py'
2024-06-12T19:07:37,434   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-06-12T19:07:37,435   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-06-12T19:07:37,437   adding 'deepspeed/module_inject/containers/internlm.py'
2024-06-12T19:07:37,438   adding 'deepspeed/module_inject/containers/llama.py'
2024-06-12T19:07:37,440   adding 'deepspeed/module_inject/containers/llama2.py'
2024-06-12T19:07:37,441   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-06-12T19:07:37,443   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-06-12T19:07:37,444   adding 'deepspeed/module_inject/containers/opt.py'
2024-06-12T19:07:37,445   adding 'deepspeed/module_inject/containers/unet.py'
2024-06-12T19:07:37,447   adding 'deepspeed/module_inject/containers/vae.py'
2024-06-12T19:07:37,449   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-06-12T19:07:37,450   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-06-12T19:07:37,452   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-06-12T19:07:37,453   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-06-12T19:07:37,454   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-06-12T19:07:37,455   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-06-12T19:07:37,457   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-06-12T19:07:37,459   adding 'deepspeed/moe/__init__.py'
2024-06-12T19:07:37,460   adding 'deepspeed/moe/experts.py'
2024-06-12T19:07:37,462   adding 'deepspeed/moe/layer.py'
2024-06-12T19:07:37,463   adding 'deepspeed/moe/mappings.py'
2024-06-12T19:07:37,466   adding 'deepspeed/moe/sharded_moe.py'
2024-06-12T19:07:37,468   adding 'deepspeed/moe/utils.py'
2024-06-12T19:07:37,469   adding 'deepspeed/monitor/__init__.py'
2024-06-12T19:07:37,471   adding 'deepspeed/monitor/comet.py'
2024-06-12T19:07:37,472   adding 'deepspeed/monitor/config.py'
2024-06-12T19:07:37,474   adding 'deepspeed/monitor/csv_monitor.py'
2024-06-12T19:07:37,475   adding 'deepspeed/monitor/monitor.py'
2024-06-12T19:07:37,476   adding 'deepspeed/monitor/tensorboard.py'
2024-06-12T19:07:37,478   adding 'deepspeed/monitor/utils.py'
2024-06-12T19:07:37,479   adding 'deepspeed/monitor/wandb.py'
2024-06-12T19:07:37,481   adding 'deepspeed/nebula/__init__.py'
2024-06-12T19:07:37,482   adding 'deepspeed/nebula/config.py'
2024-06-12T19:07:37,483   adding 'deepspeed/nebula/constants.py'
2024-06-12T19:07:37,485   adding 'deepspeed/ops/__init__.py'
2024-06-12T19:07:37,487   adding 'deepspeed/ops/adagrad/__init__.py'
2024-06-12T19:07:37,488   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-06-12T19:07:37,490   adding 'deepspeed/ops/adam/__init__.py'
2024-06-12T19:07:37,492   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-06-12T19:07:37,494   adding 'deepspeed/ops/adam/fused_adam.py'
2024-06-12T19:07:37,495   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-06-12T19:07:37,497   adding 'deepspeed/ops/aio/__init__.py'
2024-06-12T19:07:37,499   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-06-12T19:07:37,501   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-06-12T19:07:37,502   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-06-12T19:07:37,504   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-06-12T19:07:37,505   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-06-12T19:07:37,507   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-06-12T19:07:37,510   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-06-12T19:07:37,511   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-06-12T19:07:37,512   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-06-12T19:07:37,513   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-06-12T19:07:37,514   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-06-12T19:07:37,516   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-06-12T19:07:37,517   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-06-12T19:07:37,519   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-06-12T19:07:37,520   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-06-12T19:07:37,521   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-06-12T19:07:37,522   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-06-12T19:07:37,524   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-06-12T19:07:37,525   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-06-12T19:07:37,527   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-06-12T19:07:37,528   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-06-12T19:07:37,529   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-06-12T19:07:37,530   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-06-12T19:07:37,532   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-06-12T19:07:37,534   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-06-12T19:07:37,537   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-06-12T19:07:37,539   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-06-12T19:07:37,541   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-06-12T19:07:37,542   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-06-12T19:07:37,544   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-06-12T19:07:37,546   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-06-12T19:07:37,548   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-06-12T19:07:37,550   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-06-12T19:07:37,552   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-06-12T19:07:37,560   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-06-12T19:07:37,565   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-06-12T19:07:37,567   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-06-12T19:07:37,570   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-06-12T19:07:37,572   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-06-12T19:07:37,573   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-06-12T19:07:37,575   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-06-12T19:07:37,577   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-06-12T19:07:37,580   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-06-12T19:07:37,583   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-06-12T19:07:37,585   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-06-12T19:07:37,587   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-06-12T19:07:37,595   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-06-12T19:07:37,599   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-06-12T19:07:37,601   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-06-12T19:07:37,605   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-06-12T19:07:37,608   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-06-12T19:07:37,612   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-06-12T19:07:37,614   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-06-12T19:07:37,616   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-06-12T19:07:37,618   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-06-12T19:07:37,620   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-06-12T19:07:37,622   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-06-12T19:07:37,625   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-06-12T19:07:37,628   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-06-12T19:07:37,629   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-06-12T19:07:37,633   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-06-12T19:07:37,634   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-06-12T19:07:37,636   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-06-12T19:07:37,637   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-06-12T19:07:37,638   adding 'deepspeed/ops/csrc/includes/context.h'
2024-06-12T19:07:37,640   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-06-12T19:07:37,642   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-06-12T19:07:37,643   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-06-12T19:07:37,645   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-06-12T19:07:37,646   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-06-12T19:07:37,648   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-06-12T19:07:37,650   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-06-12T19:07:37,651   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-06-12T19:07:37,652   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-06-12T19:07:37,653   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-06-12T19:07:37,655   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-06-12T19:07:37,656   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-06-12T19:07:37,658   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-06-12T19:07:37,659   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-06-12T19:07:37,661   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-06-12T19:07:37,663   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-06-12T19:07:37,664   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-06-12T19:07:37,666   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-06-12T19:07:37,667   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-06-12T19:07:37,670   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-06-12T19:07:37,672   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-06-12T19:07:37,673   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-06-12T19:07:37,675   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-06-12T19:07:37,676   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-06-12T19:07:37,678   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-06-12T19:07:37,680   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-06-12T19:07:37,682   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-06-12T19:07:37,683   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-06-12T19:07:37,684   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-06-12T19:07:37,686   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-06-12T19:07:37,687   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-06-12T19:07:37,689   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-06-12T19:07:37,692   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-06-12T19:07:37,694   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-06-12T19:07:37,695   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-06-12T19:07:37,697   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-06-12T19:07:37,699   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-06-12T19:07:37,700   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-06-12T19:07:37,702   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-06-12T19:07:37,704   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-06-12T19:07:37,705   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-06-12T19:07:37,706   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-06-12T19:07:37,708   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-06-12T19:07:37,711   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-06-12T19:07:37,712   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-06-12T19:07:37,714   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-06-12T19:07:37,716   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-06-12T19:07:37,718   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-06-12T19:07:37,722   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-06-12T19:07:37,724   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-06-12T19:07:37,726   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-06-12T19:07:37,730   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-06-12T19:07:37,733   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-06-12T19:07:37,736   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-06-12T19:07:37,739   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-06-12T19:07:37,740   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-06-12T19:07:37,743   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-06-12T19:07:37,745   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-06-12T19:07:37,747   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-06-12T19:07:37,752   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-06-12T19:07:37,754   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-06-12T19:07:37,756   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-06-12T19:07:37,758   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-06-12T19:07:37,761   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-06-12T19:07:37,764   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-06-12T19:07:37,766   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-06-12T19:07:37,768   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-06-12T19:07:37,769   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-06-12T19:07:37,772   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-06-12T19:07:37,774   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp'
2024-06-12T19:07:37,775   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp'
2024-06-12T19:07:37,776   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-06-12T19:07:37,778   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-06-12T19:07:37,780   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-06-12T19:07:37,781   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-06-12T19:07:37,783   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-06-12T19:07:37,785   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-06-12T19:07:37,786   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-06-12T19:07:37,788   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-06-12T19:07:37,796   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-06-12T19:07:37,798   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-06-12T19:07:37,800   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-06-12T19:07:37,801   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-06-12T19:07:37,803   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-06-12T19:07:37,804   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-06-12T19:07:37,806   adding 'deepspeed/ops/lamb/__init__.py'
2024-06-12T19:07:37,808   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-06-12T19:07:37,810   adding 'deepspeed/ops/lion/__init__.py'
2024-06-12T19:07:37,812   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-06-12T19:07:37,813   adding 'deepspeed/ops/lion/fused_lion.py'
2024-06-12T19:07:37,815   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-06-12T19:07:37,818   adding 'deepspeed/ops/op_builder/__init__.py'
2024-06-12T19:07:37,820   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-06-12T19:07:37,822   adding 'deepspeed/ops/op_builder/async_io.py'
2024-06-12T19:07:37,826   adding 'deepspeed/ops/op_builder/builder.py'
2024-06-12T19:07:37,828   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-06-12T19:07:37,829   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-06-12T19:07:37,830   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-06-12T19:07:37,832   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-06-12T19:07:37,833   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-06-12T19:07:37,834   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-06-12T19:07:37,835   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-06-12T19:07:37,837   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-06-12T19:07:37,838   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-06-12T19:07:37,839   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-06-12T19:07:37,840   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-06-12T19:07:37,842   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-06-12T19:07:37,843   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-06-12T19:07:37,844   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-06-12T19:07:37,846   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-06-12T19:07:37,847   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-06-12T19:07:37,848   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-06-12T19:07:37,849   adding 'deepspeed/ops/op_builder/transformer.py'
2024-06-12T19:07:37,851   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-06-12T19:07:37,853   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-06-12T19:07:37,854   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-06-12T19:07:37,855   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-06-12T19:07:37,856   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-06-12T19:07:37,858   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-06-12T19:07:37,859   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-06-12T19:07:37,861   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-06-12T19:07:37,862   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-06-12T19:07:37,863   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-06-12T19:07:37,865   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-06-12T19:07:37,866   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-06-12T19:07:37,868   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-06-12T19:07:37,869   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-06-12T19:07:37,871   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-06-12T19:07:37,872   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-06-12T19:07:37,873   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-06-12T19:07:37,875   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-06-12T19:07:37,876   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-06-12T19:07:37,878   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-06-12T19:07:37,879   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-06-12T19:07:37,881   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-06-12T19:07:37,882   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-06-12T19:07:37,883   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-06-12T19:07:37,884   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-06-12T19:07:37,885   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-06-12T19:07:37,887   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-06-12T19:07:37,888   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-06-12T19:07:37,889   adding 'deepspeed/ops/quantizer/__init__.py'
2024-06-12T19:07:37,890   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-06-12T19:07:37,892   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-06-12T19:07:37,893   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-06-12T19:07:37,895   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-06-12T19:07:37,896   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-06-12T19:07:37,900   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-06-12T19:07:37,902   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-06-12T19:07:37,904   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-06-12T19:07:37,905   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-06-12T19:07:37,908   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-06-12T19:07:37,910   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-06-12T19:07:37,912   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-06-12T19:07:37,913   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-06-12T19:07:37,915   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-06-12T19:07:37,916   adding 'deepspeed/ops/transformer/__init__.py'
2024-06-12T19:07:37,919   adding 'deepspeed/ops/transformer/transformer.py'
2024-06-12T19:07:37,921   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-06-12T19:07:37,922   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-06-12T19:07:37,924   adding 'deepspeed/ops/transformer/inference/config.py'
2024-06-12T19:07:37,925   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-06-12T19:07:37,926   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-06-12T19:07:37,928   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-06-12T19:07:37,930   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-06-12T19:07:37,931   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-06-12T19:07:37,934   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-06-12T19:07:37,935   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-06-12T19:07:37,937   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-06-12T19:07:37,939   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-06-12T19:07:37,940   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-06-12T19:07:37,941   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-06-12T19:07:37,943   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-06-12T19:07:37,944   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-06-12T19:07:37,946   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-06-12T19:07:37,947   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-06-12T19:07:37,949   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-06-12T19:07:37,950   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-06-12T19:07:37,952   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-06-12T19:07:37,955   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-06-12T19:07:37,956   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-06-12T19:07:37,957   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-06-12T19:07:37,959   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-06-12T19:07:37,961   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-06-12T19:07:37,962   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-06-12T19:07:37,964   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-06-12T19:07:37,965   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-06-12T19:07:37,967   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-06-12T19:07:37,969   adding 'deepspeed/pipe/__init__.py'
2024-06-12T19:07:37,970   adding 'deepspeed/profiling/__init__.py'
2024-06-12T19:07:37,971   adding 'deepspeed/profiling/config.py'
2024-06-12T19:07:37,973   adding 'deepspeed/profiling/constants.py'
2024-06-12T19:07:37,974   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-06-12T19:07:37,980   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-06-12T19:07:37,982   adding 'deepspeed/runtime/__init__.py'
2024-06-12T19:07:37,983   adding 'deepspeed/runtime/base_optimizer.py'
2024-06-12T19:07:37,986   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-06-12T19:07:37,987   adding 'deepspeed/runtime/compiler.py'
2024-06-12T19:07:37,992   adding 'deepspeed/runtime/config.py'
2024-06-12T19:07:37,994   adding 'deepspeed/runtime/config_utils.py'
2024-06-12T19:07:37,995   adding 'deepspeed/runtime/constants.py'
2024-06-12T19:07:37,997   adding 'deepspeed/runtime/dataloader.py'
2024-06-12T19:07:37,999   adding 'deepspeed/runtime/eigenvalue.py'
2024-06-12T19:07:38,017   adding 'deepspeed/runtime/engine.py'
2024-06-12T19:07:38,021   adding 'deepspeed/runtime/hybrid_engine.py'
2024-06-12T19:07:38,024   adding 'deepspeed/runtime/lr_schedules.py'
2024-06-12T19:07:38,026   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-06-12T19:07:38,028   adding 'deepspeed/runtime/quantize.py'
2024-06-12T19:07:38,029   adding 'deepspeed/runtime/sparse_tensor.py'
2024-06-12T19:07:38,031   adding 'deepspeed/runtime/state_dict_factory.py'
2024-06-12T19:07:38,036   adding 'deepspeed/runtime/utils.py'
2024-06-12T19:07:38,038   adding 'deepspeed/runtime/weight_quantizer.py'
2024-06-12T19:07:38,040   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-06-12T19:07:38,045   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-06-12T19:07:38,047   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-06-12T19:07:38,048   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-06-12T19:07:38,050   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-06-12T19:07:38,051   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-06-12T19:07:38,052   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-06-12T19:07:38,054   adding 'deepspeed/runtime/comm/__init__.py'
2024-06-12T19:07:38,056   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-06-12T19:07:38,057   adding 'deepspeed/runtime/comm/compressed.py'
2024-06-12T19:07:38,059   adding 'deepspeed/runtime/comm/hccl.py'
2024-06-12T19:07:38,061   adding 'deepspeed/runtime/comm/mpi.py'
2024-06-12T19:07:38,062   adding 'deepspeed/runtime/comm/nccl.py'
2024-06-12T19:07:38,064   adding 'deepspeed/runtime/compression/__init__.py'
2024-06-12T19:07:38,065   adding 'deepspeed/runtime/compression/cupy.py'
2024-06-12T19:07:38,067   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-06-12T19:07:38,068   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-06-12T19:07:38,070   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-06-12T19:07:38,072   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-06-12T19:07:38,073   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-06-12T19:07:38,075   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-06-12T19:07:38,076   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-06-12T19:07:38,077   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-06-12T19:07:38,079   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-06-12T19:07:38,080   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-06-12T19:07:38,085   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-06-12T19:07:38,088   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-06-12T19:07:38,090   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-06-12T19:07:38,092   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-06-12T19:07:38,093   adding 'deepspeed/runtime/fp16/__init__.py'
2024-06-12T19:07:38,096   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-06-12T19:07:38,098   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-06-12T19:07:38,101   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-06-12T19:07:38,103   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-06-12T19:07:38,105   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-06-12T19:07:38,108   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-06-12T19:07:38,110   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-06-12T19:07:38,112   adding 'deepspeed/runtime/pipe/__init__.py'
2024-06-12T19:07:38,118   adding 'deepspeed/runtime/pipe/engine.py'
2024-06-12T19:07:38,122   adding 'deepspeed/runtime/pipe/module.py'
2024-06-12T19:07:38,124   adding 'deepspeed/runtime/pipe/p2p.py'
2024-06-12T19:07:38,126   adding 'deepspeed/runtime/pipe/schedule.py'
2024-06-12T19:07:38,129   adding 'deepspeed/runtime/pipe/topology.py'
2024-06-12T19:07:38,131   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-06-12T19:07:38,132   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-06-12T19:07:38,134   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-06-12T19:07:38,135   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-06-12T19:07:38,137   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-06-12T19:07:38,139   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-06-12T19:07:38,141   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-06-12T19:07:38,143   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-06-12T19:07:38,145   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-06-12T19:07:38,147   adding 'deepspeed/runtime/zero/__init__.py'
2024-06-12T19:07:38,149   adding 'deepspeed/runtime/zero/config.py'
2024-06-12T19:07:38,151   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-06-12T19:07:38,153   adding 'deepspeed/runtime/zero/linear.py'
2024-06-12T19:07:38,156   adding 'deepspeed/runtime/zero/mics.py'
2024-06-12T19:07:38,157   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-06-12T19:07:38,159   adding 'deepspeed/runtime/zero/offload_config.py'
2024-06-12T19:07:38,161   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-06-12T19:07:38,173   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-06-12T19:07:38,177   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-06-12T19:07:38,179   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-06-12T19:07:38,194   adding 'deepspeed/runtime/zero/stage3.py'
2024-06-12T19:07:38,208   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-06-12T19:07:38,209   adding 'deepspeed/runtime/zero/test.py'
2024-06-12T19:07:38,211   adding 'deepspeed/runtime/zero/tiling.py'
2024-06-12T19:07:38,213   adding 'deepspeed/runtime/zero/utils.py'
2024-06-12T19:07:38,215   adding 'deepspeed/sequence/__init__.py'
2024-06-12T19:07:38,216   adding 'deepspeed/sequence/layer.py'
2024-06-12T19:07:38,218   adding 'deepspeed/utils/__init__.py'
2024-06-12T19:07:38,219   adding 'deepspeed/utils/bwc.py'
2024-06-12T19:07:38,221   adding 'deepspeed/utils/comms_logging.py'
2024-06-12T19:07:38,222   adding 'deepspeed/utils/config.py'
2024-06-12T19:07:38,223   adding 'deepspeed/utils/debug.py'
2024-06-12T19:07:38,225   adding 'deepspeed/utils/exceptions.py'
2024-06-12T19:07:38,227   adding 'deepspeed/utils/groups.py'
2024-06-12T19:07:38,229   adding 'deepspeed/utils/init_on_device.py'
2024-06-12T19:07:38,230   adding 'deepspeed/utils/logging.py'
2024-06-12T19:07:38,231   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-06-12T19:07:38,233   adding 'deepspeed/utils/numa.py'
2024-06-12T19:07:38,234   adding 'deepspeed/utils/nvtx.py'
2024-06-12T19:07:38,236   adding 'deepspeed/utils/tensor_fragment.py'
2024-06-12T19:07:38,238   adding 'deepspeed/utils/timer.py'
2024-06-12T19:07:38,239   adding 'deepspeed/utils/torch.py'
2024-06-12T19:07:38,240   adding 'deepspeed/utils/types.py'
2024-06-12T19:07:38,242   adding 'deepspeed/utils/z3_leaf_module.py'
2024-06-12T19:07:38,245   adding 'deepspeed/utils/zero_to_fp32.py'
2024-06-12T19:07:38,247   adding 'deepspeed-0.14.3.data/scripts/deepspeed'
2024-06-12T19:07:38,248   adding 'deepspeed-0.14.3.data/scripts/deepspeed.pt'
2024-06-12T19:07:38,249   adding 'deepspeed-0.14.3.data/scripts/ds'
2024-06-12T19:07:38,250   adding 'deepspeed-0.14.3.data/scripts/ds_bench'
2024-06-12T19:07:38,251   adding 'deepspeed-0.14.3.data/scripts/ds_elastic'
2024-06-12T19:07:38,253   adding 'deepspeed-0.14.3.data/scripts/ds_report'
2024-06-12T19:07:38,254   adding 'deepspeed-0.14.3.data/scripts/ds_ssh'
2024-06-12T19:07:38,255   adding 'deepspeed-0.14.3.data/scripts/dsr'
2024-06-12T19:07:38,260   adding 'deepspeed-0.14.3.dist-info/METADATA'
2024-06-12T19:07:38,262   adding 'deepspeed-0.14.3.dist-info/WHEEL'
2024-06-12T19:07:38,263   adding 'deepspeed-0.14.3.dist-info/entry_points.txt'
2024-06-12T19:07:38,263   adding 'deepspeed-0.14.3.dist-info/top_level.txt'
2024-06-12T19:07:38,277   adding 'deepspeed-0.14.3.dist-info/RECORD'
2024-06-12T19:07:38,300   removing build/bdist.linux-armv7l/wheel
2024-06-12T19:07:38,525   deepspeed build time = 10.734610319137573 secs
2024-06-12T19:07:38,646   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-06-12T19:07:38,663   Created wheel for deepspeed: filename=deepspeed-0.14.3-py3-none-any.whl size=1443049 sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88
2024-06-12T19:07:38,664   Stored in directory: /tmp/pip-ephem-wheel-cache-0ieogtm_/wheels/92/b0/c9/b47fb0eec23a4a5a3504b684f08e71c0e6eb9dea4e94eb7a70
2024-06-12T19:07:38,705 Successfully built deepspeed
2024-06-12T19:07:38,750 Removed build tracker: '/tmp/pip-build-tracker-bm2esee1'