2023-12-27T20:14:45,082 Created temporary directory: /tmp/pip-build-tracker-9cbhrnt_
2023-12-27T20:14:45,083 Initialized build tracking at /tmp/pip-build-tracker-9cbhrnt_
2023-12-27T20:14:45,084 Created build tracker: /tmp/pip-build-tracker-9cbhrnt_
2023-12-27T20:14:45,084 Entered build tracker: /tmp/pip-build-tracker-9cbhrnt_
2023-12-27T20:14:45,085 Created temporary directory: /tmp/pip-wheel-q3kdja4r
2023-12-27T20:14:45,088 Created temporary directory: /tmp/pip-ephem-wheel-cache-7u64anze
2023-12-27T20:14:45,110 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-12-27T20:14:45,113 2 location(s) to search for versions of deepspeed:
2023-12-27T20:14:45,113 * https://pypi.org/simple/deepspeed/
2023-12-27T20:14:45,113 * https://www.piwheels.org/simple/deepspeed/
2023-12-27T20:14:45,114 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2023-12-27T20:14:45,115 Getting page https://pypi.org/simple/deepspeed/
2023-12-27T20:14:45,116 Found index url https://pypi.org/simple/
2023-12-27T20:14:45,330 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2023-12-27T20:14:45,345   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-12-27T20:14:45,346   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2023-12-27T20:14:45,346   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-12-27T20:14:45,347   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2023-12-27T20:14:45,348   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-12-27T20:14:45,348   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2023-12-27T20:14:45,349   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-12-27T20:14:45,350   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2023-12-27T20:14:45,351   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-12-27T20:14:45,351   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2023-12-27T20:14:45,352   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2023-12-27T20:14:45,353   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2023-12-27T20:14:45,354   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2023-12-27T20:14:45,355   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2023-12-27T20:14:45,355   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2023-12-27T20:14:45,356   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2023-12-27T20:14:45,356   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2023-12-27T20:14:45,357   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2023-12-27T20:14:45,357   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2023-12-27T20:14:45,358   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2023-12-27T20:14:45,359   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2023-12-27T20:14:45,359   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2023-12-27T20:14:45,360   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2023-12-27T20:14:45,361   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2023-12-27T20:14:45,362   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2023-12-27T20:14:45,362   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2023-12-27T20:14:45,363   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2023-12-27T20:14:45,364   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2023-12-27T20:14:45,365   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2023-12-27T20:14:45,365   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2023-12-27T20:14:45,366   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2023-12-27T20:14:45,367   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2023-12-27T20:14:45,367   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2023-12-27T20:14:45,368   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2023-12-27T20:14:45,369   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2023-12-27T20:14:45,369   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2023-12-27T20:14:45,370   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2023-12-27T20:14:45,370   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2023-12-27T20:14:45,371   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2023-12-27T20:14:45,372   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2023-12-27T20:14:45,372   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2023-12-27T20:14:45,373   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2023-12-27T20:14:45,374   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2023-12-27T20:14:45,375   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2023-12-27T20:14:45,375   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2023-12-27T20:14:45,376   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2023-12-27T20:14:45,377   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2023-12-27T20:14:45,377   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2023-12-27T20:14:45,378   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2023-12-27T20:14:45,379   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2023-12-27T20:14:45,380   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2023-12-27T20:14:45,381   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2023-12-27T20:14:45,381   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2023-12-27T20:14:45,382   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2023-12-27T20:14:45,382   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2023-12-27T20:14:45,383   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2023-12-27T20:14:45,383   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2023-12-27T20:14:45,384   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2023-12-27T20:14:45,385   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2023-12-27T20:14:45,386   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2023-12-27T20:14:45,386   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2023-12-27T20:14:45,387   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2023-12-27T20:14:45,388   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2023-12-27T20:14:45,389   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2023-12-27T20:14:45,389   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2023-12-27T20:14:45,390   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2023-12-27T20:14:45,391   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2023-12-27T20:14:45,391   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2023-12-27T20:14:45,392   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2023-12-27T20:14:45,393   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2023-12-27T20:14:45,393   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2023-12-27T20:14:45,394   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2023-12-27T20:14:45,394   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2023-12-27T20:14:45,395   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2023-12-27T20:14:45,395   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2023-12-27T20:14:45,396   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2023-12-27T20:14:45,397   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2023-12-27T20:14:45,398   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2023-12-27T20:14:45,398   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2023-12-27T20:14:45,399   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2023-12-27T20:14:45,400   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2023-12-27T20:14:45,401   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2023-12-27T20:14:45,401   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2023-12-27T20:14:45,402   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2023-12-27T20:14:45,403   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2023-12-27T20:14:45,404 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2023-12-27T20:14:45,405 Getting page https://www.piwheels.org/simple/deepspeed/
2023-12-27T20:14:45,406 Found index url https://www.piwheels.org/simple/
2023-12-27T20:14:45,566 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2023-12-27T20:14:45,580   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,581   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,581   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,582   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,582   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,583   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,583   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,584   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,585   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,586   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,586   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,587   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,587   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,588   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,589   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,590   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,590   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,590   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,591   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,591   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,592   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,592   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,593   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,594   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,594   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,595   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,595   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,596   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,597   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,597   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,598   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,598   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,599   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,599   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,599   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,600   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,601   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,601   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,602   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,602   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,603   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,603   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,604   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,605   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,605   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,606   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,606   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,607   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,607   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,607   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,608   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,609   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,609   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,610   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,610   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2023-12-27T20:14:45,611 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2023-12-27T20:14:45,612 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2023-12-27T20:14:45,640 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2023-12-27T20:14:45,660 Collecting deepspeed==0.12.6
2023-12-27T20:14:45,662   Created temporary directory: /tmp/pip-unpack-8onzmblq
2023-12-27T20:14:45,797   Downloading deepspeed-0.12.6.tar.gz (1.2 MB)
2023-12-27T20:14:47,701   Added deepspeed==0.12.6 from https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz to build tracker '/tmp/pip-build-tracker-9cbhrnt_'
2023-12-27T20:14:47,702   Running setup.py (path:/tmp/pip-wheel-q3kdja4r/deepspeed_056de0c3d8ba4fb58072c03df7bba7e3/setup.py) egg_info for package deepspeed
2023-12-27T20:14:47,703   Created temporary directory: /tmp/pip-pip-egg-info-ccvmwpei
2023-12-27T20:14:47,704   Preparing metadata (setup.py): started
2023-12-27T20:14:47,705   Running command python setup.py egg_info
2023-12-27T20:14:48,555   fatal: not a git repository (or any of the parent directories): .git
2023-12-27T20:14:49,027   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2023-12-27T20:14:49,028    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2023-12-27T20:14:49,028   DS_BUILD_OPS=0
2023-12-27T20:14:49,029    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2023-12-27T20:14:49,029    [WARNING]  async_io: please install the libaio-dev package with apt
2023-12-27T20:14:49,030    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2023-12-27T20:14:49,030    [WARNING]  Please install torch if trying to pre-compile kernels
2023-12-27T20:14:49,031    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:49,031    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:49,032    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:49,032    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:49,033    [WARNING]  unable to import torch, please install it first
2023-12-27T20:14:49,033    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:49,034    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:49,034   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False}
2023-12-27T20:14:49,035   version=0.12.6, git_hash=unknown, git_branch=unknown
2023-12-27T20:14:49,035   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2023-12-27T20:14:49,036   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False}
2023-12-27T20:14:49,037   ext_modules=[]
2023-12-27T20:14:49,037   running egg_info
2023-12-27T20:14:49,038   creating /tmp/pip-pip-egg-info-ccvmwpei/deepspeed.egg-info
2023-12-27T20:14:49,061   writing /tmp/pip-pip-egg-info-ccvmwpei/deepspeed.egg-info/PKG-INFO
2023-12-27T20:14:49,095   writing dependency_links to /tmp/pip-pip-egg-info-ccvmwpei/deepspeed.egg-info/dependency_links.txt
2023-12-27T20:14:49,097   writing entry points to /tmp/pip-pip-egg-info-ccvmwpei/deepspeed.egg-info/entry_points.txt
2023-12-27T20:14:49,113   writing requirements to /tmp/pip-pip-egg-info-ccvmwpei/deepspeed.egg-info/requires.txt
2023-12-27T20:14:49,115   writing top-level names to /tmp/pip-pip-egg-info-ccvmwpei/deepspeed.egg-info/top_level.txt
2023-12-27T20:14:49,116   writing manifest file '/tmp/pip-pip-egg-info-ccvmwpei/deepspeed.egg-info/SOURCES.txt'
2023-12-27T20:14:49,325   reading manifest file '/tmp/pip-pip-egg-info-ccvmwpei/deepspeed.egg-info/SOURCES.txt'
2023-12-27T20:14:49,327   reading manifest template 'MANIFEST.in'
2023-12-27T20:14:49,329   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2023-12-27T20:14:49,329   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2023-12-27T20:14:50,370   warning: no files found matching '*.hip' under directory 'deepspeed'
2023-12-27T20:14:51,353   warning: no files found matching '*.cc' under directory 'deepspeed'
2023-12-27T20:14:51,798   warning: no files found matching '*.tr' under directory 'csrc'
2023-12-27T20:14:51,891   warning: no files found matching '*.cc' under directory 'csrc'
2023-12-27T20:14:51,915   warning: no files found matching '*.py' under directory 'benchmarks'
2023-12-27T20:14:51,947   writing manifest file '/tmp/pip-pip-egg-info-ccvmwpei/deepspeed.egg-info/SOURCES.txt'
2023-12-27T20:14:51,949   deepspeed build time = 3.391087532043457 secs
2023-12-27T20:14:52,052   Preparing metadata (setup.py): finished with status 'done'
2023-12-27T20:14:52,058   Source in /tmp/pip-wheel-q3kdja4r/deepspeed_056de0c3d8ba4fb58072c03df7bba7e3 has version 0.12.6, which satisfies requirement deepspeed==0.12.6 from https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz
2023-12-27T20:14:52,059   Removed deepspeed==0.12.6 from https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz from build tracker '/tmp/pip-build-tracker-9cbhrnt_'
2023-12-27T20:14:52,067 Created temporary directory: /tmp/pip-unpack-lc2ki92m
2023-12-27T20:14:52,068 Created temporary directory: /tmp/pip-unpack-74d4cy9o
2023-12-27T20:14:52,306 Building wheels for collected packages: deepspeed
2023-12-27T20:14:52,310   Created temporary directory: /tmp/pip-wheel-n6130f2k
2023-12-27T20:14:52,311   Building wheel for deepspeed (setup.py): started
2023-12-27T20:14:52,312   Destination directory: /tmp/pip-wheel-n6130f2k
2023-12-27T20:14:52,312   Running command python setup.py bdist_wheel
2023-12-27T20:14:52,760   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2023-12-27T20:14:52,769    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2023-12-27T20:14:52,826   DS_BUILD_OPS=0
2023-12-27T20:14:52,937    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2023-12-27T20:14:52,994    [WARNING]  async_io: please install the libaio-dev package with apt
2023-12-27T20:14:52,995    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2023-12-27T20:14:52,995    [WARNING]  Please install torch if trying to pre-compile kernels
2023-12-27T20:14:52,996    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:52,997    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:52,997    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:52,998    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:52,998    [WARNING]  unable to import torch, please install it first
2023-12-27T20:14:52,999    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:53,000    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-12-27T20:14:53,000   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False}
2023-12-27T20:14:53,008   fatal: not a git repository (or any of the parent directories): .git
2023-12-27T20:14:53,010   version=0.12.6, git_hash=unknown, git_branch=unknown
2023-12-27T20:14:53,010   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2023-12-27T20:14:53,011   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False}
2023-12-27T20:14:53,011   ext_modules=[]
2023-12-27T20:14:53,434   running bdist_wheel
2023-12-27T20:14:53,556   running build
2023-12-27T20:14:53,557   running build_py
2023-12-27T20:14:53,584   creating build
2023-12-27T20:14:53,585   creating build/lib
2023-12-27T20:14:53,585   creating build/lib/deepspeed
2023-12-27T20:14:53,586   copying deepspeed/__init__.py -> build/lib/deepspeed
2023-12-27T20:14:53,589   copying deepspeed/env_report.py -> build/lib/deepspeed
2023-12-27T20:14:53,591   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2023-12-27T20:14:53,593   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2023-12-27T20:14:53,594   copying deepspeed/constants.py -> build/lib/deepspeed
2023-12-27T20:14:53,596   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2023-12-27T20:14:53,598   creating build/lib/deepspeed/runtime
2023-12-27T20:14:53,599   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,601   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,603   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,605   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,607   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,610   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,612   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,614   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,616   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,618   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,621   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,623   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,625   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,627   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,630   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,632   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2023-12-27T20:14:53,637   creating build/lib/deepspeed/utils
2023-12-27T20:14:53,638   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,640   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,642   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,644   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,646   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,648   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,650   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,652   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,654   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,657   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,658   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,660   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,661   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,663   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2023-12-27T20:14:53,665   creating build/lib/deepspeed/accelerator
2023-12-27T20:14:53,666   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2023-12-27T20:14:53,668   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2023-12-27T20:14:53,670   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2023-12-27T20:14:53,672   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2023-12-27T20:14:53,674   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2023-12-27T20:14:53,676   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2023-12-27T20:14:53,677   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2023-12-27T20:14:53,680   creating build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,681   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,683   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,685   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,687   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,689   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,691   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,693   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,695   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,697   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,699   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2023-12-27T20:14:53,702   creating build/lib/deepspeed/moe
2023-12-27T20:14:53,703   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2023-12-27T20:14:53,704   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2023-12-27T20:14:53,706   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2023-12-27T20:14:53,708   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2023-12-27T20:14:53,710   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2023-12-27T20:14:53,712   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2023-12-27T20:14:53,715   creating build/lib/deepspeed/model_implementations
2023-12-27T20:14:53,716   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2023-12-27T20:14:53,718   creating build/lib/deepspeed/nebula
2023-12-27T20:14:53,719   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2023-12-27T20:14:53,721   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2023-12-27T20:14:53,722   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2023-12-27T20:14:53,725   creating build/lib/deepspeed/ops
2023-12-27T20:14:53,726   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2023-12-27T20:14:53,728   creating build/lib/deepspeed/monitor
2023-12-27T20:14:53,729   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2023-12-27T20:14:53,731   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2023-12-27T20:14:53,733   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2023-12-27T20:14:53,734   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2023-12-27T20:14:53,736   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2023-12-27T20:14:53,737   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2023-12-27T20:14:53,739   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2023-12-27T20:14:53,741   creating build/lib/deepspeed/elasticity
2023-12-27T20:14:53,742   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2023-12-27T20:14:53,744   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2023-12-27T20:14:53,746   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2023-12-27T20:14:53,748   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2023-12-27T20:14:53,750   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2023-12-27T20:14:53,752   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2023-12-27T20:14:53,754   creating build/lib/deepspeed/autotuning
2023-12-27T20:14:53,756   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2023-12-27T20:14:53,758   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2023-12-27T20:14:53,759   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2023-12-27T20:14:53,762   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2023-12-27T20:14:53,764   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2023-12-27T20:14:53,766   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2023-12-27T20:14:53,769   creating build/lib/deepspeed/pipe
2023-12-27T20:14:53,770   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2023-12-27T20:14:53,773   creating build/lib/deepspeed/module_inject
2023-12-27T20:14:53,773   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,776   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,778   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,779   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,781   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,783   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,785   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,787   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,789   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,792   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,793   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,796   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,798   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2023-12-27T20:14:53,801   creating build/lib/deepspeed/compression
2023-12-27T20:14:53,802   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2023-12-27T20:14:53,804   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2023-12-27T20:14:53,807   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2023-12-27T20:14:53,809   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2023-12-27T20:14:53,812   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2023-12-27T20:14:53,814   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2023-12-27T20:14:53,816   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2023-12-27T20:14:53,818   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2023-12-27T20:14:53,821   creating build/lib/deepspeed/comm
2023-12-27T20:14:53,822   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2023-12-27T20:14:53,824   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2023-12-27T20:14:53,826   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2023-12-27T20:14:53,827   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2023-12-27T20:14:53,829   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2023-12-27T20:14:53,831   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2023-12-27T20:14:53,833   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2023-12-27T20:14:53,835   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2023-12-27T20:14:53,836   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2023-12-27T20:14:53,838   creating build/lib/deepspeed/launcher
2023-12-27T20:14:53,840   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2023-12-27T20:14:53,842   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2023-12-27T20:14:53,844   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2023-12-27T20:14:53,847   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2023-12-27T20:14:53,848   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2023-12-27T20:14:53,851   creating build/lib/deepspeed/inference
2023-12-27T20:14:53,852   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2023-12-27T20:14:53,854   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2023-12-27T20:14:53,856   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2023-12-27T20:14:53,860   creating build/lib/deepspeed/profiling
2023-12-27T20:14:53,860   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2023-12-27T20:14:53,862   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2023-12-27T20:14:53,864   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2023-12-27T20:14:53,866   creating build/lib/deepspeed/sequence
2023-12-27T20:14:53,867   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2023-12-27T20:14:53,869   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2023-12-27T20:14:53,871   creating build/lib/deepspeed/runtime/data_pipeline
2023-12-27T20:14:53,872   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2023-12-27T20:14:53,874   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2023-12-27T20:14:53,875   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2023-12-27T20:14:53,877   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2023-12-27T20:14:53,880   creating build/lib/deepspeed/runtime/fp16
2023-12-27T20:14:53,881   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2023-12-27T20:14:53,883   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2023-12-27T20:14:53,885   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2023-12-27T20:14:53,888   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2023-12-27T20:14:53,891   creating build/lib/deepspeed/runtime/swap_tensor
2023-12-27T20:14:53,892   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2023-12-27T20:14:53,894   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2023-12-27T20:14:53,896   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-12-27T20:14:53,898   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2023-12-27T20:14:53,900   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-12-27T20:14:53,902   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-12-27T20:14:53,904   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-12-27T20:14:53,906   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2023-12-27T20:14:53,907   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2023-12-27T20:14:53,910   creating build/lib/deepspeed/runtime/activation_checkpointing
2023-12-27T20:14:53,911   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2023-12-27T20:14:53,914   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2023-12-27T20:14:53,916   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2023-12-27T20:14:53,918   creating build/lib/deepspeed/runtime/pipe
2023-12-27T20:14:53,919   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2023-12-27T20:14:53,920   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2023-12-27T20:14:53,922   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2023-12-27T20:14:53,925   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2023-12-27T20:14:53,927   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2023-12-27T20:14:53,929   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2023-12-27T20:14:53,932   creating build/lib/deepspeed/runtime/checkpoint_engine
2023-12-27T20:14:53,933   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-12-27T20:14:53,935   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-12-27T20:14:53,936   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-12-27T20:14:53,938   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-12-27T20:14:53,941   creating build/lib/deepspeed/runtime/compression
2023-12-27T20:14:53,941   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2023-12-27T20:14:53,943   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2023-12-27T20:14:53,945   creating build/lib/deepspeed/runtime/comm
2023-12-27T20:14:53,947   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2023-12-27T20:14:53,948   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2023-12-27T20:14:53,951   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2023-12-27T20:14:53,953   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2023-12-27T20:14:53,955   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2023-12-27T20:14:53,958   creating build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,959   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,962   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,966   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,967   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,970   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,972   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,974   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,976   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,977   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,979   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,983   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,985   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,987   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,989   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,991   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,996   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2023-12-27T20:14:53,998   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:53,999   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:54,000   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:54,003   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:54,005   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:54,007   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:54,010   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:54,011   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:54,012   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:54,014   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:54,016   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:54,018   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:54,020   creating build/lib/deepspeed/runtime/fp16/onebit
2023-12-27T20:14:54,021   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-12-27T20:14:54,023   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-12-27T20:14:54,026   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-12-27T20:14:54,028   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-12-27T20:14:54,031   creating build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,032   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,034   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,036   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,038   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,039   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,041   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,042   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,044   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,046   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,047   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2023-12-27T20:14:54,050   creating build/lib/deepspeed/model_implementations/features
2023-12-27T20:14:54,051   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2023-12-27T20:14:54,053   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2023-12-27T20:14:54,055   creating build/lib/deepspeed/model_implementations/diffusers
2023-12-27T20:14:54,056   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2023-12-27T20:14:54,057   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2023-12-27T20:14:54,059   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2023-12-27T20:14:54,062   creating build/lib/deepspeed/ops/sparse_attention
2023-12-27T20:14:54,063   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2023-12-27T20:14:54,064   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2023-12-27T20:14:54,066   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2023-12-27T20:14:54,068   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2023-12-27T20:14:54,071   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2023-12-27T20:14:54,074   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2023-12-27T20:14:54,076   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2023-12-27T20:14:54,079   creating build/lib/deepspeed/ops/adagrad
2023-12-27T20:14:54,080   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2023-12-27T20:14:54,081   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2023-12-27T20:14:54,084   creating build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,085   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,087   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,089   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,091   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,092   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,094   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,096   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,098   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,099   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,101   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,102   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,104   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,105   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,107   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,109   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,111   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,112   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,114   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,115   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,117   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,119   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,120   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2023-12-27T20:14:54,122   creating build/lib/deepspeed/ops/quantizer
2023-12-27T20:14:54,123   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2023-12-27T20:14:54,125   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2023-12-27T20:14:54,127   creating build/lib/deepspeed/ops/deepspeed4science
2023-12-27T20:14:54,128   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2023-12-27T20:14:54,130   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2023-12-27T20:14:54,132   creating build/lib/deepspeed/ops/lamb
2023-12-27T20:14:54,133   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2023-12-27T20:14:54,135   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2023-12-27T20:14:54,137   creating build/lib/deepspeed/ops/adam
2023-12-27T20:14:54,138   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2023-12-27T20:14:54,140   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2023-12-27T20:14:54,142   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2023-12-27T20:14:54,144   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2023-12-27T20:14:54,146   creating build/lib/deepspeed/ops/lion
2023-12-27T20:14:54,147   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2023-12-27T20:14:54,149   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2023-12-27T20:14:54,151   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2023-12-27T20:14:54,153   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2023-12-27T20:14:54,155   creating build/lib/deepspeed/ops/aio
2023-12-27T20:14:54,156   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2023-12-27T20:14:54,158   creating build/lib/deepspeed/ops/random_ltd
2023-12-27T20:14:54,159   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2023-12-27T20:14:54,161   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2023-12-27T20:14:54,163   creating build/lib/deepspeed/ops/transformer
2023-12-27T20:14:54,164   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2023-12-27T20:14:54,166   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2023-12-27T20:14:54,169   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2023-12-27T20:14:54,169   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-12-27T20:14:54,172   creating build/lib/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:54,172   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:54,174   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:54,176   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:54,177   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:54,179   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:54,180   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:54,182   creating build/lib/deepspeed/ops/op_builder/npu
2023-12-27T20:14:54,183   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2023-12-27T20:14:54,185   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2023-12-27T20:14:54,186   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2023-12-27T20:14:54,188   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2023-12-27T20:14:54,189   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2023-12-27T20:14:54,191   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2023-12-27T20:14:54,193   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2023-12-27T20:14:54,195   creating build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,196   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,198   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,200   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,202   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,204   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,206   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,208   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,210   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,212   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,214   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2023-12-27T20:14:54,216   creating build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,217   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,220   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,222   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,224   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,226   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,228   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,229   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,232   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,233   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,235   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:54,237   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,238   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,240   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,242   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,244   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,245   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,247   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,249   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,251   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,252   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,254   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:54,256   creating build/lib/deepspeed/autotuning/tuner
2023-12-27T20:14:54,257   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2023-12-27T20:14:54,259   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2023-12-27T20:14:54,261   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2023-12-27T20:14:54,263   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2023-12-27T20:14:54,264   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2023-12-27T20:14:54,266   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2023-12-27T20:14:54,268   creating build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,269   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,272   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,273   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,275   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,277   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,278   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,280   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,282   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,283   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,285   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,287   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,289   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,291   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,293   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,295   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,297   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,298   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,300   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,302   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2023-12-27T20:14:54,305   creating build/lib/deepspeed/module_inject/containers/features
2023-12-27T20:14:54,306   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2023-12-27T20:14:54,307   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2023-12-27T20:14:54,309   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2023-12-27T20:14:54,311   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2023-12-27T20:14:54,313   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2023-12-27T20:14:54,315   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2023-12-27T20:14:54,317   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2023-12-27T20:14:54,319   creating build/lib/deepspeed/inference/quantization
2023-12-27T20:14:54,320   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2023-12-27T20:14:54,322   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2023-12-27T20:14:54,324   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2023-12-27T20:14:54,326   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2023-12-27T20:14:54,328   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2023-12-27T20:14:54,331   creating build/lib/deepspeed/inference/v2
2023-12-27T20:14:54,332   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2023-12-27T20:14:54,333   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2023-12-27T20:14:54,335   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2023-12-27T20:14:54,337   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2023-12-27T20:14:54,339   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2023-12-27T20:14:54,341   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2023-12-27T20:14:54,342   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2023-12-27T20:14:54,344   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2023-12-27T20:14:54,345   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2023-12-27T20:14:54,348   creating build/lib/deepspeed/inference/v2/checkpoint
2023-12-27T20:14:54,349   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2023-12-27T20:14:54,350   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2023-12-27T20:14:54,352   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2023-12-27T20:14:54,354   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2023-12-27T20:14:54,356   creating build/lib/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:54,357   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:54,359   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:54,361   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:54,363   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:54,365   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:54,367   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:54,369   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:54,372   creating build/lib/deepspeed/inference/v2/modules
2023-12-27T20:14:54,373   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2023-12-27T20:14:54,375   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2023-12-27T20:14:54,377   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2023-12-27T20:14:54,378   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2023-12-27T20:14:54,380   creating build/lib/deepspeed/inference/v2/ragged
2023-12-27T20:14:54,381   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2023-12-27T20:14:54,384   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2023-12-27T20:14:54,386   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2023-12-27T20:14:54,387   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2023-12-27T20:14:54,389   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2023-12-27T20:14:54,391   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2023-12-27T20:14:54,394   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2023-12-27T20:14:54,396   creating build/lib/deepspeed/inference/v2/kernels
2023-12-27T20:14:54,397   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2023-12-27T20:14:54,399   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2023-12-27T20:14:54,401   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2023-12-27T20:14:54,402   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2023-12-27T20:14:54,404   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2023-12-27T20:14:54,406   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2023-12-27T20:14:54,407   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2023-12-27T20:14:54,410   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2023-12-27T20:14:54,410   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2023-12-27T20:14:54,413   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2023-12-27T20:14:54,414   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2023-12-27T20:14:54,416   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2023-12-27T20:14:54,418   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2023-12-27T20:14:54,419   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2023-12-27T20:14:54,421   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2023-12-27T20:14:54,423   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2023-12-27T20:14:54,424   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2023-12-27T20:14:54,427   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:54,428   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:54,429   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:54,431   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:54,433   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:54,435   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:54,437   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:54,439   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:54,441   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:54,443   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:54,445   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2023-12-27T20:14:54,446   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2023-12-27T20:14:54,449   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2023-12-27T20:14:54,450   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2023-12-27T20:14:54,452   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2023-12-27T20:14:54,454   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:54,455   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:54,457   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:54,458   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:54,460   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:54,462   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:54,464   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:54,465   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:54,467   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:54,469   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:54,471   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2023-12-27T20:14:54,472   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2023-12-27T20:14:54,474   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2023-12-27T20:14:54,475   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2023-12-27T20:14:54,477   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2023-12-27T20:14:54,479   creating build/lib/deepspeed/inference/v2/modules/implementations
2023-12-27T20:14:54,480   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2023-12-27T20:14:54,483   creating build/lib/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:54,484   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:54,485   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:54,487   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:54,489   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:54,490   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:54,492   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:54,494   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:54,496   creating build/lib/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:54,497   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:54,499   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:54,500   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:54,502   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:54,503   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:54,505   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:54,506   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:54,508   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:54,510   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2023-12-27T20:14:54,511   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2023-12-27T20:14:54,513   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2023-12-27T20:14:54,516   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2023-12-27T20:14:54,516   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2023-12-27T20:14:54,518   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2023-12-27T20:14:54,520   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2023-12-27T20:14:54,522   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2023-12-27T20:14:54,523   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2023-12-27T20:14:54,525   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2023-12-27T20:14:54,528   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2023-12-27T20:14:54,528   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2023-12-27T20:14:54,530   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2023-12-27T20:14:54,533   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2023-12-27T20:14:54,534   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2023-12-27T20:14:54,535   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2023-12-27T20:14:54,538   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2023-12-27T20:14:54,539   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2023-12-27T20:14:54,541   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2023-12-27T20:14:54,543   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2023-12-27T20:14:54,544   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2023-12-27T20:14:54,546   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2023-12-27T20:14:54,548   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2023-12-27T20:14:54,549   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2023-12-27T20:14:54,552   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2023-12-27T20:14:54,553   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2023-12-27T20:14:54,555   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2023-12-27T20:14:54,556   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2023-12-27T20:14:54,558   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:54,559   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:54,561   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:54,563   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:54,565   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:54,566   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:54,567   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:54,570   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:54,570   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:54,572   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:54,575   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:54,576   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:54,577   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:54,580   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-12-27T20:14:54,581   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-12-27T20:14:54,582   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-12-27T20:14:54,585   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:54,586   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:54,588   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:54,590   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:54,591   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:54,593   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:54,595   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:54,595   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:54,597   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:54,600   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:54,600   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:54,602   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:54,605   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:54,605   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:54,607   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:54,609   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:54,611   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:54,614   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:54,614   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:54,616   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:54,619   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:54,620   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:54,621   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:54,623   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:54,625   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:54,627   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:54,628   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:54,630   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:54,632   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:54,634   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:54,635   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:54,637   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-12-27T20:14:54,638   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-12-27T20:14:54,640   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-12-27T20:14:54,642   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:54,643   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:54,645   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:54,647   creating build/lib/deepspeed/profiling/flops_profiler
2023-12-27T20:14:54,648   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2023-12-27T20:14:54,650   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2023-12-27T20:14:54,654   running egg_info
2023-12-27T20:14:54,679   writing deepspeed.egg-info/PKG-INFO
2023-12-27T20:14:54,710   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2023-12-27T20:14:54,712   writing entry points to deepspeed.egg-info/entry_points.txt
2023-12-27T20:14:54,727   writing requirements to deepspeed.egg-info/requires.txt
2023-12-27T20:14:54,728   writing top-level names to deepspeed.egg-info/top_level.txt
2023-12-27T20:14:54,835   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2023-12-27T20:14:54,881   reading manifest template 'MANIFEST.in'
2023-12-27T20:14:54,883   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2023-12-27T20:14:54,883   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2023-12-27T20:14:55,869   warning: no files found matching '*.hip' under directory 'deepspeed'
2023-12-27T20:14:56,581   warning: no files found matching '*.cc' under directory 'deepspeed'
2023-12-27T20:14:57,030   warning: no files found matching '*.tr' under directory 'csrc'
2023-12-27T20:14:57,121   warning: no files found matching '*.cc' under directory 'csrc'
2023-12-27T20:14:57,144   warning: no files found matching '*.py' under directory 'benchmarks'
2023-12-27T20:14:57,187   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2023-12-27T20:14:57,194   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2023-12-27T20:14:57,195   !!

2023-12-27T20:14:57,196           ********************************************************************************
2023-12-27T20:14:57,197           ############################
2023-12-27T20:14:57,197           # Package would be ignored #
2023-12-27T20:14:57,198           ############################
2023-12-27T20:14:57,199           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2023-12-27T20:14:57,199           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,201           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,201           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2023-12-27T20:14:57,202           to the `packages` configuration field.

2023-12-27T20:14:57,203           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,203           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,204           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,205           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,206           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,207           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2023-12-27T20:14:57,207           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2023-12-27T20:14:57,207           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,208           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,208           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,209           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,210           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,211           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,211                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,211                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,212                 directory, all directories are treated like packages.
2023-12-27T20:14:57,212           ********************************************************************************

2023-12-27T20:14:57,214   !!
2023-12-27T20:14:57,214     check.warn(importable)
2023-12-27T20:14:57,215   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2023-12-27T20:14:57,215   !!

2023-12-27T20:14:57,217           ********************************************************************************
2023-12-27T20:14:57,217           ############################
2023-12-27T20:14:57,218           # Package would be ignored #
2023-12-27T20:14:57,218           ############################
2023-12-27T20:14:57,219           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2023-12-27T20:14:57,220           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,221           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,221           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2023-12-27T20:14:57,222           to the `packages` configuration field.

2023-12-27T20:14:57,222           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,223           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,223           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,224           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,225           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,226           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2023-12-27T20:14:57,227           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2023-12-27T20:14:57,228           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,228           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,229           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,230           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,230           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,231           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,232                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,232                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,232                 directory, all directories are treated like packages.
2023-12-27T20:14:57,233           ********************************************************************************

2023-12-27T20:14:57,233   !!
2023-12-27T20:14:57,234     check.warn(importable)
2023-12-27T20:14:57,234   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2023-12-27T20:14:57,234   !!

2023-12-27T20:14:57,235           ********************************************************************************
2023-12-27T20:14:57,235           ############################
2023-12-27T20:14:57,236           # Package would be ignored #
2023-12-27T20:14:57,236           ############################
2023-12-27T20:14:57,236           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2023-12-27T20:14:57,237           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,238           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,238           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2023-12-27T20:14:57,239           to the `packages` configuration field.

2023-12-27T20:14:57,240           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,241           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,241           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,242           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,243           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,244           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2023-12-27T20:14:57,244           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2023-12-27T20:14:57,245           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,245           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,246           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,247           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,247           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,249           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,249                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,250                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,250                 directory, all directories are treated like packages.
2023-12-27T20:14:57,251           ********************************************************************************

2023-12-27T20:14:57,251   !!
2023-12-27T20:14:57,252     check.warn(importable)
2023-12-27T20:14:57,253   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2023-12-27T20:14:57,253   !!

2023-12-27T20:14:57,254           ********************************************************************************
2023-12-27T20:14:57,255           ############################
2023-12-27T20:14:57,255           # Package would be ignored #
2023-12-27T20:14:57,256           ############################
2023-12-27T20:14:57,256           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2023-12-27T20:14:57,256           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,257           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,257           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2023-12-27T20:14:57,258           to the `packages` configuration field.

2023-12-27T20:14:57,258           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,259           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,259           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,260           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,261           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,261           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2023-12-27T20:14:57,262           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2023-12-27T20:14:57,262           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,263           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,263           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,264           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,265           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,266           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,267                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,267                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,268                 directory, all directories are treated like packages.
2023-12-27T20:14:57,269           ********************************************************************************

2023-12-27T20:14:57,270   !!
2023-12-27T20:14:57,270     check.warn(importable)
2023-12-27T20:14:57,270   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2023-12-27T20:14:57,271   !!

2023-12-27T20:14:57,272           ********************************************************************************
2023-12-27T20:14:57,272           ############################
2023-12-27T20:14:57,273           # Package would be ignored #
2023-12-27T20:14:57,273           ############################
2023-12-27T20:14:57,273           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2023-12-27T20:14:57,274           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,275           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,275           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2023-12-27T20:14:57,276           to the `packages` configuration field.

2023-12-27T20:14:57,277           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,277           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,278           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,279           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,279           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,280           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2023-12-27T20:14:57,280           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2023-12-27T20:14:57,281           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,281           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,282           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,283           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,283           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,285           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,285                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,286                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,286                 directory, all directories are treated like packages.
2023-12-27T20:14:57,286           ********************************************************************************

2023-12-27T20:14:57,287   !!
2023-12-27T20:14:57,288     check.warn(importable)
2023-12-27T20:14:57,288   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2023-12-27T20:14:57,289   !!

2023-12-27T20:14:57,290           ********************************************************************************
2023-12-27T20:14:57,290           ############################
2023-12-27T20:14:57,291           # Package would be ignored #
2023-12-27T20:14:57,291           ############################
2023-12-27T20:14:57,292           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2023-12-27T20:14:57,292           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,293           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,294           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2023-12-27T20:14:57,294           to the `packages` configuration field.

2023-12-27T20:14:57,296           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,296           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,296           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,297           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,298           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,299           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2023-12-27T20:14:57,300           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2023-12-27T20:14:57,300           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,301           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,301           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,302           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,303           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,305           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,305                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,306                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,306                 directory, all directories are treated like packages.
2023-12-27T20:14:57,306           ********************************************************************************

2023-12-27T20:14:57,307   !!
2023-12-27T20:14:57,307     check.warn(importable)
2023-12-27T20:14:57,308   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2023-12-27T20:14:57,308   !!

2023-12-27T20:14:57,309           ********************************************************************************
2023-12-27T20:14:57,309           ############################
2023-12-27T20:14:57,309           # Package would be ignored #
2023-12-27T20:14:57,310           ############################
2023-12-27T20:14:57,310           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2023-12-27T20:14:57,310           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,311           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,312           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2023-12-27T20:14:57,312           to the `packages` configuration field.

2023-12-27T20:14:57,313           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,313           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,314           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,315           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,316           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,317           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2023-12-27T20:14:57,318           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2023-12-27T20:14:57,318           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,319           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,319           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,320           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,321           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,322           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,323                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,323                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,324                 directory, all directories are treated like packages.
2023-12-27T20:14:57,324           ********************************************************************************

2023-12-27T20:14:57,325   !!
2023-12-27T20:14:57,326     check.warn(importable)
2023-12-27T20:14:57,326   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2023-12-27T20:14:57,327   !!

2023-12-27T20:14:57,328           ********************************************************************************
2023-12-27T20:14:57,328           ############################
2023-12-27T20:14:57,329           # Package would be ignored #
2023-12-27T20:14:57,329           ############################
2023-12-27T20:14:57,330           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2023-12-27T20:14:57,331           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,332           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,332           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2023-12-27T20:14:57,333           to the `packages` configuration field.

2023-12-27T20:14:57,333           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,334           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,334           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,335           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,336           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,336           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2023-12-27T20:14:57,337           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2023-12-27T20:14:57,337           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,337           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,338           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,339           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,339           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,341           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,341                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,342                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,343                 directory, all directories are treated like packages.
2023-12-27T20:14:57,343           ********************************************************************************

2023-12-27T20:14:57,345   !!
2023-12-27T20:14:57,346     check.warn(importable)
2023-12-27T20:14:57,347   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2023-12-27T20:14:57,347   !!

2023-12-27T20:14:57,348           ********************************************************************************
2023-12-27T20:14:57,349           ############################
2023-12-27T20:14:57,350           # Package would be ignored #
2023-12-27T20:14:57,350           ############################
2023-12-27T20:14:57,351           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2023-12-27T20:14:57,351           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,352           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,353           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2023-12-27T20:14:57,353           to the `packages` configuration field.

2023-12-27T20:14:57,355           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,355           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,356           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,358           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,359           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,361           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2023-12-27T20:14:57,361           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2023-12-27T20:14:57,362           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,363           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,364           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,364           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,365           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,366           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,366                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,367                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,367                 directory, all directories are treated like packages.
2023-12-27T20:14:57,367           ********************************************************************************

2023-12-27T20:14:57,368   !!
2023-12-27T20:14:57,369     check.warn(importable)
2023-12-27T20:14:57,369   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2023-12-27T20:14:57,369   !!

2023-12-27T20:14:57,370           ********************************************************************************
2023-12-27T20:14:57,370           ############################
2023-12-27T20:14:57,371           # Package would be ignored #
2023-12-27T20:14:57,371           ############################
2023-12-27T20:14:57,372           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2023-12-27T20:14:57,372           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,373           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,374           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2023-12-27T20:14:57,374           to the `packages` configuration field.

2023-12-27T20:14:57,375           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,376           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,376           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,377           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,378           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,379           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2023-12-27T20:14:57,380           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2023-12-27T20:14:57,380           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,381           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,381           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,382           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,383           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,385           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,385                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,385                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,386                 directory, all directories are treated like packages.
2023-12-27T20:14:57,386           ********************************************************************************

2023-12-27T20:14:57,388   !!
2023-12-27T20:14:57,388     check.warn(importable)
2023-12-27T20:14:57,389   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2023-12-27T20:14:57,389   !!

2023-12-27T20:14:57,390           ********************************************************************************
2023-12-27T20:14:57,391           ############################
2023-12-27T20:14:57,391           # Package would be ignored #
2023-12-27T20:14:57,391           ############################
2023-12-27T20:14:57,392           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2023-12-27T20:14:57,392           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,393           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,393           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2023-12-27T20:14:57,393           to the `packages` configuration field.

2023-12-27T20:14:57,394           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,394           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,395           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,396           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,396           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,397           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2023-12-27T20:14:57,397           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2023-12-27T20:14:57,398           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,398           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,398           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,400           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,401           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,402           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,403                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,403                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,404                 directory, all directories are treated like packages.
2023-12-27T20:14:57,404           ********************************************************************************

2023-12-27T20:14:57,405   !!
2023-12-27T20:14:57,405     check.warn(importable)
2023-12-27T20:14:57,406   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2023-12-27T20:14:57,407   !!

2023-12-27T20:14:57,408           ********************************************************************************
2023-12-27T20:14:57,408           ############################
2023-12-27T20:14:57,409           # Package would be ignored #
2023-12-27T20:14:57,409           ############################
2023-12-27T20:14:57,409           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2023-12-27T20:14:57,410           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,411           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,412           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2023-12-27T20:14:57,412           to the `packages` configuration field.

2023-12-27T20:14:57,413           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,414           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,414           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,416           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,418           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,419           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2023-12-27T20:14:57,419           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2023-12-27T20:14:57,420           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,421           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,421           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,422           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,423           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,425           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,426                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,426                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,427                 directory, all directories are treated like packages.
2023-12-27T20:14:57,428           ********************************************************************************

2023-12-27T20:14:57,429   !!
2023-12-27T20:14:57,430     check.warn(importable)
2023-12-27T20:14:57,430   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration.
2023-12-27T20:14:57,431   !!

2023-12-27T20:14:57,433           ********************************************************************************
2023-12-27T20:14:57,434           ############################
2023-12-27T20:14:57,435           # Package would be ignored #
2023-12-27T20:14:57,435           ############################
2023-12-27T20:14:57,436           Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1],
2023-12-27T20:14:57,437           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,438           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,438           package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added
2023-12-27T20:14:57,439           to the `packages` configuration field.

2023-12-27T20:14:57,440           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,440           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,441           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,442           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,443           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,444           If you don't want 'deepspeed.ops.csrc.common' to be distributed and are
2023-12-27T20:14:57,444           already explicitly excluding 'deepspeed.ops.csrc.common' via
2023-12-27T20:14:57,445           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,445           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,446           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,447           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,448           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,449           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,450                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,450                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,451                 directory, all directories are treated like packages.
2023-12-27T20:14:57,452           ********************************************************************************

2023-12-27T20:14:57,452   !!
2023-12-27T20:14:57,453     check.warn(importable)
2023-12-27T20:14:57,453   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2023-12-27T20:14:57,453   !!

2023-12-27T20:14:57,454           ********************************************************************************
2023-12-27T20:14:57,454           ############################
2023-12-27T20:14:57,455           # Package would be ignored #
2023-12-27T20:14:57,455           ############################
2023-12-27T20:14:57,456           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2023-12-27T20:14:57,456           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,457           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,457           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2023-12-27T20:14:57,457           to the `packages` configuration field.

2023-12-27T20:14:57,458           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,458           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,459           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,459           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,460           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,461           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2023-12-27T20:14:57,462           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2023-12-27T20:14:57,463           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,463           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,463           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,464           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,465           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,466           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,467                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,467                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,468                 directory, all directories are treated like packages.
2023-12-27T20:14:57,468           ********************************************************************************

2023-12-27T20:14:57,469   !!
2023-12-27T20:14:57,470     check.warn(importable)
2023-12-27T20:14:57,470   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2023-12-27T20:14:57,470   !!

2023-12-27T20:14:57,471           ********************************************************************************
2023-12-27T20:14:57,472           ############################
2023-12-27T20:14:57,472           # Package would be ignored #
2023-12-27T20:14:57,473           ############################
2023-12-27T20:14:57,473           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2023-12-27T20:14:57,474           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,475           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,475           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2023-12-27T20:14:57,476           to the `packages` configuration field.

2023-12-27T20:14:57,477           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,477           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,478           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,478           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,479           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,480           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2023-12-27T20:14:57,480           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2023-12-27T20:14:57,480           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,481           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,481           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,482           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,483           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,484           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,484                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,484                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,485                 directory, all directories are treated like packages.
2023-12-27T20:14:57,485           ********************************************************************************

2023-12-27T20:14:57,486   !!
2023-12-27T20:14:57,487     check.warn(importable)
2023-12-27T20:14:57,487   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2023-12-27T20:14:57,488   !!

2023-12-27T20:14:57,489           ********************************************************************************
2023-12-27T20:14:57,489           ############################
2023-12-27T20:14:57,490           # Package would be ignored #
2023-12-27T20:14:57,490           ############################
2023-12-27T20:14:57,491           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2023-12-27T20:14:57,491           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,492           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,493           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2023-12-27T20:14:57,493           to the `packages` configuration field.

2023-12-27T20:14:57,494           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,494           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,495           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,496           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,497           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,498           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2023-12-27T20:14:57,498           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2023-12-27T20:14:57,499           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,499           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,500           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,501           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,502           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,503           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,503                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,504                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,504                 directory, all directories are treated like packages.
2023-12-27T20:14:57,505           ********************************************************************************

2023-12-27T20:14:57,505   !!
2023-12-27T20:14:57,506     check.warn(importable)
2023-12-27T20:14:57,506   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2023-12-27T20:14:57,507   !!

2023-12-27T20:14:57,508           ********************************************************************************
2023-12-27T20:14:57,508           ############################
2023-12-27T20:14:57,509           # Package would be ignored #
2023-12-27T20:14:57,509           ############################
2023-12-27T20:14:57,510           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2023-12-27T20:14:57,510           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,511           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,512           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2023-12-27T20:14:57,513           to the `packages` configuration field.

2023-12-27T20:14:57,514           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,514           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,515           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,516           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,517           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,519           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2023-12-27T20:14:57,519           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2023-12-27T20:14:57,520           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,521           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,521           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,523           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,524           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,526           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,527                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,527                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,528                 directory, all directories are treated like packages.
2023-12-27T20:14:57,529           ********************************************************************************

2023-12-27T20:14:57,530   !!
2023-12-27T20:14:57,531     check.warn(importable)
2023-12-27T20:14:57,531   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2023-12-27T20:14:57,532   !!

2023-12-27T20:14:57,534           ********************************************************************************
2023-12-27T20:14:57,534           ############################
2023-12-27T20:14:57,535           # Package would be ignored #
2023-12-27T20:14:57,536           ############################
2023-12-27T20:14:57,536           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2023-12-27T20:14:57,537           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,538           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,539           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2023-12-27T20:14:57,539           to the `packages` configuration field.

2023-12-27T20:14:57,540           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,541           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,541           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,542           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,544           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,545           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2023-12-27T20:14:57,545           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2023-12-27T20:14:57,546           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,546           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,547           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,548           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,549           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,551           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,552                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,553                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,554                 directory, all directories are treated like packages.
2023-12-27T20:14:57,555           ********************************************************************************

2023-12-27T20:14:57,556   !!
2023-12-27T20:14:57,557     check.warn(importable)
2023-12-27T20:14:57,558   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2023-12-27T20:14:57,558   !!

2023-12-27T20:14:57,560           ********************************************************************************
2023-12-27T20:14:57,561           ############################
2023-12-27T20:14:57,561           # Package would be ignored #
2023-12-27T20:14:57,562           ############################
2023-12-27T20:14:57,563           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2023-12-27T20:14:57,564           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,565           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,566           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2023-12-27T20:14:57,566           to the `packages` configuration field.

2023-12-27T20:14:57,568           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,568           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,569           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,571           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,572           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,573           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2023-12-27T20:14:57,574           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2023-12-27T20:14:57,574           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,575           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,575           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,577           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,578           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,580           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,580                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,581                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,582                 directory, all directories are treated like packages.
2023-12-27T20:14:57,583           ********************************************************************************

2023-12-27T20:14:57,584   !!
2023-12-27T20:14:57,585     check.warn(importable)
2023-12-27T20:14:57,585   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2023-12-27T20:14:57,586   !!

2023-12-27T20:14:57,587           ********************************************************************************
2023-12-27T20:14:57,588           ############################
2023-12-27T20:14:57,589           # Package would be ignored #
2023-12-27T20:14:57,589           ############################
2023-12-27T20:14:57,590           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2023-12-27T20:14:57,591           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,592           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,593           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2023-12-27T20:14:57,593           to the `packages` configuration field.

2023-12-27T20:14:57,594           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,595           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,596           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,597           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,598           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,600           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2023-12-27T20:14:57,600           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2023-12-27T20:14:57,601           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,602           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,602           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,604           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,605           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,607           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,607                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,608                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,608                 directory, all directories are treated like packages.
2023-12-27T20:14:57,609           ********************************************************************************

2023-12-27T20:14:57,609   !!
2023-12-27T20:14:57,610     check.warn(importable)
2023-12-27T20:14:57,611   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2023-12-27T20:14:57,611   !!

2023-12-27T20:14:57,612           ********************************************************************************
2023-12-27T20:14:57,613           ############################
2023-12-27T20:14:57,613           # Package would be ignored #
2023-12-27T20:14:57,613           ############################
2023-12-27T20:14:57,614           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2023-12-27T20:14:57,614           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,615           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,616           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2023-12-27T20:14:57,616           to the `packages` configuration field.

2023-12-27T20:14:57,617           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,618           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,618           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,619           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,620           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,621           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2023-12-27T20:14:57,621           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2023-12-27T20:14:57,622           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,622           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,623           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,624           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,625           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,626           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,627                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,628                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,628                 directory, all directories are treated like packages.
2023-12-27T20:14:57,629           ********************************************************************************

2023-12-27T20:14:57,630   !!
2023-12-27T20:14:57,630     check.warn(importable)
2023-12-27T20:14:57,631   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2023-12-27T20:14:57,631   !!

2023-12-27T20:14:57,632           ********************************************************************************
2023-12-27T20:14:57,633           ############################
2023-12-27T20:14:57,634           # Package would be ignored #
2023-12-27T20:14:57,634           ############################
2023-12-27T20:14:57,635           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2023-12-27T20:14:57,635           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,636           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,637           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2023-12-27T20:14:57,637           to the `packages` configuration field.

2023-12-27T20:14:57,638           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,639           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,639           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,640           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,640           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,641           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2023-12-27T20:14:57,642           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2023-12-27T20:14:57,642           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,643           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,643           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,644           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,645           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,646           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,646                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,647                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,647                 directory, all directories are treated like packages.
2023-12-27T20:14:57,648           ********************************************************************************

2023-12-27T20:14:57,649   !!
2023-12-27T20:14:57,649     check.warn(importable)
2023-12-27T20:14:57,649   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2023-12-27T20:14:57,650   !!

2023-12-27T20:14:57,651           ********************************************************************************
2023-12-27T20:14:57,651           ############################
2023-12-27T20:14:57,652           # Package would be ignored #
2023-12-27T20:14:57,652           ############################
2023-12-27T20:14:57,653           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2023-12-27T20:14:57,654           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,655           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,655           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2023-12-27T20:14:57,656           to the `packages` configuration field.

2023-12-27T20:14:57,657           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,657           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,658           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,659           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,660           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,660           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2023-12-27T20:14:57,661           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2023-12-27T20:14:57,662           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,662           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,663           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,664           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,665           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,666           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,666                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,666                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,667                 directory, all directories are treated like packages.
2023-12-27T20:14:57,667           ********************************************************************************

2023-12-27T20:14:57,668   !!
2023-12-27T20:14:57,669     check.warn(importable)
2023-12-27T20:14:57,669   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2023-12-27T20:14:57,670   !!

2023-12-27T20:14:57,670           ********************************************************************************
2023-12-27T20:14:57,671           ############################
2023-12-27T20:14:57,671           # Package would be ignored #
2023-12-27T20:14:57,672           ############################
2023-12-27T20:14:57,672           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2023-12-27T20:14:57,673           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,673           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,674           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2023-12-27T20:14:57,674           to the `packages` configuration field.

2023-12-27T20:14:57,675           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,676           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,676           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,677           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,678           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,680           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2023-12-27T20:14:57,680           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2023-12-27T20:14:57,681           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,681           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,682           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,682           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,683           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,685           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,685                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,686                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,687                 directory, all directories are treated like packages.
2023-12-27T20:14:57,687           ********************************************************************************

2023-12-27T20:14:57,688   !!
2023-12-27T20:14:57,689     check.warn(importable)
2023-12-27T20:14:57,689   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2023-12-27T20:14:57,690   !!

2023-12-27T20:14:57,691           ********************************************************************************
2023-12-27T20:14:57,691           ############################
2023-12-27T20:14:57,692           # Package would be ignored #
2023-12-27T20:14:57,692           ############################
2023-12-27T20:14:57,693           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2023-12-27T20:14:57,693           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,694           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,694           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2023-12-27T20:14:57,695           to the `packages` configuration field.

2023-12-27T20:14:57,696           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,696           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,697           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,698           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,699           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,701           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2023-12-27T20:14:57,701           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2023-12-27T20:14:57,701           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,702           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,703           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,704           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,705           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,707           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,707                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,708                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,708                 directory, all directories are treated like packages.
2023-12-27T20:14:57,709           ********************************************************************************

2023-12-27T20:14:57,710   !!
2023-12-27T20:14:57,710     check.warn(importable)
2023-12-27T20:14:57,711   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2023-12-27T20:14:57,712   !!

2023-12-27T20:14:57,713           ********************************************************************************
2023-12-27T20:14:57,713           ############################
2023-12-27T20:14:57,714           # Package would be ignored #
2023-12-27T20:14:57,714           ############################
2023-12-27T20:14:57,715           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2023-12-27T20:14:57,715           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,716           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,717           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2023-12-27T20:14:57,717           to the `packages` configuration field.

2023-12-27T20:14:57,719           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,719           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,720           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,721           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,722           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,723           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2023-12-27T20:14:57,723           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2023-12-27T20:14:57,724           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,724           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,725           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,726           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,727           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,728           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,729                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,730                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,730                 directory, all directories are treated like packages.
2023-12-27T20:14:57,731           ********************************************************************************

2023-12-27T20:14:57,732   !!
2023-12-27T20:14:57,732     check.warn(importable)
2023-12-27T20:14:57,733   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2023-12-27T20:14:57,733   !!

2023-12-27T20:14:57,734           ********************************************************************************
2023-12-27T20:14:57,735           ############################
2023-12-27T20:14:57,735           # Package would be ignored #
2023-12-27T20:14:57,736           ############################
2023-12-27T20:14:57,737           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2023-12-27T20:14:57,737           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,738           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,739           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2023-12-27T20:14:57,740           to the `packages` configuration field.

2023-12-27T20:14:57,741           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,742           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,742           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,743           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,744           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,746           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2023-12-27T20:14:57,746           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2023-12-27T20:14:57,747           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,748           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,748           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,750           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,751           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,753           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,753                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,754                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,754                 directory, all directories are treated like packages.
2023-12-27T20:14:57,756           ********************************************************************************

2023-12-27T20:14:57,757   !!
2023-12-27T20:14:57,757     check.warn(importable)
2023-12-27T20:14:57,758   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2023-12-27T20:14:57,758   !!

2023-12-27T20:14:57,759           ********************************************************************************
2023-12-27T20:14:57,759           ############################
2023-12-27T20:14:57,760           # Package would be ignored #
2023-12-27T20:14:57,760           ############################
2023-12-27T20:14:57,761           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2023-12-27T20:14:57,762           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,763           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,763           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2023-12-27T20:14:57,764           to the `packages` configuration field.

2023-12-27T20:14:57,765           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,765           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,766           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,767           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,768           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,769           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2023-12-27T20:14:57,769           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2023-12-27T20:14:57,770           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,770           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,771           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,772           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,773           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,775           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,775                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,776                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,776                 directory, all directories are treated like packages.
2023-12-27T20:14:57,777           ********************************************************************************

2023-12-27T20:14:57,778   !!
2023-12-27T20:14:57,778     check.warn(importable)
2023-12-27T20:14:57,779   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2023-12-27T20:14:57,779   !!

2023-12-27T20:14:57,780           ********************************************************************************
2023-12-27T20:14:57,781           ############################
2023-12-27T20:14:57,781           # Package would be ignored #
2023-12-27T20:14:57,782           ############################
2023-12-27T20:14:57,782           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2023-12-27T20:14:57,783           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,784           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,785           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2023-12-27T20:14:57,785           to the `packages` configuration field.

2023-12-27T20:14:57,787           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,787           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,787           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,788           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,789           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,790           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2023-12-27T20:14:57,791           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2023-12-27T20:14:57,791           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,792           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,793           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,794           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,795           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,796           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,797                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,797                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,798                 directory, all directories are treated like packages.
2023-12-27T20:14:57,798           ********************************************************************************

2023-12-27T20:14:57,799   !!
2023-12-27T20:14:57,800     check.warn(importable)
2023-12-27T20:14:57,800   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2023-12-27T20:14:57,801   !!

2023-12-27T20:14:57,802           ********************************************************************************
2023-12-27T20:14:57,802           ############################
2023-12-27T20:14:57,803           # Package would be ignored #
2023-12-27T20:14:57,803           ############################
2023-12-27T20:14:57,804           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2023-12-27T20:14:57,804           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,805           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,806           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2023-12-27T20:14:57,806           to the `packages` configuration field.

2023-12-27T20:14:57,808           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,808           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,809           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,810           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,811           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,812           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2023-12-27T20:14:57,812           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2023-12-27T20:14:57,813           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,813           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,814           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,815           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,816           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,817           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,818                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,818                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,819                 directory, all directories are treated like packages.
2023-12-27T20:14:57,819           ********************************************************************************

2023-12-27T20:14:57,820   !!
2023-12-27T20:14:57,821     check.warn(importable)
2023-12-27T20:14:57,821   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2023-12-27T20:14:57,822   !!

2023-12-27T20:14:57,823           ********************************************************************************
2023-12-27T20:14:57,823           ############################
2023-12-27T20:14:57,824           # Package would be ignored #
2023-12-27T20:14:57,824           ############################
2023-12-27T20:14:57,825           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2023-12-27T20:14:57,825           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,826           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,827           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2023-12-27T20:14:57,827           to the `packages` configuration field.

2023-12-27T20:14:57,828           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,829           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,829           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,830           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,831           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,833           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2023-12-27T20:14:57,833           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2023-12-27T20:14:57,834           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,834           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,835           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,836           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,837           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,839           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,839                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,840                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,841                 directory, all directories are treated like packages.
2023-12-27T20:14:57,841           ********************************************************************************

2023-12-27T20:14:57,842   !!
2023-12-27T20:14:57,843     check.warn(importable)
2023-12-27T20:14:57,843   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2023-12-27T20:14:57,844   !!

2023-12-27T20:14:57,845           ********************************************************************************
2023-12-27T20:14:57,846           ############################
2023-12-27T20:14:57,846           # Package would be ignored #
2023-12-27T20:14:57,847           ############################
2023-12-27T20:14:57,847           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2023-12-27T20:14:57,848           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,849           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,850           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2023-12-27T20:14:57,850           to the `packages` configuration field.

2023-12-27T20:14:57,851           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,851           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,852           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,853           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,854           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,855           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2023-12-27T20:14:57,855           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2023-12-27T20:14:57,856           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,856           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,857           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,858           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,859           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,860           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,861                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,861                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,862                 directory, all directories are treated like packages.
2023-12-27T20:14:57,863           ********************************************************************************

2023-12-27T20:14:57,864   !!
2023-12-27T20:14:57,864     check.warn(importable)
2023-12-27T20:14:57,865   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2023-12-27T20:14:57,865   !!

2023-12-27T20:14:57,866           ********************************************************************************
2023-12-27T20:14:57,867           ############################
2023-12-27T20:14:57,868           # Package would be ignored #
2023-12-27T20:14:57,868           ############################
2023-12-27T20:14:57,869           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2023-12-27T20:14:57,869           but it is absent from setuptools' `packages` configuration.

2023-12-27T20:14:57,870           This leads to an ambiguous overall configuration. If you want to distribute this
2023-12-27T20:14:57,871           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2023-12-27T20:14:57,872           to the `packages` configuration field.

2023-12-27T20:14:57,872           Alternatively, you can also rely on setuptools' discovery methods
2023-12-27T20:14:57,873           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-12-27T20:14:57,874           instead of `find_packages(...)`/`find:`).

2023-12-27T20:14:57,875           You can read more about "package discovery" on setuptools documentation page:

2023-12-27T20:14:57,876           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-12-27T20:14:57,877           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2023-12-27T20:14:57,878           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2023-12-27T20:14:57,878           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-12-27T20:14:57,879           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-12-27T20:14:57,879           combination with a more fine grained `package-data` configuration.

2023-12-27T20:14:57,880           You can read more about "package data files" on setuptools documentation page:

2023-12-27T20:14:57,881           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-12-27T20:14:57,883           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-12-27T20:14:57,883                 even if it does not contain any `.py` files.
2023-12-27T20:14:57,884                 On the other hand, currently there is no concept of package data
2023-12-27T20:14:57,884                 directory, all directories are treated like packages.
2023-12-27T20:14:57,885           ********************************************************************************

2023-12-27T20:14:57,886   !!
2023-12-27T20:14:57,886     check.warn(importable)
2023-12-27T20:14:57,887   creating build/lib/deepspeed/ops/csrc
2023-12-27T20:14:57,887   creating build/lib/deepspeed/ops/csrc/adagrad
2023-12-27T20:14:57,888   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2023-12-27T20:14:57,889   creating build/lib/deepspeed/ops/csrc/adam
2023-12-27T20:14:57,889   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2023-12-27T20:14:57,890   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2023-12-27T20:14:57,890   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2023-12-27T20:14:57,891   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2023-12-27T20:14:57,892   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2023-12-27T20:14:57,892   creating build/lib/deepspeed/ops/csrc/aio
2023-12-27T20:14:57,893   creating build/lib/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:57,893   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:57,894   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:57,894   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:57,895   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:57,895   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:57,896   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:57,896   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,897   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,898   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,898   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,899   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,900   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,900   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,901   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,902   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,902   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,903   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,903   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:57,903   creating build/lib/deepspeed/ops/csrc/aio/py_test
2023-12-27T20:14:57,904   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2023-12-27T20:14:57,904   creating build/lib/deepspeed/ops/csrc/common
2023-12-27T20:14:57,905   copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common
2023-12-27T20:14:57,905   creating build/lib/deepspeed/ops/csrc/cpu
2023-12-27T20:14:57,906   creating build/lib/deepspeed/ops/csrc/cpu/adam
2023-12-27T20:14:57,906   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2023-12-27T20:14:57,907   creating build/lib/deepspeed/ops/csrc/cpu/comm
2023-12-27T20:14:57,908   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2023-12-27T20:14:57,908   creating build/lib/deepspeed/ops/csrc/cpu/lion
2023-12-27T20:14:57,909   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2023-12-27T20:14:57,909   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2023-12-27T20:14:57,910   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:57,910   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:57,911   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:57,911   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:57,912   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:57,912   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:57,913   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:57,913   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-12-27T20:14:57,914   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-12-27T20:14:57,914   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-12-27T20:14:57,915   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-12-27T20:14:57,915   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-12-27T20:14:57,916   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:57,917   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:57,917   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:57,918   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:57,918   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:57,919   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:57,919   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:57,920   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:57,920   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:57,921   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:57,921   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:57,922   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:57,922   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:57,923   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:57,924   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:57,924   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:57,925   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-12-27T20:14:57,925   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-12-27T20:14:57,926   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-12-27T20:14:57,926   creating build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,927   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,927   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,928   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,928   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,929   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,929   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,930   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,931   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,931   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,932   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,932   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,933   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,934   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,934   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,934   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,935   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,935   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,936   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,937   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,937   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,938   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,938   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,939   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,940   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,940   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,941   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,941   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,942   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,942   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2023-12-27T20:14:57,943   creating build/lib/deepspeed/ops/csrc/lamb
2023-12-27T20:14:57,943   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2023-12-27T20:14:57,944   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2023-12-27T20:14:57,944   creating build/lib/deepspeed/ops/csrc/lion
2023-12-27T20:14:57,945   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2023-12-27T20:14:57,946   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2023-12-27T20:14:57,946   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2023-12-27T20:14:57,947   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2023-12-27T20:14:57,947   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2023-12-27T20:14:57,948   creating build/lib/deepspeed/ops/csrc/quantization
2023-12-27T20:14:57,949   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-12-27T20:14:57,949   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-12-27T20:14:57,950   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2023-12-27T20:14:57,950   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-12-27T20:14:57,951   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-12-27T20:14:57,951   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-12-27T20:14:57,952   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-12-27T20:14:57,953   creating build/lib/deepspeed/ops/csrc/random_ltd
2023-12-27T20:14:57,953   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2023-12-27T20:14:57,953   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2023-12-27T20:14:57,954   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2023-12-27T20:14:57,954   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2023-12-27T20:14:57,955   creating build/lib/deepspeed/ops/csrc/sparse_attention
2023-12-27T20:14:57,955   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2023-12-27T20:14:57,956   creating build/lib/deepspeed/ops/csrc/spatial
2023-12-27T20:14:57,956   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2023-12-27T20:14:57,957   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2023-12-27T20:14:57,957   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2023-12-27T20:14:57,957   creating build/lib/deepspeed/ops/csrc/spatial/includes
2023-12-27T20:14:57,958   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2023-12-27T20:14:57,958   creating build/lib/deepspeed/ops/csrc/transformer
2023-12-27T20:14:57,959   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-12-27T20:14:57,959   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-12-27T20:14:57,960   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2023-12-27T20:14:57,960   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-12-27T20:14:57,961   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-12-27T20:14:57,961   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-12-27T20:14:57,962   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-12-27T20:14:57,962   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-12-27T20:14:57,963   creating build/lib/deepspeed/ops/csrc/transformer/inference
2023-12-27T20:14:57,963   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,964   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,964   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,965   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,966   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,969   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,971   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,975   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,977   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,980   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,983   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:57,986   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-12-27T20:14:57,987   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-12-27T20:14:57,989   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-12-27T20:14:57,992   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-12-27T20:14:57,994   creating build/lib/deepspeed/ops/csrc/utils
2023-12-27T20:14:57,995   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2023-12-27T20:14:57,997   creating build/lib/deepspeed/autotuning/config_templates
2023-12-27T20:14:57,998   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2023-12-27T20:14:58,000   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2023-12-27T20:14:58,002   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2023-12-27T20:14:58,004   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2023-12-27T20:14:58,006   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-12-27T20:14:58,008   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-12-27T20:14:58,010   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-12-27T20:14:58,012   creating build/lib/deepspeed/inference/v2/ragged/csrc
2023-12-27T20:14:58,013   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2023-12-27T20:14:58,015   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2023-12-27T20:14:58,017   creating build/lib/deepspeed/inference/v2/ragged/includes
2023-12-27T20:14:58,018   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2023-12-27T20:14:58,020   creating build/lib/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:58,021   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:58,023   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:58,026   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:58,028   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:58,031   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:58,034   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2023-12-27T20:14:58,036   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2023-12-27T20:14:58,037   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2023-12-27T20:14:58,039   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2023-12-27T20:14:58,041   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2023-12-27T20:14:58,042   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2023-12-27T20:14:58,044   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-12-27T20:14:58,045   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-12-27T20:14:58,047   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-12-27T20:14:58,049   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-12-27T20:14:58,051   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2023-12-27T20:14:58,053   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:58,055   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:58,057   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:58,059   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:58,062   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:58,064   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:58,066   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:58,068   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:58,070   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:58,072   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:58,074   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:58,076   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:58,079   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:58,081   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:58,083   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-12-27T20:14:58,085   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-12-27T20:14:58,087   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:58,089   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:58,092   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:58,094   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:58,096   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:58,098   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:58,100   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:58,102   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:58,104   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:58,106   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:58,109   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:58,111   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:58,113   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:58,115   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:58,117   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:58,119   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:58,121   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:58,123   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:58,126   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:58,128   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:58,130   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:58,132   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:58,134   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:58,136   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:58,139   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:58,141   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:58,143   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:58,146   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:58,148   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:58,150   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-12-27T20:14:58,152   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-12-27T20:14:58,155   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:58,157   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:58,159   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:58,204   running build_scripts
2023-12-27T20:14:58,204   creating build/scripts-3.11
2023-12-27T20:14:58,205   copying and adjusting bin/deepspeed -> build/scripts-3.11
2023-12-27T20:14:58,207   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2023-12-27T20:14:58,208   copying and adjusting bin/ds -> build/scripts-3.11
2023-12-27T20:14:58,210   copying bin/ds_ssh -> build/scripts-3.11
2023-12-27T20:14:58,212   copying and adjusting bin/ds_report -> build/scripts-3.11
2023-12-27T20:14:58,214   copying and adjusting bin/ds_bench -> build/scripts-3.11
2023-12-27T20:14:58,215   copying and adjusting bin/dsr -> build/scripts-3.11
2023-12-27T20:14:58,216   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2023-12-27T20:14:58,217   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2023-12-27T20:14:58,218   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2023-12-27T20:14:58,218   changing mode of build/scripts-3.11/ds from 644 to 755
2023-12-27T20:14:58,219   changing mode of build/scripts-3.11/ds_report from 644 to 755
2023-12-27T20:14:58,219   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2023-12-27T20:14:58,220   changing mode of build/scripts-3.11/dsr from 644 to 755
2023-12-27T20:14:58,221   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2023-12-27T20:14:58,246   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2023-12-27T20:14:58,246   !!

2023-12-27T20:14:58,247           ********************************************************************************
2023-12-27T20:14:58,248           Please avoid running ``setup.py`` directly.
2023-12-27T20:14:58,248           Instead, use pypa/build, pypa/installer or other
2023-12-27T20:14:58,249           standards-based tools.

2023-12-27T20:14:58,250           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2023-12-27T20:14:58,251           ********************************************************************************

2023-12-27T20:14:58,252   !!
2023-12-27T20:14:58,253     self.initialize_options()
2023-12-27T20:14:58,272   installing to build/bdist.linux-armv7l/wheel
2023-12-27T20:14:58,273   running install
2023-12-27T20:14:58,297   running install_lib
2023-12-27T20:14:58,322   creating build/bdist.linux-armv7l
2023-12-27T20:14:58,323   creating build/bdist.linux-armv7l/wheel
2023-12-27T20:14:58,324   creating build/bdist.linux-armv7l/wheel/deepspeed
2023-12-27T20:14:58,326   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,327   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-12-27T20:14:58,328   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-12-27T20:14:58,331   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:58,332   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:58,333   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:58,336   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:58,337   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:58,340   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-12-27T20:14:58,342   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-12-27T20:14:58,344   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-12-27T20:14:58,346   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-12-27T20:14:58,349   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:58,350   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:58,351   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:58,354   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:58,355   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:58,358   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-12-27T20:14:58,359   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,361   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,364   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-12-27T20:14:58,365   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-12-27T20:14:58,366   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-12-27T20:14:58,368   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-12-27T20:14:58,371   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-12-27T20:14:58,373   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-12-27T20:14:58,376   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-12-27T20:14:58,378   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-12-27T20:14:58,380   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-12-27T20:14:58,382   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-12-27T20:14:58,385   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,387   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-12-27T20:14:58,388   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-12-27T20:14:58,390   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-12-27T20:14:58,391   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-12-27T20:14:58,394   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-12-27T20:14:58,396   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-12-27T20:14:58,398   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-12-27T20:14:58,400   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-12-27T20:14:58,402   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-12-27T20:14:58,404   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-12-27T20:14:58,406   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,409   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,412   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,414   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,416   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,418   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,421   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,423   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,425   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,427   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,430   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-12-27T20:14:58,431   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-12-27T20:14:58,434   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-12-27T20:14:58,436   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-12-27T20:14:58,437   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,441   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-12-27T20:14:58,442   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-12-27T20:14:58,444   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-12-27T20:14:58,446   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-12-27T20:14:58,448   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-12-27T20:14:58,451   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-12-27T20:14:58,453   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-12-27T20:14:58,456   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,459   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-12-27T20:14:58,460   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-12-27T20:14:58,461   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-12-27T20:14:58,463   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-12-27T20:14:58,465   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-12-27T20:14:58,467   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2023-12-27T20:14:58,468   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2023-12-27T20:14:58,470   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2023-12-27T20:14:58,472   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-12-27T20:14:58,473   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-12-27T20:14:58,475   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-12-27T20:14:58,477   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-12-27T20:14:58,479   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-12-27T20:14:58,482   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-12-27T20:14:58,484   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-12-27T20:14:58,489   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,490   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,493   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,498   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,500   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,503   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,507   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,509   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,511   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,514   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,516   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,521   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,523   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,526   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,528   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,531   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,535   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-12-27T20:14:58,537   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,538   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,541   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,543   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,545   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,548   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,550   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,553   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,555   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,558   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,560   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,562   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,564   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,567   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,569   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-12-27T20:14:58,571   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-12-27T20:14:58,574   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-12-27T20:14:58,575   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-12-27T20:14:58,578   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-12-27T20:14:58,580   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-12-27T20:14:58,583   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-12-27T20:14:58,585   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-12-27T20:14:58,588   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-12-27T20:14:58,591   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-12-27T20:14:58,593   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-12-27T20:14:58,596   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,597   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,600   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,602   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,605   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,607   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,609   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,612   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,614   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,616   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,619   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-12-27T20:14:58,621   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-12-27T20:14:58,623   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-12-27T20:14:58,625   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-12-27T20:14:58,627   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-12-27T20:14:58,629   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-12-27T20:14:58,632   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-12-27T20:14:58,634   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-12-27T20:14:58,637   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-12-27T20:14:58,639   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2023-12-27T20:14:58,640   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,642   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,644   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,646   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,648   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,650   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,652   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,654   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,656   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,659   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,661   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-12-27T20:14:58,663   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2023-12-27T20:14:58,665   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2023-12-27T20:14:58,666   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2023-12-27T20:14:58,668   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2023-12-27T20:14:58,671   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-12-27T20:14:58,672   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-12-27T20:14:58,674   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-12-27T20:14:58,676   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-12-27T20:14:58,679   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-12-27T20:14:58,680   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-12-27T20:14:58,682   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-12-27T20:14:58,684   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-12-27T20:14:58,689   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2023-12-27T20:14:58,690   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2023-12-27T20:14:58,693   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-12-27T20:14:58,694   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-12-27T20:14:58,696   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-12-27T20:14:58,698   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-12-27T20:14:58,701   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-12-27T20:14:58,704   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-12-27T20:14:58,707   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-12-27T20:14:58,713   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-12-27T20:14:58,715   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-12-27T20:14:58,718   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-12-27T20:14:58,720   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-12-27T20:14:58,722   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-12-27T20:14:58,725   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-12-27T20:14:58,728   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2023-12-27T20:14:58,729   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2023-12-27T20:14:58,731   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2023-12-27T20:14:58,734   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,735   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,738   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:58,745   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:58,748   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:58,750   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:58,752   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:58,754   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:58,756   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-12-27T20:14:58,758   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-12-27T20:14:58,760   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-12-27T20:14:58,762   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-12-27T20:14:58,764   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-12-27T20:14:58,766   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-12-27T20:14:58,768   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-12-27T20:14:58,770   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-12-27T20:14:58,772   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-12-27T20:14:58,774   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,777   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,779   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,781   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,783   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,786   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,788   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,790   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,792   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,794   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,796   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,797   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,800   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,802   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,804   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,806   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,807   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,809   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,811   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,813   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,815   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-12-27T20:14:58,817   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2023-12-27T20:14:58,818   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2023-12-27T20:14:58,820   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2023-12-27T20:14:58,823   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2023-12-27T20:14:58,824   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2023-12-27T20:14:58,825   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2023-12-27T20:14:58,828   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2023-12-27T20:14:58,829   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2023-12-27T20:14:58,831   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2023-12-27T20:14:58,834   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2023-12-27T20:14:58,835   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2023-12-27T20:14:58,837   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2023-12-27T20:14:58,838   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2023-12-27T20:14:58,840   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2023-12-27T20:14:58,841   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2023-12-27T20:14:58,844   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2023-12-27T20:14:58,845   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2023-12-27T20:14:58,848   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-12-27T20:14:58,849   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-12-27T20:14:58,852   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-12-27T20:14:58,854   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-12-27T20:14:58,857   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-12-27T20:14:58,861   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-12-27T20:14:58,864   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-12-27T20:14:58,866   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-12-27T20:14:58,869   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2023-12-27T20:14:58,870   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2023-12-27T20:14:58,872   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2023-12-27T20:14:58,874   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2023-12-27T20:14:58,875   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2023-12-27T20:14:58,877   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2023-12-27T20:14:58,880   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,881   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,883   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,885   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,887   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,889   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,892   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,894   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,896   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,899   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,901   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,904   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,906   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,908   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,910   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,913   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,915   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,917   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,919   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,921   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,923   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,925   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,927   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,929   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,932   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,934   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,936   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,939   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,941   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,943   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-12-27T20:14:58,946   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2023-12-27T20:14:58,947   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2023-12-27T20:14:58,949   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2023-12-27T20:14:58,950   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2023-12-27T20:14:58,953   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2023-12-27T20:14:58,954   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2023-12-27T20:14:58,957   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2023-12-27T20:14:58,958   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:58,959   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:58,962   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-12-27T20:14:58,963   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-12-27T20:14:58,966   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-12-27T20:14:58,968   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-12-27T20:14:58,971   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-12-27T20:14:58,973   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:58,975   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:58,978   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:58,982   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:58,984   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-12-27T20:14:58,987   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:58,988   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:58,991   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:58,994   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:58,996   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:58,999   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:59,001   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:59,005   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-12-27T20:14:59,007   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:59,008   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:59,010   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:59,013   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:59,016   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:59,020   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:59,023   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:59,026   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-12-27T20:14:59,029   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-12-27T20:14:59,030   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-12-27T20:14:59,033   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-12-27T20:14:59,036   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2023-12-27T20:14:59,037   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2023-12-27T20:14:59,040   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2023-12-27T20:14:59,043   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-12-27T20:14:59,044   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-12-27T20:14:59,047   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-12-27T20:14:59,049   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-12-27T20:14:59,052   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-12-27T20:14:59,054   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-12-27T20:14:59,058   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2023-12-27T20:14:59,059   copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2023-12-27T20:14:59,062   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-12-27T20:14:59,063   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-12-27T20:14:59,066   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-12-27T20:14:59,069   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-12-27T20:14:59,071   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-12-27T20:14:59,074   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-12-27T20:14:59,077   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2023-12-27T20:14:59,078   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2023-12-27T20:14:59,080   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2023-12-27T20:14:59,083   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,084   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,087   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,090   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,092   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,094   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,097   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,099   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,101   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,103   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,105   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,108   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-12-27T20:14:59,111   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:59,112   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:59,114   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:59,116   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:59,118   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:59,120   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:59,122   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-12-27T20:14:59,125   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-12-27T20:14:59,126   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-12-27T20:14:59,128   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-12-27T20:14:59,130   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-12-27T20:14:59,132   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-12-27T20:14:59,135   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-12-27T20:14:59,136   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-12-27T20:14:59,139   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-12-27T20:14:59,142   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-12-27T20:14:59,144   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-12-27T20:14:59,146   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-12-27T20:14:59,149   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-12-27T20:14:59,151   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2023-12-27T20:14:59,153   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-12-27T20:14:59,153   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-12-27T20:14:59,156   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-12-27T20:14:59,158   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-12-27T20:14:59,161   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,162   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,165   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,168   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,170   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,172   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,174   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,176   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,179   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,181   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,183   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-12-27T20:14:59,185   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-12-27T20:14:59,189   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-12-27T20:14:59,192   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-12-27T20:14:59,193   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-12-27T20:14:59,195   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-12-27T20:14:59,196   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-12-27T20:14:59,198   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-12-27T20:14:59,201   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-12-27T20:14:59,202   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-12-27T20:14:59,204   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-12-27T20:14:59,205   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-12-27T20:14:59,207   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-12-27T20:14:59,210   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2023-12-27T20:14:59,210   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2023-12-27T20:14:59,213   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2023-12-27T20:14:59,213   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2023-12-27T20:14:59,215   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2023-12-27T20:14:59,217   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2023-12-27T20:14:59,218   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2023-12-27T20:14:59,220   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2023-12-27T20:14:59,223   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,224   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,226   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,228   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,230   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,232   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,235   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,236   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,238   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,240   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,242   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,244   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,247   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,248   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,251   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,252   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,254   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-12-27T20:14:59,256   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,258   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,261   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,261   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,263   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,265   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,267   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,269   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,271   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,272   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,274   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,276   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,278   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-12-27T20:14:59,280   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,282   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,284   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-12-27T20:14:59,286   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-12-27T20:14:59,287   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-12-27T20:14:59,289   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-12-27T20:14:59,290   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-12-27T20:14:59,292   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-12-27T20:14:59,294   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-12-27T20:14:59,296   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-12-27T20:14:59,297   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-12-27T20:14:59,299   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-12-27T20:14:59,301   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-12-27T20:14:59,303   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-12-27T20:14:59,304   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-12-27T20:14:59,305   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-12-27T20:14:59,308   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-12-27T20:14:59,310   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-12-27T20:14:59,311   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-12-27T20:14:59,313   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-12-27T20:14:59,315   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-12-27T20:14:59,316   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-12-27T20:14:59,319   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-12-27T20:14:59,320   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-12-27T20:14:59,323   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-12-27T20:14:59,325   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-12-27T20:14:59,328   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-12-27T20:14:59,328   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-12-27T20:14:59,330   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-12-27T20:14:59,332   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-12-27T20:14:59,334   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-12-27T20:14:59,336   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-12-27T20:14:59,338   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-12-27T20:14:59,340   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-12-27T20:14:59,341   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-12-27T20:14:59,343   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-12-27T20:14:59,344   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-12-27T20:14:59,346   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-12-27T20:14:59,348   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-12-27T20:14:59,350   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2023-12-27T20:14:59,351   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2023-12-27T20:14:59,353   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,354   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,357   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,360   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,361   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,363   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,365   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,366   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,368   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,370   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,372   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,374   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,376   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,378   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,380   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,382   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,384   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,386   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,388   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,390   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,392   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,394   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,397   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-12-27T20:14:59,398   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-12-27T20:14:59,400   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-12-27T20:14:59,402   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-12-27T20:14:59,405   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-12-27T20:14:59,407   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-12-27T20:14:59,409   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-12-27T20:14:59,411   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-12-27T20:14:59,413   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-12-27T20:14:59,415   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,417   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,419   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,420   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,422   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,424   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,427   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,429   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,431   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,433   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,435   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-12-27T20:14:59,437   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-12-27T20:14:59,438   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-12-27T20:14:59,440   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-12-27T20:14:59,442   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-12-27T20:14:59,444   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-12-27T20:14:59,447   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-12-27T20:14:59,449   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-12-27T20:14:59,451   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-12-27T20:14:59,454   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-12-27T20:14:59,456   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-12-27T20:14:59,457   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-12-27T20:14:59,460   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-12-27T20:14:59,462   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-12-27T20:14:59,464   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-12-27T20:14:59,465   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-12-27T20:14:59,468   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-12-27T20:14:59,470   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-12-27T20:14:59,472   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-12-27T20:14:59,473   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-12-27T20:14:59,475   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-12-27T20:14:59,476   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-12-27T20:14:59,478   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-12-27T20:14:59,480   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-12-27T20:14:59,482   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-12-27T20:14:59,484   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-12-27T20:14:59,487   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-12-27T20:14:59,488   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-12-27T20:14:59,489   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-12-27T20:14:59,491   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-12-27T20:14:59,493   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-12-27T20:14:59,495   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-12-27T20:14:59,497   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-12-27T20:14:59,499   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-12-27T20:14:59,501   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-12-27T20:14:59,504   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-12-27T20:14:59,504   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-12-27T20:14:59,506   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-12-27T20:14:59,508   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-12-27T20:14:59,510   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-12-27T20:14:59,512   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-12-27T20:14:59,514   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2023-12-27T20:14:59,515   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2023-12-27T20:14:59,517   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2023-12-27T20:14:59,518   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2023-12-27T20:14:59,520   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2023-12-27T20:14:59,523   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:59,524   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:59,526   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2023-12-27T20:14:59,527   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2023-12-27T20:14:59,530   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2023-12-27T20:14:59,531   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2023-12-27T20:14:59,533   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2023-12-27T20:14:59,535   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2023-12-27T20:14:59,536   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2023-12-27T20:14:59,538   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2023-12-27T20:14:59,539   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2023-12-27T20:14:59,541   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2023-12-27T20:14:59,543   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:59,546   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2023-12-27T20:14:59,546   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2023-12-27T20:14:59,549   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2023-12-27T20:14:59,551   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2023-12-27T20:14:59,553   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2023-12-27T20:14:59,555   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:59,556   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:59,558   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:59,560   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:59,562   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:59,563   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:59,566   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:59,567   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:59,570   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:59,571   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-12-27T20:14:59,573   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:59,574   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:59,576   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:59,578   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:59,581   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2023-12-27T20:14:59,582   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2023-12-27T20:14:59,584   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2023-12-27T20:14:59,586   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2023-12-27T20:14:59,588   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2023-12-27T20:14:59,590   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:59,591   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:59,592   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:59,594   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:59,596   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:59,598   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:59,599   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:59,601   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:59,603   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:59,605   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-12-27T20:14:59,606   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-12-27T20:14:59,609   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2023-12-27T20:14:59,610   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2023-12-27T20:14:59,612   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2023-12-27T20:14:59,614   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2023-12-27T20:14:59,616   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2023-12-27T20:14:59,618   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2023-12-27T20:14:59,619   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2023-12-27T20:14:59,621   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2023-12-27T20:14:59,623   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2023-12-27T20:14:59,624   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2023-12-27T20:14:59,625   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2023-12-27T20:14:59,627   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2023-12-27T20:14:59,629   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2023-12-27T20:14:59,630   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2023-12-27T20:14:59,632   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2023-12-27T20:14:59,634   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2023-12-27T20:14:59,636   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2023-12-27T20:14:59,638   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2023-12-27T20:14:59,639   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2023-12-27T20:14:59,641   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2023-12-27T20:14:59,644   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2023-12-27T20:14:59,644   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2023-12-27T20:14:59,647   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2023-12-27T20:14:59,649   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2023-12-27T20:14:59,649   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2023-12-27T20:14:59,651   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2023-12-27T20:14:59,653   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2023-12-27T20:14:59,654   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2023-12-27T20:14:59,656   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2023-12-27T20:14:59,658   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2023-12-27T20:14:59,659   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2023-12-27T20:14:59,660   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2023-12-27T20:14:59,663   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2023-12-27T20:14:59,664   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2023-12-27T20:14:59,666   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:59,667   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:59,669   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:59,671   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:59,673   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:59,674   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:59,676   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:59,678   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-12-27T20:14:59,680   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:59,681   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:59,683   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:59,685   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:59,687   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:59,688   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:59,690   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:59,692   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:59,693   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-12-27T20:14:59,696   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-12-27T20:14:59,696   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-12-27T20:14:59,699   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2023-12-27T20:14:59,700   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2023-12-27T20:14:59,702   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-12-27T20:14:59,704   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-12-27T20:14:59,706   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-12-27T20:14:59,708   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-12-27T20:14:59,710   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-12-27T20:14:59,712   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-12-27T20:14:59,715   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2023-12-27T20:14:59,716   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2023-12-27T20:14:59,718   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2023-12-27T20:14:59,720   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2023-12-27T20:14:59,722   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:59,723   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:59,725   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:59,727   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:59,730   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:59,732   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2023-12-27T20:14:59,734   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2023-12-27T20:14:59,736   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2023-12-27T20:14:59,737   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2023-12-27T20:14:59,739   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2023-12-27T20:14:59,741   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:59,742   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:59,743   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:59,745   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:59,747   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:59,749   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:59,751   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-12-27T20:14:59,753   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:59,754   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:59,756   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:59,757   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:59,759   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:59,761   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-12-27T20:14:59,763   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2023-12-27T20:14:59,764   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2023-12-27T20:14:59,766   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2023-12-27T20:14:59,768   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:59,769   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:59,771   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:59,773   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:59,775   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:59,777   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:59,779   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-12-27T20:14:59,781   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2023-12-27T20:14:59,782   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2023-12-27T20:14:59,784   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-12-27T20:14:59,785   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-12-27T20:14:59,786   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-12-27T20:14:59,788   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-12-27T20:14:59,790   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:59,791   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:59,793   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:59,794   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:59,796   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:59,798   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:59,800   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-12-27T20:14:59,802   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2023-12-27T20:14:59,804   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-12-27T20:14:59,805   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-12-27T20:14:59,807   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-12-27T20:14:59,809   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-12-27T20:14:59,811   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-12-27T20:14:59,813   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:59,814   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:59,816   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:59,818   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:59,820   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:59,821   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:59,823   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2023-12-27T20:14:59,825   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:59,826   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:59,828   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:59,829   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:59,831   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:59,833   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:59,835   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-12-27T20:14:59,837   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:59,838   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:59,840   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:59,842   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:59,844   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:59,846   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:59,848   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-12-27T20:14:59,850   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:59,851   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:59,853   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:59,855   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:59,857   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:59,859   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:59,860   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-12-27T20:14:59,863   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:59,864   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:59,865   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:59,867   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:59,869   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:59,871   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:59,873   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:59,875   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:59,877   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-12-27T20:14:59,879   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2023-12-27T20:14:59,881   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2023-12-27T20:14:59,882   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2023-12-27T20:14:59,884   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:59,885   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:59,887   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:59,889   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:59,892   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:59,894   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-12-27T20:14:59,896   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:59,897   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:59,899   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:59,901   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:59,902   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:59,905   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:59,907   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:59,909   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-12-27T20:14:59,911   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:59,912   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:59,915   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:59,917   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:59,918   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:59,920   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:59,922   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:59,925   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:59,927   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-12-27T20:14:59,929   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-12-27T20:14:59,930   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-12-27T20:14:59,932   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-12-27T20:14:59,934   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-12-27T20:14:59,936   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-12-27T20:14:59,939   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:59,939   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:59,942   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:59,943   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:59,945   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:59,947   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-12-27T20:14:59,949   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2023-12-27T20:14:59,950   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2023-12-27T20:14:59,952   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-12-27T20:14:59,954   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-12-27T20:14:59,956   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-12-27T20:14:59,958   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-12-27T20:14:59,960   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-12-27T20:14:59,963   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-12-27T20:14:59,964   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2023-12-27T20:14:59,965   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2023-12-27T20:14:59,967   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2023-12-27T20:14:59,970   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-12-27T20:14:59,972   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-12-27T20:14:59,974   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-12-27T20:14:59,976   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2023-12-27T20:14:59,977   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2023-12-27T20:14:59,979   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2023-12-27T20:14:59,981   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-12-27T20:14:59,982   running install_egg_info
2023-12-27T20:15:00,013   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.12.6-py3.11.egg-info
2023-12-27T20:15:00,026   running install_scripts
2023-12-27T20:15:00,027   creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data
2023-12-27T20:15:00,027   creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts
2023-12-27T20:15:00,028   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts
2023-12-27T20:15:00,030   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts
2023-12-27T20:15:00,032   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts
2023-12-27T20:15:00,033   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts
2023-12-27T20:15:00,035   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts
2023-12-27T20:15:00,036   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts
2023-12-27T20:15:00,038   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts
2023-12-27T20:15:00,039   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts
2023-12-27T20:15:00,041   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts/ds to 755
2023-12-27T20:15:00,042   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts/ds_bench to 755
2023-12-27T20:15:00,042   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts/dsr to 755
2023-12-27T20:15:00,042   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts/ds_ssh to 755
2023-12-27T20:15:00,043   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts/ds_report to 755
2023-12-27T20:15:00,043   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts/deepspeed to 755
2023-12-27T20:15:00,044   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts/deepspeed.pt to 755
2023-12-27T20:15:00,045   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.data/scripts/ds_elastic to 755
2023-12-27T20:15:00,084   creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.6.dist-info/WHEEL
2023-12-27T20:15:00,086   creating '/tmp/pip-wheel-n6130f2k/deepspeed-0.12.6-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-12-27T20:15:00,089   adding 'deepspeed/__init__.py'
2023-12-27T20:15:00,091   adding 'deepspeed/constants.py'
2023-12-27T20:15:00,093   adding 'deepspeed/env_report.py'
2023-12-27T20:15:00,094   adding 'deepspeed/git_version_info.py'
2023-12-27T20:15:00,096   adding 'deepspeed/git_version_info_installed.py'
2023-12-27T20:15:00,097   adding 'deepspeed/pydantic_v1.py'
2023-12-27T20:15:00,099   adding 'deepspeed/accelerator/__init__.py'
2023-12-27T20:15:00,100   adding 'deepspeed/accelerator/abstract_accelerator.py'
2023-12-27T20:15:00,102   adding 'deepspeed/accelerator/cpu_accelerator.py'
2023-12-27T20:15:00,105   adding 'deepspeed/accelerator/cuda_accelerator.py'
2023-12-27T20:15:00,106   adding 'deepspeed/accelerator/mps_accelerator.py'
2023-12-27T20:15:00,108   adding 'deepspeed/accelerator/npu_accelerator.py'
2023-12-27T20:15:00,110   adding 'deepspeed/accelerator/real_accelerator.py'
2023-12-27T20:15:00,112   adding 'deepspeed/autotuning/__init__.py'
2023-12-27T20:15:00,117   adding 'deepspeed/autotuning/autotuner.py'
2023-12-27T20:15:00,119   adding 'deepspeed/autotuning/config.py'
2023-12-27T20:15:00,121   adding 'deepspeed/autotuning/constants.py'
2023-12-27T20:15:00,123   adding 'deepspeed/autotuning/scheduler.py'
2023-12-27T20:15:00,125   adding 'deepspeed/autotuning/utils.py'
2023-12-27T20:15:00,127   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2023-12-27T20:15:00,128   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2023-12-27T20:15:00,129   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2023-12-27T20:15:00,130   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2023-12-27T20:15:00,132   adding 'deepspeed/autotuning/tuner/__init__.py'
2023-12-27T20:15:00,133   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2023-12-27T20:15:00,134   adding 'deepspeed/autotuning/tuner/cost_model.py'
2023-12-27T20:15:00,135   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2023-12-27T20:15:00,137   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2023-12-27T20:15:00,138   adding 'deepspeed/autotuning/tuner/utils.py'
2023-12-27T20:15:00,140   adding 'deepspeed/checkpoint/__init__.py'
2023-12-27T20:15:00,141   adding 'deepspeed/checkpoint/constants.py'
2023-12-27T20:15:00,143   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2023-12-27T20:15:00,145   adding 'deepspeed/checkpoint/ds_to_universal.py'
2023-12-27T20:15:00,147   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2023-12-27T20:15:00,148   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2023-12-27T20:15:00,150   adding 'deepspeed/checkpoint/reshape_utils.py'
2023-12-27T20:15:00,151   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2023-12-27T20:15:00,153   adding 'deepspeed/checkpoint/utils.py'
2023-12-27T20:15:00,154   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2023-12-27T20:15:00,156   adding 'deepspeed/comm/__init__.py'
2023-12-27T20:15:00,157   adding 'deepspeed/comm/backend.py'
2023-12-27T20:15:00,159   adding 'deepspeed/comm/ccl.py'
2023-12-27T20:15:00,162   adding 'deepspeed/comm/comm.py'
2023-12-27T20:15:00,163   adding 'deepspeed/comm/config.py'
2023-12-27T20:15:00,165   adding 'deepspeed/comm/constants.py'
2023-12-27T20:15:00,166   adding 'deepspeed/comm/reduce_op.py'
2023-12-27T20:15:00,168   adding 'deepspeed/comm/torch.py'
2023-12-27T20:15:00,169   adding 'deepspeed/comm/utils.py'
2023-12-27T20:15:00,171   adding 'deepspeed/compression/__init__.py'
2023-12-27T20:15:00,174   adding 'deepspeed/compression/basic_layer.py'
2023-12-27T20:15:00,176   adding 'deepspeed/compression/compress.py'
2023-12-27T20:15:00,178   adding 'deepspeed/compression/config.py'
2023-12-27T20:15:00,180   adding 'deepspeed/compression/constants.py'
2023-12-27T20:15:00,182   adding 'deepspeed/compression/helper.py'
2023-12-27T20:15:00,183   adding 'deepspeed/compression/scheduler.py'
2023-12-27T20:15:00,185   adding 'deepspeed/compression/utils.py'
2023-12-27T20:15:00,187   adding 'deepspeed/elasticity/__init__.py'
2023-12-27T20:15:00,188   adding 'deepspeed/elasticity/config.py'
2023-12-27T20:15:00,190   adding 'deepspeed/elasticity/constants.py'
2023-12-27T20:15:00,191   adding 'deepspeed/elasticity/elastic_agent.py'
2023-12-27T20:15:00,193   adding 'deepspeed/elasticity/elasticity.py'
2023-12-27T20:15:00,195   adding 'deepspeed/elasticity/utils.py'
2023-12-27T20:15:00,196   adding 'deepspeed/inference/__init__.py'
2023-12-27T20:15:00,198   adding 'deepspeed/inference/config.py'
2023-12-27T20:15:00,202   adding 'deepspeed/inference/engine.py'
2023-12-27T20:15:00,204   adding 'deepspeed/inference/quantization/__init__.py'
2023-12-27T20:15:00,205   adding 'deepspeed/inference/quantization/layers.py'
2023-12-27T20:15:00,207   adding 'deepspeed/inference/quantization/quantization.py'
2023-12-27T20:15:00,208   adding 'deepspeed/inference/quantization/quantization_context.py'
2023-12-27T20:15:00,210   adding 'deepspeed/inference/quantization/utils.py'
2023-12-27T20:15:00,211   adding 'deepspeed/inference/v2/__init__.py'
2023-12-27T20:15:00,213   adding 'deepspeed/inference/v2/allocator.py'
2023-12-27T20:15:00,214   adding 'deepspeed/inference/v2/config_v2.py'
2023-12-27T20:15:00,215   adding 'deepspeed/inference/v2/engine_factory.py'
2023-12-27T20:15:00,217   adding 'deepspeed/inference/v2/engine_v2.py'
2023-12-27T20:15:00,218   adding 'deepspeed/inference/v2/inference_parameter.py'
2023-12-27T20:15:00,220   adding 'deepspeed/inference/v2/inference_utils.py'
2023-12-27T20:15:00,221   adding 'deepspeed/inference/v2/logging.py'
2023-12-27T20:15:00,222   adding 'deepspeed/inference/v2/scheduling_utils.py'
2023-12-27T20:15:00,224   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2023-12-27T20:15:00,225   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2023-12-27T20:15:00,226   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2023-12-27T20:15:00,227   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2023-12-27T20:15:00,229   adding 'deepspeed/inference/v2/kernels/__init__.py'
2023-12-27T20:15:00,230   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2023-12-27T20:15:00,232   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2023-12-27T20:15:00,233   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2023-12-27T20:15:00,235   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2023-12-27T20:15:00,236   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2023-12-27T20:15:00,238   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu'
2023-12-27T20:15:00,239   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2023-12-27T20:15:00,240   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2023-12-27T20:15:00,242   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2023-12-27T20:15:00,243   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2023-12-27T20:15:00,244   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2023-12-27T20:15:00,246   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2023-12-27T20:15:00,248   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2023-12-27T20:15:00,249   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2023-12-27T20:15:00,250   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2023-12-27T20:15:00,251   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2023-12-27T20:15:00,253   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2023-12-27T20:15:00,254   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2023-12-27T20:15:00,256   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu'
2023-12-27T20:15:00,257   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2023-12-27T20:15:00,259   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2023-12-27T20:15:00,261   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2023-12-27T20:15:00,262   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu'
2023-12-27T20:15:00,263   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2023-12-27T20:15:00,265   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2023-12-27T20:15:00,266   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2023-12-27T20:15:00,267   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2023-12-27T20:15:00,269   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2023-12-27T20:15:00,270   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2023-12-27T20:15:00,271   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2023-12-27T20:15:00,273   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu'
2023-12-27T20:15:00,274   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2023-12-27T20:15:00,276   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2023-12-27T20:15:00,277   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2023-12-27T20:15:00,278   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2023-12-27T20:15:00,280   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2023-12-27T20:15:00,281   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2023-12-27T20:15:00,282   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2023-12-27T20:15:00,283   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2023-12-27T20:15:00,285   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2023-12-27T20:15:00,286   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2023-12-27T20:15:00,287   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2023-12-27T20:15:00,288   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2023-12-27T20:15:00,290   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2023-12-27T20:15:00,291   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2023-12-27T20:15:00,292   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2023-12-27T20:15:00,294   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2023-12-27T20:15:00,295   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2023-12-27T20:15:00,297   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2023-12-27T20:15:00,299   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2023-12-27T20:15:00,302   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2023-12-27T20:15:00,303   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2023-12-27T20:15:00,305   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2023-12-27T20:15:00,306   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2023-12-27T20:15:00,308   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2023-12-27T20:15:00,309   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2023-12-27T20:15:00,310   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2023-12-27T20:15:00,312   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2023-12-27T20:15:00,313   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2023-12-27T20:15:00,314   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2023-12-27T20:15:00,316   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2023-12-27T20:15:00,317   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2023-12-27T20:15:00,318   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2023-12-27T20:15:00,320   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2023-12-27T20:15:00,321   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2023-12-27T20:15:00,323   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu'
2023-12-27T20:15:00,324   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2023-12-27T20:15:00,325   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2023-12-27T20:15:00,327   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2023-12-27T20:15:00,328   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2023-12-27T20:15:00,330   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2023-12-27T20:15:00,332   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2023-12-27T20:15:00,333   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu'
2023-12-27T20:15:00,335   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2023-12-27T20:15:00,336   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2023-12-27T20:15:00,338   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2023-12-27T20:15:00,339   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2023-12-27T20:15:00,340   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2023-12-27T20:15:00,342   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2023-12-27T20:15:00,343   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2023-12-27T20:15:00,344   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu'
2023-12-27T20:15:00,345   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2023-12-27T20:15:00,346   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2023-12-27T20:15:00,348   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2023-12-27T20:15:00,349   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2023-12-27T20:15:00,351   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2023-12-27T20:15:00,352   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu'
2023-12-27T20:15:00,353   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2023-12-27T20:15:00,354   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2023-12-27T20:15:00,356   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2023-12-27T20:15:00,357   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2023-12-27T20:15:00,359   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2023-12-27T20:15:00,360   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu'
2023-12-27T20:15:00,362   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2023-12-27T20:15:00,363   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2023-12-27T20:15:00,364   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2023-12-27T20:15:00,366   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2023-12-27T20:15:00,367   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2023-12-27T20:15:00,368   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2023-12-27T20:15:00,370   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2023-12-27T20:15:00,371   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2023-12-27T20:15:00,373   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cu'
2023-12-27T20:15:00,374   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2023-12-27T20:15:00,375   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2023-12-27T20:15:00,377   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2023-12-27T20:15:00,378   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2023-12-27T20:15:00,380   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2023-12-27T20:15:00,382   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2023-12-27T20:15:00,384   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2023-12-27T20:15:00,386   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2023-12-27T20:15:00,389   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2023-12-27T20:15:00,391   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2023-12-27T20:15:00,392   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2023-12-27T20:15:00,393   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2023-12-27T20:15:00,395   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2023-12-27T20:15:00,396   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2023-12-27T20:15:00,397   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2023-12-27T20:15:00,399   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2023-12-27T20:15:00,400   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2023-12-27T20:15:00,401   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2023-12-27T20:15:00,402   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2023-12-27T20:15:00,404   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2023-12-27T20:15:00,405   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2023-12-27T20:15:00,407   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2023-12-27T20:15:00,408   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2023-12-27T20:15:00,410   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2023-12-27T20:15:00,411   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2023-12-27T20:15:00,412   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2023-12-27T20:15:00,414   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2023-12-27T20:15:00,415   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2023-12-27T20:15:00,416   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2023-12-27T20:15:00,418   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2023-12-27T20:15:00,419   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2023-12-27T20:15:00,421   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2023-12-27T20:15:00,422   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2023-12-27T20:15:00,424   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2023-12-27T20:15:00,425   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2023-12-27T20:15:00,427   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2023-12-27T20:15:00,428   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2023-12-27T20:15:00,430   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2023-12-27T20:15:00,431   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2023-12-27T20:15:00,433   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2023-12-27T20:15:00,434   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2023-12-27T20:15:00,435   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2023-12-27T20:15:00,437   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2023-12-27T20:15:00,438   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2023-12-27T20:15:00,439   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2023-12-27T20:15:00,441   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2023-12-27T20:15:00,442   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2023-12-27T20:15:00,443   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2023-12-27T20:15:00,445   adding 'deepspeed/inference/v2/modules/__init__.py'
2023-12-27T20:15:00,446   adding 'deepspeed/inference/v2/modules/ds_module.py'
2023-12-27T20:15:00,448   adding 'deepspeed/inference/v2/modules/heuristics.py'
2023-12-27T20:15:00,449   adding 'deepspeed/inference/v2/modules/module_registry.py'
2023-12-27T20:15:00,451   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2023-12-27T20:15:00,452   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2023-12-27T20:15:00,453   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2023-12-27T20:15:00,454   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2023-12-27T20:15:00,455   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2023-12-27T20:15:00,456   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2023-12-27T20:15:00,457   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2023-12-27T20:15:00,459   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2023-12-27T20:15:00,460   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2023-12-27T20:15:00,462   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2023-12-27T20:15:00,463   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2023-12-27T20:15:00,465   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2023-12-27T20:15:00,466   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2023-12-27T20:15:00,467   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2023-12-27T20:15:00,470   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2023-12-27T20:15:00,471   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2023-12-27T20:15:00,473   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2023-12-27T20:15:00,475   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2023-12-27T20:15:00,476   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2023-12-27T20:15:00,477   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2023-12-27T20:15:00,479   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2023-12-27T20:15:00,480   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2023-12-27T20:15:00,482   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2023-12-27T20:15:00,484   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2023-12-27T20:15:00,485   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2023-12-27T20:15:00,486   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2023-12-27T20:15:00,488   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2023-12-27T20:15:00,489   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2023-12-27T20:15:00,490   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2023-12-27T20:15:00,492   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2023-12-27T20:15:00,493   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2023-12-27T20:15:00,495   adding 'deepspeed/inference/v2/ragged/__init__.py'
2023-12-27T20:15:00,496   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2023-12-27T20:15:00,498   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2023-12-27T20:15:00,499   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2023-12-27T20:15:00,501   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2023-12-27T20:15:00,503   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2023-12-27T20:15:00,505   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2023-12-27T20:15:00,506   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2023-12-27T20:15:00,508   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2023-12-27T20:15:00,510   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2023-12-27T20:15:00,511   adding 'deepspeed/launcher/__init__.py'
2023-12-27T20:15:00,512   adding 'deepspeed/launcher/constants.py'
2023-12-27T20:15:00,514   adding 'deepspeed/launcher/launch.py'
2023-12-27T20:15:00,516   adding 'deepspeed/launcher/multinode_runner.py'
2023-12-27T20:15:00,519   adding 'deepspeed/launcher/runner.py'
2023-12-27T20:15:00,521   adding 'deepspeed/model_implementations/__init__.py'
2023-12-27T20:15:00,522   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2023-12-27T20:15:00,523   adding 'deepspeed/model_implementations/diffusers/unet.py'
2023-12-27T20:15:00,525   adding 'deepspeed/model_implementations/diffusers/vae.py'
2023-12-27T20:15:00,526   adding 'deepspeed/model_implementations/features/__init__.py'
2023-12-27T20:15:00,527   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2023-12-27T20:15:00,529   adding 'deepspeed/model_implementations/transformers/__init__.py'
2023-12-27T20:15:00,530   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2023-12-27T20:15:00,531   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2023-12-27T20:15:00,532   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2023-12-27T20:15:00,533   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2023-12-27T20:15:00,535   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2023-12-27T20:15:00,536   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2023-12-27T20:15:00,537   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2023-12-27T20:15:00,538   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2023-12-27T20:15:00,540   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2023-12-27T20:15:00,541   adding 'deepspeed/module_inject/__init__.py'
2023-12-27T20:15:00,544   adding 'deepspeed/module_inject/auto_tp.py'
2023-12-27T20:15:00,546   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2023-12-27T20:15:00,547   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2023-12-27T20:15:00,548   adding 'deepspeed/module_inject/inject.py'
2023-12-27T20:15:00,550   adding 'deepspeed/module_inject/layers.py'
2023-12-27T20:15:00,552   adding 'deepspeed/module_inject/load_checkpoint.py'
2023-12-27T20:15:00,553   adding 'deepspeed/module_inject/module_quantize.py'
2023-12-27T20:15:00,555   adding 'deepspeed/module_inject/policy.py'
2023-12-27T20:15:00,558   adding 'deepspeed/module_inject/replace_module.py'
2023-12-27T20:15:00,559   adding 'deepspeed/module_inject/replace_policy.py'
2023-12-27T20:15:00,561   adding 'deepspeed/module_inject/tp_shard.py'
2023-12-27T20:15:00,562   adding 'deepspeed/module_inject/utils.py'
2023-12-27T20:15:00,564   adding 'deepspeed/module_inject/containers/__init__.py'
2023-12-27T20:15:00,566   adding 'deepspeed/module_inject/containers/base.py'
2023-12-27T20:15:00,567   adding 'deepspeed/module_inject/containers/base_moe.py'
2023-12-27T20:15:00,569   adding 'deepspeed/module_inject/containers/bert.py'
2023-12-27T20:15:00,570   adding 'deepspeed/module_inject/containers/bloom.py'
2023-12-27T20:15:00,571   adding 'deepspeed/module_inject/containers/clip.py'
2023-12-27T20:15:00,573   adding 'deepspeed/module_inject/containers/distil_bert.py'
2023-12-27T20:15:00,574   adding 'deepspeed/module_inject/containers/gpt2.py'
2023-12-27T20:15:00,575   adding 'deepspeed/module_inject/containers/gptj.py'
2023-12-27T20:15:00,577   adding 'deepspeed/module_inject/containers/gptneo.py'
2023-12-27T20:15:00,578   adding 'deepspeed/module_inject/containers/gptneox.py'
2023-12-27T20:15:00,580   adding 'deepspeed/module_inject/containers/internlm.py'
2023-12-27T20:15:00,582   adding 'deepspeed/module_inject/containers/llama.py'
2023-12-27T20:15:00,583   adding 'deepspeed/module_inject/containers/llama2.py'
2023-12-27T20:15:00,585   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2023-12-27T20:15:00,586   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2023-12-27T20:15:00,587   adding 'deepspeed/module_inject/containers/opt.py'
2023-12-27T20:15:00,589   adding 'deepspeed/module_inject/containers/unet.py'
2023-12-27T20:15:00,590   adding 'deepspeed/module_inject/containers/vae.py'
2023-12-27T20:15:00,591   adding 'deepspeed/module_inject/containers/features/__init__.py'
2023-12-27T20:15:00,592   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2023-12-27T20:15:00,594   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2023-12-27T20:15:00,595   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2023-12-27T20:15:00,596   adding 'deepspeed/module_inject/containers/features/megatron.py'
2023-12-27T20:15:00,598   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2023-12-27T20:15:00,599   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2023-12-27T20:15:00,601   adding 'deepspeed/moe/__init__.py'
2023-12-27T20:15:00,602   adding 'deepspeed/moe/experts.py'
2023-12-27T20:15:00,603   adding 'deepspeed/moe/layer.py'
2023-12-27T20:15:00,605   adding 'deepspeed/moe/mappings.py'
2023-12-27T20:15:00,607   adding 'deepspeed/moe/sharded_moe.py'
2023-12-27T20:15:00,609   adding 'deepspeed/moe/utils.py'
2023-12-27T20:15:00,610   adding 'deepspeed/monitor/__init__.py'
2023-12-27T20:15:00,611   adding 'deepspeed/monitor/config.py'
2023-12-27T20:15:00,613   adding 'deepspeed/monitor/csv_monitor.py'
2023-12-27T20:15:00,614   adding 'deepspeed/monitor/monitor.py'
2023-12-27T20:15:00,615   adding 'deepspeed/monitor/tensorboard.py'
2023-12-27T20:15:00,616   adding 'deepspeed/monitor/utils.py'
2023-12-27T20:15:00,617   adding 'deepspeed/monitor/wandb.py'
2023-12-27T20:15:00,619   adding 'deepspeed/nebula/__init__.py'
2023-12-27T20:15:00,620   adding 'deepspeed/nebula/config.py'
2023-12-27T20:15:00,621   adding 'deepspeed/nebula/constants.py'
2023-12-27T20:15:00,623   adding 'deepspeed/ops/__init__.py'
2023-12-27T20:15:00,624   adding 'deepspeed/ops/adagrad/__init__.py'
2023-12-27T20:15:00,626   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2023-12-27T20:15:00,628   adding 'deepspeed/ops/adam/__init__.py'
2023-12-27T20:15:00,629   adding 'deepspeed/ops/adam/cpu_adam.py'
2023-12-27T20:15:00,631   adding 'deepspeed/ops/adam/fused_adam.py'
2023-12-27T20:15:00,632   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2023-12-27T20:15:00,634   adding 'deepspeed/ops/aio/__init__.py'
2023-12-27T20:15:00,637   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2023-12-27T20:15:00,639   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2023-12-27T20:15:00,640   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2023-12-27T20:15:00,642   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2023-12-27T20:15:00,643   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2023-12-27T20:15:00,645   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2023-12-27T20:15:00,648   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2023-12-27T20:15:00,650   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2023-12-27T20:15:00,651   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2023-12-27T20:15:00,652   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2023-12-27T20:15:00,654   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2023-12-27T20:15:00,655   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2023-12-27T20:15:00,657   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2023-12-27T20:15:00,659   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2023-12-27T20:15:00,660   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2023-12-27T20:15:00,661   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2023-12-27T20:15:00,663   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2023-12-27T20:15:00,664   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2023-12-27T20:15:00,666   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2023-12-27T20:15:00,667   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2023-12-27T20:15:00,669   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2023-12-27T20:15:00,670   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2023-12-27T20:15:00,671   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2023-12-27T20:15:00,673   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2023-12-27T20:15:00,675   adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu'
2023-12-27T20:15:00,677   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2023-12-27T20:15:00,681   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2023-12-27T20:15:00,683   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2023-12-27T20:15:00,685   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2023-12-27T20:15:00,687   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2023-12-27T20:15:00,688   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2023-12-27T20:15:00,690   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2023-12-27T20:15:00,698   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2023-12-27T20:15:00,703   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2023-12-27T20:15:00,706   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2023-12-27T20:15:00,708   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2023-12-27T20:15:00,710   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2023-12-27T20:15:00,711   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2023-12-27T20:15:00,714   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2023-12-27T20:15:00,715   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2023-12-27T20:15:00,718   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2023-12-27T20:15:00,720   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2023-12-27T20:15:00,722   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2023-12-27T20:15:00,724   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2023-12-27T20:15:00,731   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2023-12-27T20:15:00,735   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2023-12-27T20:15:00,736   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2023-12-27T20:15:00,740   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2023-12-27T20:15:00,743   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2023-12-27T20:15:00,747   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2023-12-27T20:15:00,749   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2023-12-27T20:15:00,751   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2023-12-27T20:15:00,753   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2023-12-27T20:15:00,754   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2023-12-27T20:15:00,756   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2023-12-27T20:15:00,758   adding 'deepspeed/ops/csrc/includes/Timer.h'
2023-12-27T20:15:00,759   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2023-12-27T20:15:00,760   adding 'deepspeed/ops/csrc/includes/compat.h'
2023-12-27T20:15:00,762   adding 'deepspeed/ops/csrc/includes/context.h'
2023-12-27T20:15:00,763   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2023-12-27T20:15:00,765   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2023-12-27T20:15:00,767   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2023-12-27T20:15:00,768   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2023-12-27T20:15:00,769   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2023-12-27T20:15:00,771   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2023-12-27T20:15:00,773   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2023-12-27T20:15:00,774   adding 'deepspeed/ops/csrc/includes/dropout.h'
2023-12-27T20:15:00,775   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2023-12-27T20:15:00,777   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2023-12-27T20:15:00,778   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2023-12-27T20:15:00,779   adding 'deepspeed/ops/csrc/includes/gelu.h'
2023-12-27T20:15:00,781   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2023-12-27T20:15:00,782   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2023-12-27T20:15:00,784   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2023-12-27T20:15:00,786   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2023-12-27T20:15:00,787   adding 'deepspeed/ops/csrc/includes/quantization.h'
2023-12-27T20:15:00,789   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2023-12-27T20:15:00,790   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2023-12-27T20:15:00,793   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2023-12-27T20:15:00,794   adding 'deepspeed/ops/csrc/includes/simd.h'
2023-12-27T20:15:00,795   adding 'deepspeed/ops/csrc/includes/softmax.h'
2023-12-27T20:15:00,797   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2023-12-27T20:15:00,798   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2023-12-27T20:15:00,800   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2023-12-27T20:15:00,802   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2023-12-27T20:15:00,804   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2023-12-27T20:15:00,805   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2023-12-27T20:15:00,806   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2023-12-27T20:15:00,808   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2023-12-27T20:15:00,809   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2023-12-27T20:15:00,811   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2023-12-27T20:15:00,814   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2023-12-27T20:15:00,816   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2023-12-27T20:15:00,817   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2023-12-27T20:15:00,819   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2023-12-27T20:15:00,821   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2023-12-27T20:15:00,822   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2023-12-27T20:15:00,824   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2023-12-27T20:15:00,826   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2023-12-27T20:15:00,827   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2023-12-27T20:15:00,829   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2023-12-27T20:15:00,831   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2023-12-27T20:15:00,833   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2023-12-27T20:15:00,834   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2023-12-27T20:15:00,836   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2023-12-27T20:15:00,838   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2023-12-27T20:15:00,841   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2023-12-27T20:15:00,845   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2023-12-27T20:15:00,847   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2023-12-27T20:15:00,848   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2023-12-27T20:15:00,853   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2023-12-27T20:15:00,855   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2023-12-27T20:15:00,858   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2023-12-27T20:15:00,860   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2023-12-27T20:15:00,862   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2023-12-27T20:15:00,864   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2023-12-27T20:15:00,866   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2023-12-27T20:15:00,868   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2023-12-27T20:15:00,873   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2023-12-27T20:15:00,875   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2023-12-27T20:15:00,876   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2023-12-27T20:15:00,879   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2023-12-27T20:15:00,882   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2023-12-27T20:15:00,884   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2023-12-27T20:15:00,886   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2023-12-27T20:15:00,887   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2023-12-27T20:15:00,889   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2023-12-27T20:15:00,890   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2023-12-27T20:15:00,892   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2023-12-27T20:15:00,894   adding 'deepspeed/ops/lamb/__init__.py'
2023-12-27T20:15:00,895   adding 'deepspeed/ops/lamb/fused_lamb.py'
2023-12-27T20:15:00,897   adding 'deepspeed/ops/lion/__init__.py'
2023-12-27T20:15:00,899   adding 'deepspeed/ops/lion/cpu_lion.py'
2023-12-27T20:15:00,900   adding 'deepspeed/ops/lion/fused_lion.py'
2023-12-27T20:15:00,902   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2023-12-27T20:15:00,904   adding 'deepspeed/ops/op_builder/__init__.py'
2023-12-27T20:15:00,905   adding 'deepspeed/ops/op_builder/all_ops.py'
2023-12-27T20:15:00,906   adding 'deepspeed/ops/op_builder/async_io.py'
2023-12-27T20:15:00,910   adding 'deepspeed/ops/op_builder/builder.py'
2023-12-27T20:15:00,911   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2023-12-27T20:15:00,912   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2023-12-27T20:15:00,914   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2023-12-27T20:15:00,915   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2023-12-27T20:15:00,916   adding 'deepspeed/ops/op_builder/fused_adam.py'
2023-12-27T20:15:00,917   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2023-12-27T20:15:00,919   adding 'deepspeed/ops/op_builder/fused_lion.py'
2023-12-27T20:15:00,920   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2023-12-27T20:15:00,921   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2023-12-27T20:15:00,922   adding 'deepspeed/ops/op_builder/quantizer.py'
2023-12-27T20:15:00,924   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2023-12-27T20:15:00,925   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2023-12-27T20:15:00,926   adding 'deepspeed/ops/op_builder/random_ltd.py'
2023-12-27T20:15:00,928   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2023-12-27T20:15:00,929   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2023-12-27T20:15:00,930   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2023-12-27T20:15:00,932   adding 'deepspeed/ops/op_builder/transformer.py'
2023-12-27T20:15:00,933   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2023-12-27T20:15:00,935   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2023-12-27T20:15:00,936   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2023-12-27T20:15:00,937   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2023-12-27T20:15:00,938   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2023-12-27T20:15:00,939   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2023-12-27T20:15:00,941   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2023-12-27T20:15:00,942   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2023-12-27T20:15:00,944   adding 'deepspeed/ops/op_builder/npu/builder.py'
2023-12-27T20:15:00,945   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2023-12-27T20:15:00,946   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2023-12-27T20:15:00,947   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2023-12-27T20:15:00,948   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2023-12-27T20:15:00,949   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2023-12-27T20:15:00,951   adding 'deepspeed/ops/quantizer/__init__.py'
2023-12-27T20:15:00,952   adding 'deepspeed/ops/quantizer/quantizer.py'
2023-12-27T20:15:00,954   adding 'deepspeed/ops/random_ltd/__init__.py'
2023-12-27T20:15:00,955   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2023-12-27T20:15:00,957   adding 'deepspeed/ops/sparse_attention/__init__.py'
2023-12-27T20:15:00,958   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2023-12-27T20:15:00,962   adding 'deepspeed/ops/sparse_attention/matmul.py'
2023-12-27T20:15:00,964   adding 'deepspeed/ops/sparse_attention/softmax.py'
2023-12-27T20:15:00,965   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2023-12-27T20:15:00,967   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2023-12-27T20:15:00,970   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2023-12-27T20:15:00,972   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2023-12-27T20:15:00,974   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2023-12-27T20:15:00,975   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2023-12-27T20:15:00,977   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2023-12-27T20:15:00,978   adding 'deepspeed/ops/transformer/__init__.py'
2023-12-27T20:15:00,981   adding 'deepspeed/ops/transformer/transformer.py'
2023-12-27T20:15:00,982   adding 'deepspeed/ops/transformer/inference/__init__.py'
2023-12-27T20:15:00,984   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2023-12-27T20:15:00,985   adding 'deepspeed/ops/transformer/inference/config.py'
2023-12-27T20:15:00,986   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2023-12-27T20:15:00,988   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2023-12-27T20:15:00,990   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2023-12-27T20:15:00,992   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2023-12-27T20:15:00,993   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2023-12-27T20:15:00,995   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2023-12-27T20:15:00,997   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2023-12-27T20:15:00,999   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2023-12-27T20:15:01,000   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2023-12-27T20:15:01,001   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2023-12-27T20:15:01,003   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2023-12-27T20:15:01,004   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2023-12-27T20:15:01,005   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2023-12-27T20:15:01,007   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2023-12-27T20:15:01,008   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2023-12-27T20:15:01,010   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2023-12-27T20:15:01,011   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2023-12-27T20:15:01,013   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2023-12-27T20:15:01,015   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2023-12-27T20:15:01,016   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2023-12-27T20:15:01,017   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2023-12-27T20:15:01,019   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2023-12-27T20:15:01,021   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2023-12-27T20:15:01,022   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2023-12-27T20:15:01,023   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2023-12-27T20:15:01,024   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2023-12-27T20:15:01,026   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2023-12-27T20:15:01,028   adding 'deepspeed/pipe/__init__.py'
2023-12-27T20:15:01,029   adding 'deepspeed/profiling/__init__.py'
2023-12-27T20:15:01,031   adding 'deepspeed/profiling/config.py'
2023-12-27T20:15:01,032   adding 'deepspeed/profiling/constants.py'
2023-12-27T20:15:01,033   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2023-12-27T20:15:01,039   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2023-12-27T20:15:01,041   adding 'deepspeed/runtime/__init__.py'
2023-12-27T20:15:01,043   adding 'deepspeed/runtime/bf16_optimizer.py'
2023-12-27T20:15:01,047   adding 'deepspeed/runtime/config.py'
2023-12-27T20:15:01,050   adding 'deepspeed/runtime/config_utils.py'
2023-12-27T20:15:01,052   adding 'deepspeed/runtime/constants.py'
2023-12-27T20:15:01,053   adding 'deepspeed/runtime/dataloader.py'
2023-12-27T20:15:01,054   adding 'deepspeed/runtime/eigenvalue.py'
2023-12-27T20:15:01,072   adding 'deepspeed/runtime/engine.py'
2023-12-27T20:15:01,076   adding 'deepspeed/runtime/hybrid_engine.py'
2023-12-27T20:15:01,080   adding 'deepspeed/runtime/lr_schedules.py'
2023-12-27T20:15:01,081   adding 'deepspeed/runtime/progressive_layer_drop.py'
2023-12-27T20:15:01,083   adding 'deepspeed/runtime/quantize.py'
2023-12-27T20:15:01,084   adding 'deepspeed/runtime/sparse_tensor.py'
2023-12-27T20:15:01,086   adding 'deepspeed/runtime/state_dict_factory.py'
2023-12-27T20:15:01,091   adding 'deepspeed/runtime/utils.py'
2023-12-27T20:15:01,093   adding 'deepspeed/runtime/weight_quantizer.py'
2023-12-27T20:15:01,097   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2023-12-27T20:15:01,102   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2023-12-27T20:15:01,104   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2023-12-27T20:15:01,106   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2023-12-27T20:15:01,107   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2023-12-27T20:15:01,108   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2023-12-27T20:15:01,110   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2023-12-27T20:15:01,111   adding 'deepspeed/runtime/comm/__init__.py'
2023-12-27T20:15:01,113   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2023-12-27T20:15:01,114   adding 'deepspeed/runtime/comm/hccl.py'
2023-12-27T20:15:01,116   adding 'deepspeed/runtime/comm/mpi.py'
2023-12-27T20:15:01,117   adding 'deepspeed/runtime/comm/nccl.py'
2023-12-27T20:15:01,119   adding 'deepspeed/runtime/compression/__init__.py'
2023-12-27T20:15:01,120   adding 'deepspeed/runtime/compression/cupy.py'
2023-12-27T20:15:01,122   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2023-12-27T20:15:01,123   adding 'deepspeed/runtime/data_pipeline/config.py'
2023-12-27T20:15:01,125   adding 'deepspeed/runtime/data_pipeline/constants.py'
2023-12-27T20:15:01,126   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2023-12-27T20:15:01,128   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2023-12-27T20:15:01,129   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2023-12-27T20:15:01,131   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2023-12-27T20:15:01,132   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2023-12-27T20:15:01,133   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2023-12-27T20:15:01,135   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2023-12-27T20:15:01,137   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2023-12-27T20:15:01,140   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2023-12-27T20:15:01,142   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2023-12-27T20:15:01,144   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2023-12-27T20:15:01,145   adding 'deepspeed/runtime/fp16/__init__.py'
2023-12-27T20:15:01,147   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2023-12-27T20:15:01,149   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2023-12-27T20:15:01,152   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2023-12-27T20:15:01,153   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2023-12-27T20:15:01,155   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2023-12-27T20:15:01,158   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2023-12-27T20:15:01,161   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2023-12-27T20:15:01,162   adding 'deepspeed/runtime/pipe/__init__.py'
2023-12-27T20:15:01,169   adding 'deepspeed/runtime/pipe/engine.py'
2023-12-27T20:15:01,172   adding 'deepspeed/runtime/pipe/module.py'
2023-12-27T20:15:01,174   adding 'deepspeed/runtime/pipe/p2p.py'
2023-12-27T20:15:01,176   adding 'deepspeed/runtime/pipe/schedule.py'
2023-12-27T20:15:01,178   adding 'deepspeed/runtime/pipe/topology.py'
2023-12-27T20:15:01,180   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2023-12-27T20:15:01,181   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2023-12-27T20:15:01,183   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2023-12-27T20:15:01,184   adding 'deepspeed/runtime/swap_tensor/constants.py'
2023-12-27T20:15:01,186   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2023-12-27T20:15:01,188   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2023-12-27T20:15:01,190   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2023-12-27T20:15:01,192   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2023-12-27T20:15:01,194   adding 'deepspeed/runtime/swap_tensor/utils.py'
2023-12-27T20:15:01,196   adding 'deepspeed/runtime/zero/__init__.py'
2023-12-27T20:15:01,198   adding 'deepspeed/runtime/zero/config.py'
2023-12-27T20:15:01,199   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2023-12-27T20:15:01,201   adding 'deepspeed/runtime/zero/linear.py'
2023-12-27T20:15:01,204   adding 'deepspeed/runtime/zero/mics.py'
2023-12-27T20:15:01,205   adding 'deepspeed/runtime/zero/mics_utils.py'
2023-12-27T20:15:01,207   adding 'deepspeed/runtime/zero/offload_config.py'
2023-12-27T20:15:01,210   adding 'deepspeed/runtime/zero/parameter_offload.py'
2023-12-27T20:15:01,221   adding 'deepspeed/runtime/zero/partition_parameters.py'
2023-12-27T20:15:01,224   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2023-12-27T20:15:01,226   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2023-12-27T20:15:01,240   adding 'deepspeed/runtime/zero/stage3.py'
2023-12-27T20:15:01,253   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2023-12-27T20:15:01,255   adding 'deepspeed/runtime/zero/test.py'
2023-12-27T20:15:01,257   adding 'deepspeed/runtime/zero/tiling.py'
2023-12-27T20:15:01,258   adding 'deepspeed/runtime/zero/utils.py'
2023-12-27T20:15:01,260   adding 'deepspeed/sequence/__init__.py'
2023-12-27T20:15:01,262   adding 'deepspeed/sequence/layer.py'
2023-12-27T20:15:01,263   adding 'deepspeed/utils/__init__.py'
2023-12-27T20:15:01,265   adding 'deepspeed/utils/comms_logging.py'
2023-12-27T20:15:01,266   adding 'deepspeed/utils/debug.py'
2023-12-27T20:15:01,268   adding 'deepspeed/utils/exceptions.py'
2023-12-27T20:15:01,270   adding 'deepspeed/utils/groups.py'
2023-12-27T20:15:01,272   adding 'deepspeed/utils/init_on_device.py'
2023-12-27T20:15:01,273   adding 'deepspeed/utils/logging.py'
2023-12-27T20:15:01,275   adding 'deepspeed/utils/mixed_precision_linkage.py'
2023-12-27T20:15:01,276   adding 'deepspeed/utils/numa.py'
2023-12-27T20:15:01,277   adding 'deepspeed/utils/nvtx.py'
2023-12-27T20:15:01,279   adding 'deepspeed/utils/tensor_fragment.py'
2023-12-27T20:15:01,281   adding 'deepspeed/utils/timer.py'
2023-12-27T20:15:01,282   adding 'deepspeed/utils/types.py'
2023-12-27T20:15:01,285   adding 'deepspeed/utils/zero_to_fp32.py'
2023-12-27T20:15:01,287   adding 'deepspeed-0.12.6.data/scripts/deepspeed'
2023-12-27T20:15:01,288   adding 'deepspeed-0.12.6.data/scripts/deepspeed.pt'
2023-12-27T20:15:01,289   adding 'deepspeed-0.12.6.data/scripts/ds'
2023-12-27T20:15:01,290   adding 'deepspeed-0.12.6.data/scripts/ds_bench'
2023-12-27T20:15:01,291   adding 'deepspeed-0.12.6.data/scripts/ds_elastic'
2023-12-27T20:15:01,292   adding 'deepspeed-0.12.6.data/scripts/ds_report'
2023-12-27T20:15:01,293   adding 'deepspeed-0.12.6.data/scripts/ds_ssh'
2023-12-27T20:15:01,294   adding 'deepspeed-0.12.6.data/scripts/dsr'
2023-12-27T20:15:01,300   adding 'deepspeed-0.12.6.dist-info/METADATA'
2023-12-27T20:15:01,301   adding 'deepspeed-0.12.6.dist-info/WHEEL'
2023-12-27T20:15:01,302   adding 'deepspeed-0.12.6.dist-info/entry_points.txt'
2023-12-27T20:15:01,303   adding 'deepspeed-0.12.6.dist-info/top_level.txt'
2023-12-27T20:15:01,315   adding 'deepspeed-0.12.6.dist-info/RECORD'
2023-12-27T20:15:01,383   removing build/bdist.linux-armv7l/wheel
2023-12-27T20:15:01,583   deepspeed build time = 8.571710586547852 secs
2023-12-27T20:15:01,696   Building wheel for deepspeed (setup.py): finished with status 'done'
2023-12-27T20:15:01,711   Created wheel for deepspeed: filename=deepspeed-0.12.6-py3-none-any.whl size=1306693 sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd
2023-12-27T20:15:01,713   Stored in directory: /tmp/pip-ephem-wheel-cache-7u64anze/wheels/f3/e6/c6/bf503773d88c9375949b2037f80d39d65f1fb960dac01049c5
2023-12-27T20:15:01,749 Successfully built deepspeed
2023-12-27T20:15:01,787 Removed build tracker: '/tmp/pip-build-tracker-9cbhrnt_'