2023-11-03T23:50:09,256 Created temporary directory: /tmp/pip-build-tracker-2r1ir139
2023-11-03T23:50:09,257 Initialized build tracking at /tmp/pip-build-tracker-2r1ir139
2023-11-03T23:50:09,258 Created build tracker: /tmp/pip-build-tracker-2r1ir139
2023-11-03T23:50:09,258 Entered build tracker: /tmp/pip-build-tracker-2r1ir139
2023-11-03T23:50:09,259 Created temporary directory: /tmp/pip-wheel-sr8r_ahc
2023-11-03T23:50:09,262 Created temporary directory: /tmp/pip-ephem-wheel-cache-5_b3wdvt
2023-11-03T23:50:09,284 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-11-03T23:50:09,288 2 location(s) to search for versions of deepspeed:
2023-11-03T23:50:09,288 * https://pypi.org/simple/deepspeed/
2023-11-03T23:50:09,288 * https://www.piwheels.org/simple/deepspeed/
2023-11-03T23:50:09,288 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2023-11-03T23:50:09,289 Getting page https://pypi.org/simple/deepspeed/
2023-11-03T23:50:09,291 Found index url https://pypi.org/simple/
2023-11-03T23:50:09,508 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2023-11-03T23:50:09,523   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-11-03T23:50:09,523   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2023-11-03T23:50:09,524   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-11-03T23:50:09,525   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2023-11-03T23:50:09,525   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-11-03T23:50:09,526   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2023-11-03T23:50:09,527   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-11-03T23:50:09,528   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2023-11-03T23:50:09,528   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-11-03T23:50:09,529   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2023-11-03T23:50:09,530   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2023-11-03T23:50:09,530   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2023-11-03T23:50:09,531   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2023-11-03T23:50:09,532   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2023-11-03T23:50:09,533   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2023-11-03T23:50:09,533   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2023-11-03T23:50:09,534   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2023-11-03T23:50:09,535   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2023-11-03T23:50:09,535   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2023-11-03T23:50:09,536   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2023-11-03T23:50:09,536   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2023-11-03T23:50:09,537   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2023-11-03T23:50:09,538   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2023-11-03T23:50:09,539   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2023-11-03T23:50:09,539   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2023-11-03T23:50:09,540   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2023-11-03T23:50:09,541   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2023-11-03T23:50:09,542   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2023-11-03T23:50:09,542   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2023-11-03T23:50:09,543   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2023-11-03T23:50:09,544   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2023-11-03T23:50:09,545   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2023-11-03T23:50:09,545   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2023-11-03T23:50:09,546   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2023-11-03T23:50:09,547   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2023-11-03T23:50:09,547   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2023-11-03T23:50:09,548   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2023-11-03T23:50:09,548   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2023-11-03T23:50:09,549   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2023-11-03T23:50:09,550   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2023-11-03T23:50:09,550   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2023-11-03T23:50:09,551   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2023-11-03T23:50:09,552   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2023-11-03T23:50:09,553   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2023-11-03T23:50:09,553   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2023-11-03T23:50:09,554   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2023-11-03T23:50:09,555   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2023-11-03T23:50:09,556   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2023-11-03T23:50:09,556   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2023-11-03T23:50:09,557   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2023-11-03T23:50:09,558   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2023-11-03T23:50:09,559   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2023-11-03T23:50:09,559   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2023-11-03T23:50:09,560   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2023-11-03T23:50:09,560   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2023-11-03T23:50:09,561   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2023-11-03T23:50:09,562   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2023-11-03T23:50:09,562   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2023-11-03T23:50:09,563   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2023-11-03T23:50:09,564   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2023-11-03T23:50:09,564   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2023-11-03T23:50:09,565   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2023-11-03T23:50:09,566   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2023-11-03T23:50:09,566   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2023-11-03T23:50:09,567   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2023-11-03T23:50:09,568   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2023-11-03T23:50:09,569   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2023-11-03T23:50:09,570   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2023-11-03T23:50:09,571   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2023-11-03T23:50:09,571   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2023-11-03T23:50:09,572   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2023-11-03T23:50:09,572   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2023-11-03T23:50:09,573   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2023-11-03T23:50:09,573   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2023-11-03T23:50:09,574   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2023-11-03T23:50:09,575   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2023-11-03T23:50:09,575   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2023-11-03T23:50:09,576   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2023-11-03T23:50:09,577   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2023-11-03T23:50:09,577 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2023-11-03T23:50:09,578 Getting page https://www.piwheels.org/simple/deepspeed/
2023-11-03T23:50:09,579 Found index url https://www.piwheels.org/simple/
2023-11-03T23:50:09,759 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2023-11-03T23:50:09,772   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,773   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,773   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,774   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,775   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,776   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,776   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,777   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,777   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,778   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,778   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,778   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,779   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,780   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,780   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,781   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,781   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,782   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,783   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,783   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,784   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,785   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,785   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,785   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,786   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,786   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,787   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,787   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,788   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,789   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,789   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,790   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,790   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,791   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,792   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,793   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,793   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,793   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,794   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,794   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,795   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,795   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,796   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,797   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,797   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,798   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,798   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,799   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,800   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T23:50:09,801 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2023-11-03T23:50:09,801 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2023-11-03T23:50:09,828 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2023-11-03T23:50:09,846 Collecting deepspeed==0.12.0
2023-11-03T23:50:09,848   Created temporary directory: /tmp/pip-unpack-h84k68h7
2023-11-03T23:50:10,064   Downloading deepspeed-0.12.0.tar.gz (1.2 MB)
2023-11-03T23:50:12,047   Added deepspeed==0.12.0 from https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz to build tracker '/tmp/pip-build-tracker-2r1ir139'
2023-11-03T23:50:12,050   Running setup.py (path:/tmp/pip-wheel-sr8r_ahc/deepspeed_0c813189bf51456ea4139dc18ea72798/setup.py) egg_info for package deepspeed
2023-11-03T23:50:12,050   Created temporary directory: /tmp/pip-pip-egg-info-5dop1y12
2023-11-03T23:50:12,051   Preparing metadata (setup.py): started
2023-11-03T23:50:12,052   Running command python setup.py egg_info
2023-11-03T23:50:12,880   fatal: not a git repository (or any of the parent directories): .git
2023-11-03T23:50:13,548   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2023-11-03T23:50:13,548    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2023-11-03T23:50:13,549   DS_BUILD_OPS=0
2023-11-03T23:50:13,549    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2023-11-03T23:50:13,550    [WARNING]  async_io: please install the libaio-dev package with apt
2023-11-03T23:50:13,551    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2023-11-03T23:50:13,551    [WARNING]  Please install torch if trying to pre-compile kernels
2023-11-03T23:50:13,552    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:13,552    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:13,553    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:13,554    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:13,554    [WARNING]  unable to import torch, please install it first
2023-11-03T23:50:13,555    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:13,555    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:13,556   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False}
2023-11-03T23:50:13,556   version=0.12.0, git_hash=unknown, git_branch=unknown
2023-11-03T23:50:13,557   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2023-11-03T23:50:13,557   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False}
2023-11-03T23:50:13,558   ext_modules=[]
2023-11-03T23:50:13,559   running egg_info
2023-11-03T23:50:13,559   creating /tmp/pip-pip-egg-info-5dop1y12/deepspeed.egg-info
2023-11-03T23:50:13,576   writing /tmp/pip-pip-egg-info-5dop1y12/deepspeed.egg-info/PKG-INFO
2023-11-03T23:50:13,606   writing dependency_links to /tmp/pip-pip-egg-info-5dop1y12/deepspeed.egg-info/dependency_links.txt
2023-11-03T23:50:13,608   writing entry points to /tmp/pip-pip-egg-info-5dop1y12/deepspeed.egg-info/entry_points.txt
2023-11-03T23:50:13,623   writing requirements to /tmp/pip-pip-egg-info-5dop1y12/deepspeed.egg-info/requires.txt
2023-11-03T23:50:13,624   writing top-level names to /tmp/pip-pip-egg-info-5dop1y12/deepspeed.egg-info/top_level.txt
2023-11-03T23:50:13,626   writing manifest file '/tmp/pip-pip-egg-info-5dop1y12/deepspeed.egg-info/SOURCES.txt'
2023-11-03T23:50:13,785   reading manifest file '/tmp/pip-pip-egg-info-5dop1y12/deepspeed.egg-info/SOURCES.txt'
2023-11-03T23:50:13,787   reading manifest template 'MANIFEST.in'
2023-11-03T23:50:13,789   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2023-11-03T23:50:13,789   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2023-11-03T23:50:14,854   warning: no files found matching '*.hip' under directory 'deepspeed'
2023-11-03T23:50:15,655   warning: no files found matching '*.cc' under directory 'deepspeed'
2023-11-03T23:50:16,114   warning: no files found matching '*.tr' under directory 'csrc'
2023-11-03T23:50:16,209   warning: no files found matching '*.cc' under directory 'csrc'
2023-11-03T23:50:16,231   warning: no files found matching '*.py' under directory 'benchmarks'
2023-11-03T23:50:16,269   writing manifest file '/tmp/pip-pip-egg-info-5dop1y12/deepspeed.egg-info/SOURCES.txt'
2023-11-03T23:50:16,271   deepspeed build time = 3.387695550918579 secs
2023-11-03T23:50:16,400   Preparing metadata (setup.py): finished with status 'done'
2023-11-03T23:50:16,405   Source in /tmp/pip-wheel-sr8r_ahc/deepspeed_0c813189bf51456ea4139dc18ea72798 has version 0.12.0, which satisfies requirement deepspeed==0.12.0 from https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz
2023-11-03T23:50:16,407   Removed deepspeed==0.12.0 from https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz from build tracker '/tmp/pip-build-tracker-2r1ir139'
2023-11-03T23:50:16,415 Created temporary directory: /tmp/pip-unpack-ljz3wpu3
2023-11-03T23:50:16,416 Created temporary directory: /tmp/pip-unpack-bk8iu25c
2023-11-03T23:50:16,657 Building wheels for collected packages: deepspeed
2023-11-03T23:50:16,661   Created temporary directory: /tmp/pip-wheel-xh2j8h2i
2023-11-03T23:50:16,662   Building wheel for deepspeed (setup.py): started
2023-11-03T23:50:16,663   Destination directory: /tmp/pip-wheel-xh2j8h2i
2023-11-03T23:50:16,664   Running command python setup.py bdist_wheel
2023-11-03T23:50:17,082   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2023-11-03T23:50:17,089    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2023-11-03T23:50:17,144   DS_BUILD_OPS=0
2023-11-03T23:50:17,257    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2023-11-03T23:50:17,316    [WARNING]  async_io: please install the libaio-dev package with apt
2023-11-03T23:50:17,317    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2023-11-03T23:50:17,317    [WARNING]  Please install torch if trying to pre-compile kernels
2023-11-03T23:50:17,318    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:17,319    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:17,319    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:17,320    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:17,320    [WARNING]  unable to import torch, please install it first
2023-11-03T23:50:17,321    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:17,321    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T23:50:17,322   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False}
2023-11-03T23:50:17,329   fatal: not a git repository (or any of the parent directories): .git
2023-11-03T23:50:17,331   version=0.12.0, git_hash=unknown, git_branch=unknown
2023-11-03T23:50:17,332   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2023-11-03T23:50:17,333   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False}
2023-11-03T23:50:17,334   ext_modules=[]
2023-11-03T23:50:17,964   running bdist_wheel
2023-11-03T23:50:18,060   running build
2023-11-03T23:50:18,061   running build_py
2023-11-03T23:50:18,088   creating build
2023-11-03T23:50:18,089   creating build/lib
2023-11-03T23:50:18,089   creating build/lib/deepspeed
2023-11-03T23:50:18,091   copying deepspeed/constants.py -> build/lib/deepspeed
2023-11-03T23:50:18,093   copying deepspeed/__init__.py -> build/lib/deepspeed
2023-11-03T23:50:18,095   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2023-11-03T23:50:18,097   copying deepspeed/env_report.py -> build/lib/deepspeed
2023-11-03T23:50:18,099   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2023-11-03T23:50:18,101   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2023-11-03T23:50:18,103   creating build/lib/deepspeed/inference
2023-11-03T23:50:18,104   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2023-11-03T23:50:18,106   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2023-11-03T23:50:18,108   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2023-11-03T23:50:18,111   creating build/lib/deepspeed/monitor
2023-11-03T23:50:18,112   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2023-11-03T23:50:18,114   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2023-11-03T23:50:18,115   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2023-11-03T23:50:18,117   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2023-11-03T23:50:18,119   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2023-11-03T23:50:18,120   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2023-11-03T23:50:18,122   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2023-11-03T23:50:18,125   creating build/lib/deepspeed/moe
2023-11-03T23:50:18,126   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2023-11-03T23:50:18,127   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2023-11-03T23:50:18,129   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2023-11-03T23:50:18,131   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2023-11-03T23:50:18,133   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2023-11-03T23:50:18,135   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2023-11-03T23:50:18,138   creating build/lib/deepspeed/sequence
2023-11-03T23:50:18,138   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2023-11-03T23:50:18,140   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2023-11-03T23:50:18,143   creating build/lib/deepspeed/autotuning
2023-11-03T23:50:18,143   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2023-11-03T23:50:18,146   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2023-11-03T23:50:18,147   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2023-11-03T23:50:18,150   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2023-11-03T23:50:18,152   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2023-11-03T23:50:18,155   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2023-11-03T23:50:18,158   creating build/lib/deepspeed/launcher
2023-11-03T23:50:18,158   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2023-11-03T23:50:18,160   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2023-11-03T23:50:18,162   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2023-11-03T23:50:18,164   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2023-11-03T23:50:18,166   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2023-11-03T23:50:18,169   creating build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,170   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,172   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,174   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,175   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,178   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,180   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,181   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,184   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,186   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,188   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2023-11-03T23:50:18,190   creating build/lib/deepspeed/compression
2023-11-03T23:50:18,191   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2023-11-03T23:50:18,194   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2023-11-03T23:50:18,195   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2023-11-03T23:50:18,197   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2023-11-03T23:50:18,200   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2023-11-03T23:50:18,202   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2023-11-03T23:50:18,204   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2023-11-03T23:50:18,207   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2023-11-03T23:50:18,210   creating build/lib/deepspeed/accelerator
2023-11-03T23:50:18,211   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2023-11-03T23:50:18,213   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T23:50:18,215   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T23:50:18,216   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T23:50:18,218   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T23:50:18,221   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T23:50:18,223   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T23:50:18,225   creating build/lib/deepspeed/model_implementations
2023-11-03T23:50:18,226   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2023-11-03T23:50:18,228   creating build/lib/deepspeed/utils
2023-11-03T23:50:18,229   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,231   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,233   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,235   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,237   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,239   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,241   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,243   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,245   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,247   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,250   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,251   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,254   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,256   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2023-11-03T23:50:18,258   creating build/lib/deepspeed/ops
2023-11-03T23:50:18,259   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2023-11-03T23:50:18,261   creating build/lib/deepspeed/comm
2023-11-03T23:50:18,262   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2023-11-03T23:50:18,264   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2023-11-03T23:50:18,267   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2023-11-03T23:50:18,269   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2023-11-03T23:50:18,270   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2023-11-03T23:50:18,273   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2023-11-03T23:50:18,274   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2023-11-03T23:50:18,277   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2023-11-03T23:50:18,278   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2023-11-03T23:50:18,281   creating build/lib/deepspeed/module_inject
2023-11-03T23:50:18,281   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,283   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,285   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,287   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,289   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,290   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,293   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,295   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,297   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,298   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,301   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,303   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,305   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2023-11-03T23:50:18,307   creating build/lib/deepspeed/pipe
2023-11-03T23:50:18,308   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2023-11-03T23:50:18,311   creating build/lib/deepspeed/runtime
2023-11-03T23:50:18,311   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,314   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,315   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,318   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,319   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,321   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,323   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,325   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,328   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,330   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,332   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,337   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,339   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,342   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,344   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,346   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2023-11-03T23:50:18,349   creating build/lib/deepspeed/elasticity
2023-11-03T23:50:18,349   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2023-11-03T23:50:18,351   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2023-11-03T23:50:18,353   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2023-11-03T23:50:18,355   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2023-11-03T23:50:18,357   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2023-11-03T23:50:18,359   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2023-11-03T23:50:18,362   creating build/lib/deepspeed/profiling
2023-11-03T23:50:18,362   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2023-11-03T23:50:18,364   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2023-11-03T23:50:18,366   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2023-11-03T23:50:18,368   creating build/lib/deepspeed/nebula
2023-11-03T23:50:18,369   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2023-11-03T23:50:18,371   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2023-11-03T23:50:18,373   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2023-11-03T23:50:18,375   creating build/lib/deepspeed/inference/quantization
2023-11-03T23:50:18,376   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2023-11-03T23:50:18,378   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2023-11-03T23:50:18,380   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2023-11-03T23:50:18,382   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2023-11-03T23:50:18,384   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2023-11-03T23:50:18,386   creating build/lib/deepspeed/inference/v2
2023-11-03T23:50:18,387   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2023-11-03T23:50:18,388   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2023-11-03T23:50:18,390   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2023-11-03T23:50:18,391   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2023-11-03T23:50:18,393   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2023-11-03T23:50:18,395   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2023-11-03T23:50:18,396   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2023-11-03T23:50:18,398   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2023-11-03T23:50:18,400   creating build/lib/deepspeed/inference/v2/checkpoint
2023-11-03T23:50:18,401   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2023-11-03T23:50:18,403   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2023-11-03T23:50:18,405   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2023-11-03T23:50:18,406   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2023-11-03T23:50:18,409   creating build/lib/deepspeed/inference/v2/ragged
2023-11-03T23:50:18,410   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2023-11-03T23:50:18,412   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2023-11-03T23:50:18,413   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2023-11-03T23:50:18,416   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2023-11-03T23:50:18,418   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2023-11-03T23:50:18,420   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2023-11-03T23:50:18,422   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2023-11-03T23:50:18,425   creating build/lib/deepspeed/inference/v2/kernels
2023-11-03T23:50:18,425   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2023-11-03T23:50:18,427   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2023-11-03T23:50:18,429   creating build/lib/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:18,430   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:18,432   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:18,434   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:18,437   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:18,439   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:18,441   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:18,444   creating build/lib/deepspeed/inference/v2/modules
2023-11-03T23:50:18,445   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2023-11-03T23:50:18,446   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2023-11-03T23:50:18,448   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2023-11-03T23:50:18,450   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2023-11-03T23:50:18,452   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2023-11-03T23:50:18,453   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2023-11-03T23:50:18,455   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2023-11-03T23:50:18,456   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2023-11-03T23:50:18,458   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2023-11-03T23:50:18,459   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2023-11-03T23:50:18,461   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:18,462   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:18,464   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:18,466   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:18,467   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:18,469   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:18,471   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:18,473   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:18,474   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:18,476   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:18,478   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:18,479   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:18,481   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:18,483   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:18,484   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:18,486   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:18,488   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:18,489   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:18,491   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:18,492   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:18,494   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:18,496   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-11-03T23:50:18,497   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-11-03T23:50:18,499   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-11-03T23:50:18,501   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:18,502   copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:18,503   copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:18,505   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:18,506   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:18,508   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:18,510   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:18,511   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:18,513   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:18,516   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:18,516   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:18,518   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:18,520   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:18,521   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:18,523   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:18,525   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:18,526   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:18,528   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:18,530   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:18,531   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:18,534   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:18,535   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:18,536   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:18,538   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:18,540   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:18,541   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:18,543   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-11-03T23:50:18,544   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-11-03T23:50:18,546   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-11-03T23:50:18,548   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:18,549   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:18,551   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:18,553   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:18,555   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:18,557   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:18,559   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:18,561   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:18,563   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:18,564   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:18,567   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2023-11-03T23:50:18,568   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2023-11-03T23:50:18,570   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2023-11-03T23:50:18,571   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2023-11-03T23:50:18,573   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2023-11-03T23:50:18,576   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2023-11-03T23:50:18,577   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2023-11-03T23:50:18,579   copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2023-11-03T23:50:18,580   copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2023-11-03T23:50:18,583   copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2023-11-03T23:50:18,585   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2023-11-03T23:50:18,586   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2023-11-03T23:50:18,588   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2023-11-03T23:50:18,589   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2023-11-03T23:50:18,591   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2023-11-03T23:50:18,594   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:18,595   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:18,597   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:18,598   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:18,600   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:18,602   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:18,603   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:18,605   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:18,607   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:18,608   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:18,611   creating build/lib/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:18,612   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:18,613   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:18,615   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:18,617   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:18,619   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:18,620   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:18,622   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:18,624   creating build/lib/deepspeed/inference/v2/modules/implementations
2023-11-03T23:50:18,625   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2023-11-03T23:50:18,628   creating build/lib/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:18,628   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:18,630   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:18,632   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:18,633   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:18,635   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:18,637   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:18,639   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:18,641   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:18,643   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2023-11-03T23:50:18,644   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2023-11-03T23:50:18,646   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2023-11-03T23:50:18,648   copying deepspeed/inference/v2/modules/implementations/moe/test.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2023-11-03T23:50:18,650   copying deepspeed/inference/v2/modules/implementations/moe/gate_fn.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2023-11-03T23:50:18,652   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2023-11-03T23:50:18,653   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2023-11-03T23:50:18,655   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2023-11-03T23:50:18,657   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2023-11-03T23:50:18,658   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2023-11-03T23:50:18,660   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2023-11-03T23:50:18,663   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2023-11-03T23:50:18,664   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2023-11-03T23:50:18,666   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2023-11-03T23:50:18,668   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2023-11-03T23:50:18,670   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2023-11-03T23:50:18,672   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2023-11-03T23:50:18,675   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2023-11-03T23:50:18,676   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2023-11-03T23:50:18,678   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2023-11-03T23:50:18,680   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2023-11-03T23:50:18,683   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2023-11-03T23:50:18,684   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2023-11-03T23:50:18,686   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2023-11-03T23:50:18,688   copying deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2023-11-03T23:50:18,690   creating build/lib/deepspeed/autotuning/tuner
2023-11-03T23:50:18,691   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T23:50:18,694   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T23:50:18,696   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T23:50:18,698   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T23:50:18,700   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T23:50:18,701   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T23:50:18,705   creating build/lib/deepspeed/model_implementations/features
2023-11-03T23:50:18,706   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2023-11-03T23:50:18,708   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2023-11-03T23:50:18,710   creating build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,712   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,714   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,716   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,718   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,720   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,722   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,724   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,726   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,728   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,731   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T23:50:18,733   creating build/lib/deepspeed/model_implementations/diffusers
2023-11-03T23:50:18,735   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2023-11-03T23:50:18,737   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2023-11-03T23:50:18,739   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2023-11-03T23:50:18,742   creating build/lib/deepspeed/ops/lion
2023-11-03T23:50:18,743   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2023-11-03T23:50:18,745   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2023-11-03T23:50:18,747   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2023-11-03T23:50:18,749   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2023-11-03T23:50:18,752   creating build/lib/deepspeed/ops/random_ltd
2023-11-03T23:50:18,754   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2023-11-03T23:50:18,756   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2023-11-03T23:50:18,759   creating build/lib/deepspeed/ops/deepspeed4science
2023-11-03T23:50:18,760   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2023-11-03T23:50:18,762   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2023-11-03T23:50:18,765   creating build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,766   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,768   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,770   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,772   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,775   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,777   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,779   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,781   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,783   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,785   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,787   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,789   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,792   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,794   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,797   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,799   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,802   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,805   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,807   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,809   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,812   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,814   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T23:50:18,817   creating build/lib/deepspeed/ops/lamb
2023-11-03T23:50:18,819   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2023-11-03T23:50:18,821   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2023-11-03T23:50:18,824   creating build/lib/deepspeed/ops/adam
2023-11-03T23:50:18,825   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2023-11-03T23:50:18,827   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2023-11-03T23:50:18,830   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2023-11-03T23:50:18,832   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2023-11-03T23:50:18,835   creating build/lib/deepspeed/ops/transformer
2023-11-03T23:50:18,836   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2023-11-03T23:50:18,838   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2023-11-03T23:50:18,841   creating build/lib/deepspeed/ops/adagrad
2023-11-03T23:50:18,843   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2023-11-03T23:50:18,845   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2023-11-03T23:50:18,848   creating build/lib/deepspeed/ops/sparse_attention
2023-11-03T23:50:18,849   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T23:50:18,851   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T23:50:18,854   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T23:50:18,857   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T23:50:18,860   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T23:50:18,864   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T23:50:18,866   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T23:50:18,870   creating build/lib/deepspeed/ops/quantizer
2023-11-03T23:50:18,871   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2023-11-03T23:50:18,873   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2023-11-03T23:50:18,876   creating build/lib/deepspeed/ops/aio
2023-11-03T23:50:18,878   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2023-11-03T23:50:18,880   creating build/lib/deepspeed/ops/op_builder/npu
2023-11-03T23:50:18,882   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2023-11-03T23:50:18,884   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2023-11-03T23:50:18,886   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2023-11-03T23:50:18,889   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2023-11-03T23:50:18,891   creating build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:18,893   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:18,895   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:18,897   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:18,899   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:18,902   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:18,904   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:18,906   creating build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,907   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,910   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,912   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,915   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,916   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,919   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,920   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,923   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,925   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,928   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T23:50:18,931   creating build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,932   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,934   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,936   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,938   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,940   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,943   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,946   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,948   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,950   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,953   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:18,956   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,957   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,960   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,963   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,965   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,967   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,970   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,972   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,974   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,977   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,980   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:18,983   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2023-11-03T23:50:18,984   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-11-03T23:50:18,987   creating build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:18,989   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:18,991   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:18,993   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:18,995   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:18,997   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,000   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,002   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,005   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,008   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,010   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,013   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,016   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,018   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,020   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,023   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,026   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,028   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,030   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,033   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T23:50:19,036   creating build/lib/deepspeed/module_inject/containers/features
2023-11-03T23:50:19,037   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T23:50:19,039   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T23:50:19,042   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T23:50:19,044   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T23:50:19,047   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T23:50:19,049   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T23:50:19,052   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T23:50:19,055   creating build/lib/deepspeed/runtime/data_pipeline
2023-11-03T23:50:19,056   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2023-11-03T23:50:19,059   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2023-11-03T23:50:19,061   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2023-11-03T23:50:19,063   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2023-11-03T23:50:19,066   creating build/lib/deepspeed/runtime/compression
2023-11-03T23:50:19,067   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2023-11-03T23:50:19,069   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2023-11-03T23:50:19,072   creating build/lib/deepspeed/runtime/checkpoint_engine
2023-11-03T23:50:19,073   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-11-03T23:50:19,075   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-11-03T23:50:19,077   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-11-03T23:50:19,080   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-11-03T23:50:19,083   creating build/lib/deepspeed/runtime/swap_tensor
2023-11-03T23:50:19,084   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T23:50:19,086   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T23:50:19,088   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T23:50:19,091   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T23:50:19,094   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T23:50:19,097   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T23:50:19,100   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T23:50:19,102   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T23:50:19,105   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T23:50:19,108   creating build/lib/deepspeed/runtime/activation_checkpointing
2023-11-03T23:50:19,109   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2023-11-03T23:50:19,111   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2023-11-03T23:50:19,115   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2023-11-03T23:50:19,118   creating build/lib/deepspeed/runtime/comm
2023-11-03T23:50:19,119   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2023-11-03T23:50:19,121   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2023-11-03T23:50:19,124   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2023-11-03T23:50:19,126   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2023-11-03T23:50:19,130   creating build/lib/deepspeed/runtime/fp16
2023-11-03T23:50:19,131   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2023-11-03T23:50:19,133   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2023-11-03T23:50:19,136   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2023-11-03T23:50:19,139   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2023-11-03T23:50:19,143   creating build/lib/deepspeed/runtime/pipe
2023-11-03T23:50:19,144   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T23:50:19,146   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T23:50:19,149   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T23:50:19,152   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T23:50:19,155   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T23:50:19,159   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T23:50:19,162   creating build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,164   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,166   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,171   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,173   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,176   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,178   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,181   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,186   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,189   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,191   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,196   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,199   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,202   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,205   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,207   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,210   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2023-11-03T23:50:19,213   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:19,214   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:19,216   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:19,218   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:19,221   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:19,223   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:19,226   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:19,227   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:19,230   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:19,233   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:19,235   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:19,238   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:19,241   creating build/lib/deepspeed/runtime/fp16/onebit
2023-11-03T23:50:19,243   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-11-03T23:50:19,245   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-11-03T23:50:19,247   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-11-03T23:50:19,250   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-11-03T23:50:19,254   creating build/lib/deepspeed/profiling/flops_profiler
2023-11-03T23:50:19,255   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2023-11-03T23:50:19,257   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2023-11-03T23:50:19,261   running egg_info
2023-11-03T23:50:19,310   writing deepspeed.egg-info/PKG-INFO
2023-11-03T23:50:19,341   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2023-11-03T23:50:19,344   writing entry points to deepspeed.egg-info/entry_points.txt
2023-11-03T23:50:19,359   writing requirements to deepspeed.egg-info/requires.txt
2023-11-03T23:50:19,361   writing top-level names to deepspeed.egg-info/top_level.txt
2023-11-03T23:50:19,436   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2023-11-03T23:50:19,479   reading manifest template 'MANIFEST.in'
2023-11-03T23:50:19,481   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2023-11-03T23:50:19,482   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2023-11-03T23:50:20,491   warning: no files found matching '*.hip' under directory 'deepspeed'
2023-11-03T23:50:21,252   warning: no files found matching '*.cc' under directory 'deepspeed'
2023-11-03T23:50:21,711   warning: no files found matching '*.tr' under directory 'csrc'
2023-11-03T23:50:21,807   warning: no files found matching '*.cc' under directory 'csrc'
2023-11-03T23:50:21,829   warning: no files found matching '*.py' under directory 'benchmarks'
2023-11-03T23:50:21,872   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2023-11-03T23:50:21,880   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2023-11-03T23:50:21,880   !!

2023-11-03T23:50:21,881           ********************************************************************************
2023-11-03T23:50:21,882           ############################
2023-11-03T23:50:21,882           # Package would be ignored #
2023-11-03T23:50:21,883           ############################
2023-11-03T23:50:21,883           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2023-11-03T23:50:21,884           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:21,885           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:21,885           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2023-11-03T23:50:21,886           to the `packages` configuration field.

2023-11-03T23:50:21,887           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:21,887           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:21,888           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:21,889           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:21,891           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:21,891           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2023-11-03T23:50:21,892           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2023-11-03T23:50:21,892           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:21,893           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:21,893           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:21,894           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:21,895           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:21,896           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:21,896                 even if it does not contain any `.py` files.
2023-11-03T23:50:21,897                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:21,897                 directory, all directories are treated like packages.
2023-11-03T23:50:21,898           ********************************************************************************

2023-11-03T23:50:21,899   !!
2023-11-03T23:50:21,899     check.warn(importable)
2023-11-03T23:50:21,899   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2023-11-03T23:50:21,900   !!

2023-11-03T23:50:21,901           ********************************************************************************
2023-11-03T23:50:21,902           ############################
2023-11-03T23:50:21,902           # Package would be ignored #
2023-11-03T23:50:21,903           ############################
2023-11-03T23:50:21,903           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2023-11-03T23:50:21,904           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:21,905           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:21,906           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2023-11-03T23:50:21,906           to the `packages` configuration field.

2023-11-03T23:50:21,907           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:21,908           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:21,909           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:21,910           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:21,911           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:21,912           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2023-11-03T23:50:21,912           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2023-11-03T23:50:21,913           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:21,913           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:21,914           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:21,915           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:21,916           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:21,917           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:21,918                 even if it does not contain any `.py` files.
2023-11-03T23:50:21,918                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:21,919                 directory, all directories are treated like packages.
2023-11-03T23:50:21,920           ********************************************************************************

2023-11-03T23:50:21,920   !!
2023-11-03T23:50:21,921     check.warn(importable)
2023-11-03T23:50:21,921   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2023-11-03T23:50:21,921   !!

2023-11-03T23:50:21,922           ********************************************************************************
2023-11-03T23:50:21,922           ############################
2023-11-03T23:50:21,923           # Package would be ignored #
2023-11-03T23:50:21,923           ############################
2023-11-03T23:50:21,924           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2023-11-03T23:50:21,924           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:21,925           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:21,925           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2023-11-03T23:50:21,925           to the `packages` configuration field.

2023-11-03T23:50:21,926           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:21,926           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:21,927           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:21,928           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:21,929           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:21,930           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2023-11-03T23:50:21,931           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2023-11-03T23:50:21,931           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:21,932           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:21,932           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:21,933           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:21,934           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:21,935           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:21,936                 even if it does not contain any `.py` files.
2023-11-03T23:50:21,936                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:21,937                 directory, all directories are treated like packages.
2023-11-03T23:50:21,937           ********************************************************************************

2023-11-03T23:50:21,938   !!
2023-11-03T23:50:21,938     check.warn(importable)
2023-11-03T23:50:21,939   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2023-11-03T23:50:21,939   !!

2023-11-03T23:50:21,940           ********************************************************************************
2023-11-03T23:50:21,941           ############################
2023-11-03T23:50:21,941           # Package would be ignored #
2023-11-03T23:50:21,942           ############################
2023-11-03T23:50:21,943           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2023-11-03T23:50:21,943           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:21,944           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:21,944           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2023-11-03T23:50:21,945           to the `packages` configuration field.

2023-11-03T23:50:21,945           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:21,946           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:21,946           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:21,947           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:21,947           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:21,948           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2023-11-03T23:50:21,948           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2023-11-03T23:50:21,949           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:21,949           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:21,949           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:21,950           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:21,951           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:21,952           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:21,953                 even if it does not contain any `.py` files.
2023-11-03T23:50:21,953                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:21,954                 directory, all directories are treated like packages.
2023-11-03T23:50:21,954           ********************************************************************************

2023-11-03T23:50:21,955   !!
2023-11-03T23:50:21,956     check.warn(importable)
2023-11-03T23:50:21,956   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2023-11-03T23:50:21,957   !!

2023-11-03T23:50:21,958           ********************************************************************************
2023-11-03T23:50:21,958           ############################
2023-11-03T23:50:21,958           # Package would be ignored #
2023-11-03T23:50:21,959           ############################
2023-11-03T23:50:21,960           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2023-11-03T23:50:21,960           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:21,961           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:21,961           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2023-11-03T23:50:21,962           to the `packages` configuration field.

2023-11-03T23:50:21,963           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:21,963           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:21,964           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:21,965           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:21,966           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:21,967           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2023-11-03T23:50:21,967           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2023-11-03T23:50:21,968           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:21,968           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:21,969           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:21,970           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:21,971           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:21,972           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:21,973                 even if it does not contain any `.py` files.
2023-11-03T23:50:21,973                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:21,973                 directory, all directories are treated like packages.
2023-11-03T23:50:21,974           ********************************************************************************

2023-11-03T23:50:21,974   !!
2023-11-03T23:50:21,975     check.warn(importable)
2023-11-03T23:50:21,975   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2023-11-03T23:50:21,975   !!

2023-11-03T23:50:21,976           ********************************************************************************
2023-11-03T23:50:21,976           ############################
2023-11-03T23:50:21,977           # Package would be ignored #
2023-11-03T23:50:21,977           ############################
2023-11-03T23:50:21,978           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2023-11-03T23:50:21,978           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:21,979           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:21,979           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2023-11-03T23:50:21,980           to the `packages` configuration field.

2023-11-03T23:50:21,981           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:21,981           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:21,982           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:21,983           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:21,984           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:21,985           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2023-11-03T23:50:21,985           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2023-11-03T23:50:21,986           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:21,987           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:21,987           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:21,988           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:21,989           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:21,990           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:21,991                 even if it does not contain any `.py` files.
2023-11-03T23:50:21,991                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:21,992                 directory, all directories are treated like packages.
2023-11-03T23:50:21,992           ********************************************************************************

2023-11-03T23:50:21,993   !!
2023-11-03T23:50:21,994     check.warn(importable)
2023-11-03T23:50:21,994   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2023-11-03T23:50:21,995   !!

2023-11-03T23:50:21,996           ********************************************************************************
2023-11-03T23:50:21,996           ############################
2023-11-03T23:50:21,997           # Package would be ignored #
2023-11-03T23:50:21,997           ############################
2023-11-03T23:50:21,997           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2023-11-03T23:50:21,998           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:21,998           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:21,999           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2023-11-03T23:50:21,999           to the `packages` configuration field.

2023-11-03T23:50:22,000           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,000           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,000           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,001           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,002           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,003           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2023-11-03T23:50:22,003           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2023-11-03T23:50:22,004           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,004           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,004           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,005           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,006           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,007           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,008                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,008                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,008                 directory, all directories are treated like packages.
2023-11-03T23:50:22,009           ********************************************************************************

2023-11-03T23:50:22,010   !!
2023-11-03T23:50:22,010     check.warn(importable)
2023-11-03T23:50:22,011   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2023-11-03T23:50:22,011   !!

2023-11-03T23:50:22,012           ********************************************************************************
2023-11-03T23:50:22,013           ############################
2023-11-03T23:50:22,013           # Package would be ignored #
2023-11-03T23:50:22,013           ############################
2023-11-03T23:50:22,014           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2023-11-03T23:50:22,014           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,015           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,016           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2023-11-03T23:50:22,016           to the `packages` configuration field.

2023-11-03T23:50:22,017           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,018           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,018           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,019           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,020           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,021           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2023-11-03T23:50:22,021           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2023-11-03T23:50:22,022           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,022           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,022           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,023           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,024           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,025           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,025                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,025                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,026                 directory, all directories are treated like packages.
2023-11-03T23:50:22,026           ********************************************************************************

2023-11-03T23:50:22,027   !!
2023-11-03T23:50:22,027     check.warn(importable)
2023-11-03T23:50:22,028   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2023-11-03T23:50:22,028   !!

2023-11-03T23:50:22,029           ********************************************************************************
2023-11-03T23:50:22,029           ############################
2023-11-03T23:50:22,030           # Package would be ignored #
2023-11-03T23:50:22,030           ############################
2023-11-03T23:50:22,030           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2023-11-03T23:50:22,031           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,032           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,033           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2023-11-03T23:50:22,033           to the `packages` configuration field.

2023-11-03T23:50:22,034           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,034           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,035           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,036           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,037           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,038           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2023-11-03T23:50:22,038           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2023-11-03T23:50:22,039           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,039           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,040           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,041           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,042           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,044           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,044                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,045                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,045                 directory, all directories are treated like packages.
2023-11-03T23:50:22,046           ********************************************************************************

2023-11-03T23:50:22,047   !!
2023-11-03T23:50:22,047     check.warn(importable)
2023-11-03T23:50:22,048   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2023-11-03T23:50:22,048   !!

2023-11-03T23:50:22,049           ********************************************************************************
2023-11-03T23:50:22,049           ############################
2023-11-03T23:50:22,049           # Package would be ignored #
2023-11-03T23:50:22,050           ############################
2023-11-03T23:50:22,050           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2023-11-03T23:50:22,050           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,051           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,051           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2023-11-03T23:50:22,052           to the `packages` configuration field.

2023-11-03T23:50:22,053           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,053           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,053           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,054           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,055           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,056           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2023-11-03T23:50:22,056           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2023-11-03T23:50:22,057           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,057           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,058           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,059           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,059           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,061           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,061                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,061                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,062                 directory, all directories are treated like packages.
2023-11-03T23:50:22,062           ********************************************************************************

2023-11-03T23:50:22,063   !!
2023-11-03T23:50:22,064     check.warn(importable)
2023-11-03T23:50:22,064   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration.
2023-11-03T23:50:22,065   !!

2023-11-03T23:50:22,066           ********************************************************************************
2023-11-03T23:50:22,066           ############################
2023-11-03T23:50:22,066           # Package would be ignored #
2023-11-03T23:50:22,067           ############################
2023-11-03T23:50:22,067           Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1],
2023-11-03T23:50:22,068           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,069           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,069           package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added
2023-11-03T23:50:22,070           to the `packages` configuration field.

2023-11-03T23:50:22,071           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,071           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,072           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,072           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,073           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,074           If you don't want 'deepspeed.ops.csrc.common' to be distributed and are
2023-11-03T23:50:22,074           already explicitly excluding 'deepspeed.ops.csrc.common' via
2023-11-03T23:50:22,074           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,075           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,075           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,076           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,076           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,078           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,078                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,078                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,079                 directory, all directories are treated like packages.
2023-11-03T23:50:22,079           ********************************************************************************

2023-11-03T23:50:22,080   !!
2023-11-03T23:50:22,080     check.warn(importable)
2023-11-03T23:50:22,081   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2023-11-03T23:50:22,081   !!

2023-11-03T23:50:22,083           ********************************************************************************
2023-11-03T23:50:22,083           ############################
2023-11-03T23:50:22,084           # Package would be ignored #
2023-11-03T23:50:22,084           ############################
2023-11-03T23:50:22,084           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2023-11-03T23:50:22,085           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,086           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,086           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2023-11-03T23:50:22,087           to the `packages` configuration field.

2023-11-03T23:50:22,088           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,088           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,089           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,090           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,090           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,091           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2023-11-03T23:50:22,092           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2023-11-03T23:50:22,092           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,093           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,093           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,094           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,096           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,097           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,097                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,097                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,098                 directory, all directories are treated like packages.
2023-11-03T23:50:22,098           ********************************************************************************

2023-11-03T23:50:22,099   !!
2023-11-03T23:50:22,099     check.warn(importable)
2023-11-03T23:50:22,099   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2023-11-03T23:50:22,100   !!

2023-11-03T23:50:22,100           ********************************************************************************
2023-11-03T23:50:22,101           ############################
2023-11-03T23:50:22,101           # Package would be ignored #
2023-11-03T23:50:22,102           ############################
2023-11-03T23:50:22,102           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2023-11-03T23:50:22,102           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,103           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,104           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2023-11-03T23:50:22,104           to the `packages` configuration field.

2023-11-03T23:50:22,105           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,105           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,106           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,106           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,107           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,108           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2023-11-03T23:50:22,109           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2023-11-03T23:50:22,109           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,110           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,110           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,111           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,112           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,114           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,114                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,115                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,115                 directory, all directories are treated like packages.
2023-11-03T23:50:22,116           ********************************************************************************

2023-11-03T23:50:22,117   !!
2023-11-03T23:50:22,117     check.warn(importable)
2023-11-03T23:50:22,118   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2023-11-03T23:50:22,118   !!

2023-11-03T23:50:22,119           ********************************************************************************
2023-11-03T23:50:22,120           ############################
2023-11-03T23:50:22,120           # Package would be ignored #
2023-11-03T23:50:22,121           ############################
2023-11-03T23:50:22,121           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2023-11-03T23:50:22,122           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,123           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,123           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2023-11-03T23:50:22,124           to the `packages` configuration field.

2023-11-03T23:50:22,125           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,125           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,125           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,126           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,127           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,128           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2023-11-03T23:50:22,128           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2023-11-03T23:50:22,128           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,129           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,129           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,130           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,131           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,132           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,133                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,133                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,134                 directory, all directories are treated like packages.
2023-11-03T23:50:22,134           ********************************************************************************

2023-11-03T23:50:22,135   !!
2023-11-03T23:50:22,136     check.warn(importable)
2023-11-03T23:50:22,136   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2023-11-03T23:50:22,137   !!

2023-11-03T23:50:22,138           ********************************************************************************
2023-11-03T23:50:22,138           ############################
2023-11-03T23:50:22,139           # Package would be ignored #
2023-11-03T23:50:22,139           ############################
2023-11-03T23:50:22,140           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2023-11-03T23:50:22,140           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,141           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,142           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2023-11-03T23:50:22,142           to the `packages` configuration field.

2023-11-03T23:50:22,143           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,144           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,144           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,145           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,146           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,147           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2023-11-03T23:50:22,148           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2023-11-03T23:50:22,149           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,149           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,149           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,150           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,151           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,153           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,153                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,153                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,154                 directory, all directories are treated like packages.
2023-11-03T23:50:22,154           ********************************************************************************

2023-11-03T23:50:22,155   !!
2023-11-03T23:50:22,155     check.warn(importable)
2023-11-03T23:50:22,156   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2023-11-03T23:50:22,156   !!

2023-11-03T23:50:22,157           ********************************************************************************
2023-11-03T23:50:22,158           ############################
2023-11-03T23:50:22,158           # Package would be ignored #
2023-11-03T23:50:22,159           ############################
2023-11-03T23:50:22,159           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2023-11-03T23:50:22,160           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,161           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,161           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2023-11-03T23:50:22,162           to the `packages` configuration field.

2023-11-03T23:50:22,163           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,163           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,164           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,165           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,165           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,166           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2023-11-03T23:50:22,167           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2023-11-03T23:50:22,167           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,168           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,168           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,169           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,170           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,172           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,172                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,173                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,173                 directory, all directories are treated like packages.
2023-11-03T23:50:22,174           ********************************************************************************

2023-11-03T23:50:22,175   !!
2023-11-03T23:50:22,175     check.warn(importable)
2023-11-03T23:50:22,175   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2023-11-03T23:50:22,176   !!

2023-11-03T23:50:22,177           ********************************************************************************
2023-11-03T23:50:22,177           ############################
2023-11-03T23:50:22,177           # Package would be ignored #
2023-11-03T23:50:22,178           ############################
2023-11-03T23:50:22,178           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2023-11-03T23:50:22,179           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,179           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,180           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2023-11-03T23:50:22,180           to the `packages` configuration field.

2023-11-03T23:50:22,181           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,182           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,182           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,183           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,184           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,185           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2023-11-03T23:50:22,185           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2023-11-03T23:50:22,186           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,186           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,187           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,187           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,188           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,190           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,190                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,191                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,192                 directory, all directories are treated like packages.
2023-11-03T23:50:22,192           ********************************************************************************

2023-11-03T23:50:22,193   !!
2023-11-03T23:50:22,194     check.warn(importable)
2023-11-03T23:50:22,194   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2023-11-03T23:50:22,195   !!

2023-11-03T23:50:22,195           ********************************************************************************
2023-11-03T23:50:22,196           ############################
2023-11-03T23:50:22,196           # Package would be ignored #
2023-11-03T23:50:22,197           ############################
2023-11-03T23:50:22,197           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2023-11-03T23:50:22,198           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,199           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,199           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2023-11-03T23:50:22,200           to the `packages` configuration field.

2023-11-03T23:50:22,201           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,201           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,202           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,203           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,204           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,205           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2023-11-03T23:50:22,205           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2023-11-03T23:50:22,205           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,206           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,206           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,207           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,208           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,210           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,210                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,210                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,211                 directory, all directories are treated like packages.
2023-11-03T23:50:22,211           ********************************************************************************

2023-11-03T23:50:22,212   !!
2023-11-03T23:50:22,213     check.warn(importable)
2023-11-03T23:50:22,213   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2023-11-03T23:50:22,214   !!

2023-11-03T23:50:22,215           ********************************************************************************
2023-11-03T23:50:22,215           ############################
2023-11-03T23:50:22,216           # Package would be ignored #
2023-11-03T23:50:22,216           ############################
2023-11-03T23:50:22,217           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2023-11-03T23:50:22,217           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,218           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,218           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2023-11-03T23:50:22,219           to the `packages` configuration field.

2023-11-03T23:50:22,220           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,220           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,221           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,222           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,223           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,224           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2023-11-03T23:50:22,225           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2023-11-03T23:50:22,225           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,226           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,226           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,227           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,228           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,229           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,230                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,230                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,230                 directory, all directories are treated like packages.
2023-11-03T23:50:22,231           ********************************************************************************

2023-11-03T23:50:22,232   !!
2023-11-03T23:50:22,233     check.warn(importable)
2023-11-03T23:50:22,233   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2023-11-03T23:50:22,234   !!

2023-11-03T23:50:22,234           ********************************************************************************
2023-11-03T23:50:22,235           ############################
2023-11-03T23:50:22,235           # Package would be ignored #
2023-11-03T23:50:22,236           ############################
2023-11-03T23:50:22,236           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2023-11-03T23:50:22,237           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,238           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,238           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2023-11-03T23:50:22,239           to the `packages` configuration field.

2023-11-03T23:50:22,240           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,240           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,241           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,243           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,244           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,245           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2023-11-03T23:50:22,245           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2023-11-03T23:50:22,246           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,246           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,247           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,248           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,249           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,250           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,251                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,251                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,252                 directory, all directories are treated like packages.
2023-11-03T23:50:22,252           ********************************************************************************

2023-11-03T23:50:22,254   !!
2023-11-03T23:50:22,254     check.warn(importable)
2023-11-03T23:50:22,255   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2023-11-03T23:50:22,255   !!

2023-11-03T23:50:22,257           ********************************************************************************
2023-11-03T23:50:22,257           ############################
2023-11-03T23:50:22,258           # Package would be ignored #
2023-11-03T23:50:22,258           ############################
2023-11-03T23:50:22,258           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2023-11-03T23:50:22,259           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,260           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,260           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2023-11-03T23:50:22,261           to the `packages` configuration field.

2023-11-03T23:50:22,261           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,262           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,262           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,263           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,264           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,265           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2023-11-03T23:50:22,265           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2023-11-03T23:50:22,266           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,266           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,267           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,268           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,269           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,271           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,271                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,272                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,272                 directory, all directories are treated like packages.
2023-11-03T23:50:22,273           ********************************************************************************

2023-11-03T23:50:22,274   !!
2023-11-03T23:50:22,274     check.warn(importable)
2023-11-03T23:50:22,275   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2023-11-03T23:50:22,276   !!

2023-11-03T23:50:22,277           ********************************************************************************
2023-11-03T23:50:22,277           ############################
2023-11-03T23:50:22,277           # Package would be ignored #
2023-11-03T23:50:22,278           ############################
2023-11-03T23:50:22,279           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2023-11-03T23:50:22,279           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,280           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,281           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2023-11-03T23:50:22,281           to the `packages` configuration field.

2023-11-03T23:50:22,284           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,284           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,285           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,286           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,288           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,289           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2023-11-03T23:50:22,289           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2023-11-03T23:50:22,290           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,290           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,291           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,291           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,293           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,295           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,295                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,295                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,296                 directory, all directories are treated like packages.
2023-11-03T23:50:22,296           ********************************************************************************

2023-11-03T23:50:22,298   !!
2023-11-03T23:50:22,298     check.warn(importable)
2023-11-03T23:50:22,298   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2023-11-03T23:50:22,299   !!

2023-11-03T23:50:22,300           ********************************************************************************
2023-11-03T23:50:22,301           ############################
2023-11-03T23:50:22,302           # Package would be ignored #
2023-11-03T23:50:22,302           ############################
2023-11-03T23:50:22,303           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2023-11-03T23:50:22,303           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,304           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,305           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2023-11-03T23:50:22,305           to the `packages` configuration field.

2023-11-03T23:50:22,306           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,307           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,307           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,308           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,309           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,310           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2023-11-03T23:50:22,311           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2023-11-03T23:50:22,311           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,312           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,312           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,313           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,314           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,316           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,317                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,317                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,318                 directory, all directories are treated like packages.
2023-11-03T23:50:22,318           ********************************************************************************

2023-11-03T23:50:22,319   !!
2023-11-03T23:50:22,319     check.warn(importable)
2023-11-03T23:50:22,320   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2023-11-03T23:50:22,320   !!

2023-11-03T23:50:22,321           ********************************************************************************
2023-11-03T23:50:22,321           ############################
2023-11-03T23:50:22,322           # Package would be ignored #
2023-11-03T23:50:22,322           ############################
2023-11-03T23:50:22,323           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2023-11-03T23:50:22,323           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,324           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,324           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2023-11-03T23:50:22,325           to the `packages` configuration field.

2023-11-03T23:50:22,326           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,326           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,326           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,327           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,328           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,329           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2023-11-03T23:50:22,330           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2023-11-03T23:50:22,330           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,331           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,331           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,332           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,333           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,335           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,335                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,336                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,336                 directory, all directories are treated like packages.
2023-11-03T23:50:22,337           ********************************************************************************

2023-11-03T23:50:22,338   !!
2023-11-03T23:50:22,338     check.warn(importable)
2023-11-03T23:50:22,339   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2023-11-03T23:50:22,339   !!

2023-11-03T23:50:22,340           ********************************************************************************
2023-11-03T23:50:22,341           ############################
2023-11-03T23:50:22,341           # Package would be ignored #
2023-11-03T23:50:22,342           ############################
2023-11-03T23:50:22,342           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2023-11-03T23:50:22,343           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,344           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,344           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2023-11-03T23:50:22,345           to the `packages` configuration field.

2023-11-03T23:50:22,346           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,346           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,347           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,348           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,349           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,349           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2023-11-03T23:50:22,350           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2023-11-03T23:50:22,350           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,351           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,351           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,352           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,353           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,355           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,355                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,356                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,356                 directory, all directories are treated like packages.
2023-11-03T23:50:22,357           ********************************************************************************

2023-11-03T23:50:22,358   !!
2023-11-03T23:50:22,358     check.warn(importable)
2023-11-03T23:50:22,359   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2023-11-03T23:50:22,359   !!

2023-11-03T23:50:22,360           ********************************************************************************
2023-11-03T23:50:22,361           ############################
2023-11-03T23:50:22,361           # Package would be ignored #
2023-11-03T23:50:22,362           ############################
2023-11-03T23:50:22,362           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2023-11-03T23:50:22,363           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,364           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,364           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2023-11-03T23:50:22,365           to the `packages` configuration field.

2023-11-03T23:50:22,366           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,366           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,367           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,368           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,369           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,370           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2023-11-03T23:50:22,371           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2023-11-03T23:50:22,371           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,372           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,372           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,373           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,375           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,376           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,376                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,377                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,378                 directory, all directories are treated like packages.
2023-11-03T23:50:22,378           ********************************************************************************

2023-11-03T23:50:22,379   !!
2023-11-03T23:50:22,379     check.warn(importable)
2023-11-03T23:50:22,379   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2023-11-03T23:50:22,380   !!

2023-11-03T23:50:22,381           ********************************************************************************
2023-11-03T23:50:22,381           ############################
2023-11-03T23:50:22,381           # Package would be ignored #
2023-11-03T23:50:22,382           ############################
2023-11-03T23:50:22,383           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2023-11-03T23:50:22,383           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,384           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,384           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2023-11-03T23:50:22,385           to the `packages` configuration field.

2023-11-03T23:50:22,386           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,386           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,387           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,387           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,388           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,389           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2023-11-03T23:50:22,390           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2023-11-03T23:50:22,390           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,391           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,391           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,392           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,393           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,395           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,395                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,396                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,396                 directory, all directories are treated like packages.
2023-11-03T23:50:22,397           ********************************************************************************

2023-11-03T23:50:22,398   !!
2023-11-03T23:50:22,398     check.warn(importable)
2023-11-03T23:50:22,399   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2023-11-03T23:50:22,399   !!

2023-11-03T23:50:22,400           ********************************************************************************
2023-11-03T23:50:22,401           ############################
2023-11-03T23:50:22,401           # Package would be ignored #
2023-11-03T23:50:22,402           ############################
2023-11-03T23:50:22,403           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2023-11-03T23:50:22,403           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,404           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,404           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2023-11-03T23:50:22,405           to the `packages` configuration field.

2023-11-03T23:50:22,406           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,406           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,407           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,408           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,409           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,410           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2023-11-03T23:50:22,410           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2023-11-03T23:50:22,410           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,411           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,411           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,412           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,413           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,415           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,415                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,416                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,416                 directory, all directories are treated like packages.
2023-11-03T23:50:22,417           ********************************************************************************

2023-11-03T23:50:22,418   !!
2023-11-03T23:50:22,418     check.warn(importable)
2023-11-03T23:50:22,419   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2023-11-03T23:50:22,419   !!

2023-11-03T23:50:22,421           ********************************************************************************
2023-11-03T23:50:22,421           ############################
2023-11-03T23:50:22,422           # Package would be ignored #
2023-11-03T23:50:22,422           ############################
2023-11-03T23:50:22,423           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2023-11-03T23:50:22,423           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,424           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,425           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2023-11-03T23:50:22,425           to the `packages` configuration field.

2023-11-03T23:50:22,426           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,427           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,427           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,429           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,429           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,431           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2023-11-03T23:50:22,431           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2023-11-03T23:50:22,432           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,432           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,433           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,433           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,434           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,436           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,436                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,436                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,437                 directory, all directories are treated like packages.
2023-11-03T23:50:22,438           ********************************************************************************

2023-11-03T23:50:22,439   !!
2023-11-03T23:50:22,439     check.warn(importable)
2023-11-03T23:50:22,440   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2023-11-03T23:50:22,440   !!

2023-11-03T23:50:22,441           ********************************************************************************
2023-11-03T23:50:22,442           ############################
2023-11-03T23:50:22,442           # Package would be ignored #
2023-11-03T23:50:22,443           ############################
2023-11-03T23:50:22,443           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2023-11-03T23:50:22,444           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,445           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,445           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2023-11-03T23:50:22,446           to the `packages` configuration field.

2023-11-03T23:50:22,447           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,447           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,448           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,449           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,450           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,451           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2023-11-03T23:50:22,451           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2023-11-03T23:50:22,452           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,452           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,453           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,454           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,455           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,456           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,457                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,457                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,458                 directory, all directories are treated like packages.
2023-11-03T23:50:22,458           ********************************************************************************

2023-11-03T23:50:22,459   !!
2023-11-03T23:50:22,460     check.warn(importable)
2023-11-03T23:50:22,460   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2023-11-03T23:50:22,460   !!

2023-11-03T23:50:22,461           ********************************************************************************
2023-11-03T23:50:22,462           ############################
2023-11-03T23:50:22,462           # Package would be ignored #
2023-11-03T23:50:22,462           ############################
2023-11-03T23:50:22,463           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2023-11-03T23:50:22,463           but it is absent from setuptools' `packages` configuration.

2023-11-03T23:50:22,464           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T23:50:22,465           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2023-11-03T23:50:22,465           to the `packages` configuration field.

2023-11-03T23:50:22,466           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T23:50:22,467           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T23:50:22,468           instead of `find_packages(...)`/`find:`).

2023-11-03T23:50:22,469           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T23:50:22,470           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T23:50:22,471           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2023-11-03T23:50:22,471           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2023-11-03T23:50:22,472           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T23:50:22,472           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T23:50:22,473           combination with a more fine grained `package-data` configuration.

2023-11-03T23:50:22,474           You can read more about "package data files" on setuptools documentation page:

2023-11-03T23:50:22,475           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T23:50:22,476           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T23:50:22,477                 even if it does not contain any `.py` files.
2023-11-03T23:50:22,477                 On the other hand, currently there is no concept of package data
2023-11-03T23:50:22,478                 directory, all directories are treated like packages.
2023-11-03T23:50:22,478           ********************************************************************************

2023-11-03T23:50:22,479   !!
2023-11-03T23:50:22,480     check.warn(importable)
2023-11-03T23:50:22,481   creating build/lib/deepspeed/autotuning/config_templates
2023-11-03T23:50:22,481   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2023-11-03T23:50:22,482   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2023-11-03T23:50:22,483   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2023-11-03T23:50:22,483   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2023-11-03T23:50:22,483   creating build/lib/deepspeed/ops/csrc
2023-11-03T23:50:22,484   creating build/lib/deepspeed/ops/csrc/adagrad
2023-11-03T23:50:22,485   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2023-11-03T23:50:22,485   creating build/lib/deepspeed/ops/csrc/adam
2023-11-03T23:50:22,486   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2023-11-03T23:50:22,486   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2023-11-03T23:50:22,487   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2023-11-03T23:50:22,488   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2023-11-03T23:50:22,488   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2023-11-03T23:50:22,488   creating build/lib/deepspeed/ops/csrc/aio
2023-11-03T23:50:22,489   creating build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:22,489   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:22,490   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:22,490   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:22,491   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:22,491   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:22,492   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:22,492   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,493   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,493   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,493   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,494   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,495   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,495   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,495   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,496   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,496   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,497   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,498   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:22,498   creating build/lib/deepspeed/ops/csrc/aio/py_test
2023-11-03T23:50:22,498   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2023-11-03T23:50:22,499   creating build/lib/deepspeed/ops/csrc/common
2023-11-03T23:50:22,499   copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common
2023-11-03T23:50:22,500   creating build/lib/deepspeed/ops/csrc/cpu
2023-11-03T23:50:22,500   creating build/lib/deepspeed/ops/csrc/cpu/adam
2023-11-03T23:50:22,501   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2023-11-03T23:50:22,502   creating build/lib/deepspeed/ops/csrc/cpu/comm
2023-11-03T23:50:22,502   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2023-11-03T23:50:22,503   creating build/lib/deepspeed/ops/csrc/cpu/lion
2023-11-03T23:50:22,503   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2023-11-03T23:50:22,504   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2023-11-03T23:50:22,504   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:22,505   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:22,506   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:22,506   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:22,507   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:22,507   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:22,508   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:22,508   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T23:50:22,509   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T23:50:22,509   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T23:50:22,510   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T23:50:22,510   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T23:50:22,510   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:22,511   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:22,511   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:22,512   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:22,512   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:22,513   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:22,513   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:22,514   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:22,514   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:22,515   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:22,515   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:22,516   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:22,516   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:22,517   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:22,518   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:22,518   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:22,518   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T23:50:22,519   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T23:50:22,519   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T23:50:22,520   creating build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,521   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,521   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,521   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,522   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,522   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,523   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,523   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,524   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,524   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,525   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,525   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,526   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,526   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,527   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,528   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,528   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,529   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,529   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,530   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,530   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,531   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,531   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,532   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,532   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,533   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,533   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,534   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,534   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,535   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T23:50:22,535   creating build/lib/deepspeed/ops/csrc/lamb
2023-11-03T23:50:22,535   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2023-11-03T23:50:22,536   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2023-11-03T23:50:22,536   creating build/lib/deepspeed/ops/csrc/lion
2023-11-03T23:50:22,537   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2023-11-03T23:50:22,537   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2023-11-03T23:50:22,537   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2023-11-03T23:50:22,538   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2023-11-03T23:50:22,538   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2023-11-03T23:50:22,539   creating build/lib/deepspeed/ops/csrc/quantization
2023-11-03T23:50:22,539   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T23:50:22,540   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T23:50:22,540   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T23:50:22,541   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T23:50:22,541   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T23:50:22,542   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T23:50:22,542   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T23:50:22,543   creating build/lib/deepspeed/ops/csrc/random_ltd
2023-11-03T23:50:22,543   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2023-11-03T23:50:22,544   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2023-11-03T23:50:22,544   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2023-11-03T23:50:22,545   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2023-11-03T23:50:22,545   creating build/lib/deepspeed/ops/csrc/sparse_attention
2023-11-03T23:50:22,546   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2023-11-03T23:50:22,546   creating build/lib/deepspeed/ops/csrc/spatial
2023-11-03T23:50:22,547   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2023-11-03T23:50:22,547   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2023-11-03T23:50:22,548   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2023-11-03T23:50:22,548   creating build/lib/deepspeed/ops/csrc/spatial/includes
2023-11-03T23:50:22,549   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2023-11-03T23:50:22,549   creating build/lib/deepspeed/ops/csrc/transformer
2023-11-03T23:50:22,550   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T23:50:22,550   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T23:50:22,551   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T23:50:22,551   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T23:50:22,552   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T23:50:22,552   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T23:50:22,553   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T23:50:22,553   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T23:50:22,553   creating build/lib/deepspeed/ops/csrc/transformer/inference
2023-11-03T23:50:22,554   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,554   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,555   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,555   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,555   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,556   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,556   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,557   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,557   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,558   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,558   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:22,559   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T23:50:22,559   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T23:50:22,559   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T23:50:22,560   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T23:50:22,560   creating build/lib/deepspeed/ops/csrc/utils
2023-11-03T23:50:22,561   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2023-11-03T23:50:22,561   creating build/lib/deepspeed/inference/v2/ragged/csrc
2023-11-03T23:50:22,562   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2023-11-03T23:50:22,562   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2023-11-03T23:50:22,563   creating build/lib/deepspeed/inference/v2/ragged/includes
2023-11-03T23:50:22,563   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2023-11-03T23:50:22,564   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2023-11-03T23:50:22,564   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2023-11-03T23:50:22,565   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2023-11-03T23:50:22,566   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2023-11-03T23:50:22,566   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-11-03T23:50:22,566   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-11-03T23:50:22,567   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-11-03T23:50:22,567   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-11-03T23:50:22,568   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2023-11-03T23:50:22,568   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:22,569   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:22,571   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:22,573   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:22,575   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:22,577   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:22,579   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,582   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,584   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,586   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,588   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,590   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,593   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,595   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,597   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:22,599   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:22,602   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:22,604   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:22,606   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:22,608   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:22,610   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:22,611   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:22,613   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-11-03T23:50:22,615   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-11-03T23:50:22,617   copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:22,619   copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:22,621   copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:22,623   copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:22,625   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:22,627   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:22,629   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:22,631   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:22,633   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:22,636   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:22,638   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:22,640   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:22,642   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:22,645   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:22,647   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:22,649   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:22,651   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:22,654   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:22,656   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:22,658   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:22,660   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:22,662   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:22,664   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:22,667   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:22,669   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-11-03T23:50:22,671   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-11-03T23:50:22,674   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-11-03T23:50:22,676   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-11-03T23:50:22,678   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-11-03T23:50:22,723   running build_scripts
2023-11-03T23:50:22,723   creating build/scripts-3.11
2023-11-03T23:50:22,724   copying and adjusting bin/deepspeed -> build/scripts-3.11
2023-11-03T23:50:22,726   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2023-11-03T23:50:22,727   copying and adjusting bin/ds -> build/scripts-3.11
2023-11-03T23:50:22,728   copying bin/ds_ssh -> build/scripts-3.11
2023-11-03T23:50:22,730   copying and adjusting bin/ds_report -> build/scripts-3.11
2023-11-03T23:50:22,732   copying and adjusting bin/ds_bench -> build/scripts-3.11
2023-11-03T23:50:22,733   copying and adjusting bin/dsr -> build/scripts-3.11
2023-11-03T23:50:22,734   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2023-11-03T23:50:22,735   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2023-11-03T23:50:22,736   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2023-11-03T23:50:22,736   changing mode of build/scripts-3.11/ds from 644 to 755
2023-11-03T23:50:22,737   changing mode of build/scripts-3.11/ds_report from 644 to 755
2023-11-03T23:50:22,737   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2023-11-03T23:50:22,738   changing mode of build/scripts-3.11/dsr from 644 to 755
2023-11-03T23:50:22,738   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2023-11-03T23:50:22,762   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2023-11-03T23:50:22,762   !!

2023-11-03T23:50:22,764           ********************************************************************************
2023-11-03T23:50:22,764           Please avoid running ``setup.py`` directly.
2023-11-03T23:50:22,765           Instead, use pypa/build, pypa/installer or other
2023-11-03T23:50:22,766           standards-based tools.

2023-11-03T23:50:22,767           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2023-11-03T23:50:22,767           ********************************************************************************

2023-11-03T23:50:22,768   !!
2023-11-03T23:50:22,769     self.initialize_options()
2023-11-03T23:50:22,786   installing to build/bdist.linux-armv7l/wheel
2023-11-03T23:50:22,787   running install
2023-11-03T23:50:22,810   running install_lib
2023-11-03T23:50:22,834   creating build/bdist.linux-armv7l
2023-11-03T23:50:22,835   creating build/bdist.linux-armv7l/wheel
2023-11-03T23:50:22,837   creating build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T23:50:22,838   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T23:50:22,839   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T23:50:22,842   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-11-03T23:50:22,843   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-11-03T23:50:22,845   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-11-03T23:50:22,848   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T23:50:22,849   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T23:50:22,851   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T23:50:22,853   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T23:50:22,855   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T23:50:22,857   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T23:50:22,860   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-11-03T23:50:22,860   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-11-03T23:50:22,862   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-11-03T23:50:22,864   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-11-03T23:50:22,866   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2023-11-03T23:50:22,867   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2023-11-03T23:50:22,869   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2023-11-03T23:50:22,870   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2023-11-03T23:50:22,872   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2023-11-03T23:50:22,874   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-11-03T23:50:22,876   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-11-03T23:50:22,877   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-11-03T23:50:22,879   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-11-03T23:50:22,881   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2023-11-03T23:50:22,883   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2023-11-03T23:50:22,885   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2023-11-03T23:50:22,886   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2023-11-03T23:50:22,888   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2023-11-03T23:50:22,890   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-11-03T23:50:22,892   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-11-03T23:50:22,894   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-11-03T23:50:22,896   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-11-03T23:50:22,899   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2023-11-03T23:50:22,901   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-11-03T23:50:22,903   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-11-03T23:50:22,906   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2023-11-03T23:50:22,907   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2023-11-03T23:50:22,909   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2023-11-03T23:50:22,911   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2023-11-03T23:50:22,913   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2023-11-03T23:50:22,915   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2023-11-03T23:50:22,918   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2023-11-03T23:50:22,919   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2023-11-03T23:50:22,922   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:22,923   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:22,925   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:22,928   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:22,930   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:22,932   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2023-11-03T23:50:22,935   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:22,936   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:22,941   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:22,943   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:22,945   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:22,947   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:22,949   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2023-11-03T23:50:22,952   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2023-11-03T23:50:22,953   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2023-11-03T23:50:22,956   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,957   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,960   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,962   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,964   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,967   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,969   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2023-11-03T23:50:22,971   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,973   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,975   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,977   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,980   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,982   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,984   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2023-11-03T23:50:22,987   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:22,988   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:22,991   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:22,993   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:22,995   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:22,998   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:23,000   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:23,003   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:23,005   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2023-11-03T23:50:23,008   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:23,009   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:23,010   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:23,012   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:23,014   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:23,016   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:23,017   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2023-11-03T23:50:23,020   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-11-03T23:50:23,021   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-11-03T23:50:23,023   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-11-03T23:50:23,024   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-11-03T23:50:23,026   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2023-11-03T23:50:23,028   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:23,030   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:23,031   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:23,033   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:23,035   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:23,036   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:23,038   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating
2023-11-03T23:50:23,040   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2023-11-03T23:50:23,042   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:23,043   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:23,044   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:23,046   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:23,048   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:23,050   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:23,052   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2023-11-03T23:50:23,054   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:23,055   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:23,057   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:23,059   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:23,060   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:23,062   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:23,064   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2023-11-03T23:50:23,066   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-11-03T23:50:23,067   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-11-03T23:50:23,069   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-11-03T23:50:23,071   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2023-11-03T23:50:23,073   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2023-11-03T23:50:23,074   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2023-11-03T23:50:23,076   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:23,077   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:23,079   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:23,080   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:23,082   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:23,084   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2023-11-03T23:50:23,087   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:23,087   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:23,089   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:23,091   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:23,093   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:23,095   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2023-11-03T23:50:23,097   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2023-11-03T23:50:23,099   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:23,100   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:23,103   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:23,105   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:23,107   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:23,110   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:23,111   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:23,113   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2023-11-03T23:50:23,115   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:23,116   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:23,118   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:23,121   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:23,123   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:23,125   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:23,126   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:23,128   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:23,130   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2023-11-03T23:50:23,133   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-11-03T23:50:23,133   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-11-03T23:50:23,135   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-11-03T23:50:23,137   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-11-03T23:50:23,140   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2023-11-03T23:50:23,143   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:23,144   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:23,145   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:23,148   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:23,150   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:23,153   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:23,155   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:23,158   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:23,160   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:23,162   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:23,164   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2023-11-03T23:50:23,166   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:23,168   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:23,170   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2023-11-03T23:50:23,171   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2023-11-03T23:50:23,173   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2023-11-03T23:50:23,175   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2023-11-03T23:50:23,177   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2023-11-03T23:50:23,179   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:23,182   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2023-11-03T23:50:23,183   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2023-11-03T23:50:23,185   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2023-11-03T23:50:23,187   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2023-11-03T23:50:23,189   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2023-11-03T23:50:23,191   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:23,193   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2023-11-03T23:50:23,194   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2023-11-03T23:50:23,196   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2023-11-03T23:50:23,198   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2023-11-03T23:50:23,200   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2023-11-03T23:50:23,202   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:23,205   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:23,206   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:23,208   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:23,210   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:23,211   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:23,213   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:23,215   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:23,217   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:23,219   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:23,221   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2023-11-03T23:50:23,223   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2023-11-03T23:50:23,226   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2023-11-03T23:50:23,228   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2023-11-03T23:50:23,231   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:23,232   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:23,234   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:23,236   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:23,237   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:23,239   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:23,241   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:23,243   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2023-11-03T23:50:23,245   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2023-11-03T23:50:23,247   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2023-11-03T23:50:23,248   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2023-11-03T23:50:23,250   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2023-11-03T23:50:23,251   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2023-11-03T23:50:23,253   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2023-11-03T23:50:23,256   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2023-11-03T23:50:23,257   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/gate_fn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2023-11-03T23:50:23,260   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2023-11-03T23:50:23,261   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2023-11-03T23:50:23,263   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2023-11-03T23:50:23,265   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2023-11-03T23:50:23,266   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2023-11-03T23:50:23,268   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2023-11-03T23:50:23,270   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2023-11-03T23:50:23,271   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2023-11-03T23:50:23,273   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2023-11-03T23:50:23,276   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2023-11-03T23:50:23,277   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2023-11-03T23:50:23,279   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2023-11-03T23:50:23,281   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2023-11-03T23:50:23,282   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2023-11-03T23:50:23,284   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2023-11-03T23:50:23,286   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2023-11-03T23:50:23,288   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2023-11-03T23:50:23,289   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2023-11-03T23:50:23,291   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2023-11-03T23:50:23,293   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2023-11-03T23:50:23,295   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:23,296   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:23,298   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:23,300   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:23,302   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:23,311   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:23,313   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:23,315   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:23,316   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2023-11-03T23:50:23,318   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2023-11-03T23:50:23,320   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2023-11-03T23:50:23,322   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-11-03T23:50:23,325   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2023-11-03T23:50:23,327   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-11-03T23:50:23,329   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T23:50:23,331   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T23:50:23,332   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T23:50:23,334   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T23:50:23,336   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T23:50:23,337   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T23:50:23,339   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T23:50:23,341   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T23:50:23,342   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T23:50:23,345   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T23:50:23,345   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T23:50:23,347   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T23:50:23,349   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T23:50:23,351   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T23:50:23,353   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T23:50:23,356   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T23:50:23,358   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2023-11-03T23:50:23,359   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2023-11-03T23:50:23,361   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2023-11-03T23:50:23,363   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T23:50:23,364   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T23:50:23,366   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T23:50:23,368   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T23:50:23,371   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T23:50:23,373   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T23:50:23,376   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T23:50:23,377   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T23:50:23,379   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T23:50:23,381   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T23:50:23,383   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T23:50:23,385   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T23:50:23,386   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T23:50:23,389   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T23:50:23,391   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-11-03T23:50:23,392   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-11-03T23:50:23,394   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-11-03T23:50:23,396   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-11-03T23:50:23,397   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-11-03T23:50:23,399   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T23:50:23,400   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T23:50:23,402   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T23:50:23,404   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T23:50:23,407   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T23:50:23,409   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T23:50:23,412   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,413   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,415   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,416   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,418   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,421   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,423   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,424   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,427   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,429   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,431   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T23:50:23,434   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T23:50:23,435   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T23:50:23,437   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T23:50:23,439   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T23:50:23,441   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T23:50:23,443   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T23:50:23,446   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T23:50:23,448   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T23:50:23,451   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T23:50:23,454   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T23:50:23,457   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T23:50:23,457   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T23:50:23,459   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T23:50:23,461   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T23:50:23,464   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T23:50:23,466   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T23:50:23,469   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T23:50:23,471   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T23:50:23,473   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T23:50:23,475   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2023-11-03T23:50:23,476   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2023-11-03T23:50:23,479   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2023-11-03T23:50:23,479   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2023-11-03T23:50:23,481   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2023-11-03T23:50:23,484   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,484   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,487   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,489   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,491   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,492   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,494   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,496   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,498   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,500   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,501   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T23:50:23,504   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-11-03T23:50:23,505   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-11-03T23:50:23,507   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-11-03T23:50:23,509   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-11-03T23:50:23,512   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,513   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,515   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,517   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,519   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,521   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,523   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,525   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,527   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,529   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,532   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,534   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,536   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,538   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,540   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T23:50:23,543   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2023-11-03T23:50:23,544   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-11-03T23:50:23,545   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-11-03T23:50:23,547   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-11-03T23:50:23,549   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-11-03T23:50:23,552   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-11-03T23:50:23,554   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2023-11-03T23:50:23,556   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2023-11-03T23:50:23,558   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2023-11-03T23:50:23,560   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2023-11-03T23:50:23,563   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2023-11-03T23:50:23,564   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2023-11-03T23:50:23,566   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2023-11-03T23:50:23,569   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,570   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,572   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,574   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,575   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,577   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,580   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-11-03T23:50:23,580   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-11-03T23:50:23,582   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-11-03T23:50:23,584   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-11-03T23:50:23,586   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-11-03T23:50:23,588   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,589   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,592   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:23,593   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:23,595   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:23,596   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:23,598   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:23,600   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:23,602   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T23:50:23,603   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,605   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,607   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,609   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,611   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,614   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,615   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,617   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,619   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,621   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,623   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,625   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,627   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,628   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,630   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T23:50:23,632   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2023-11-03T23:50:23,633   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2023-11-03T23:50:23,635   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2023-11-03T23:50:23,638   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2023-11-03T23:50:23,639   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T23:50:23,640   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T23:50:23,642   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T23:50:23,644   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T23:50:23,645   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T23:50:23,647   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T23:50:23,650   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-11-03T23:50:23,651   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-11-03T23:50:23,653   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-11-03T23:50:23,655   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-11-03T23:50:23,657   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-11-03T23:50:23,660   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2023-11-03T23:50:23,662   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:23,663   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:23,665   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:23,667   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:23,668   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:23,671   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:23,673   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:23,677   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:23,679   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:23,682   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:23,685   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T23:50:23,687   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T23:50:23,688   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T23:50:23,691   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T23:50:23,693   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T23:50:23,696   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T23:50:23,699   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:23,699   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:23,702   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:23,704   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:23,707   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:23,710   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:23,715   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:23,718   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T23:50:23,721   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:23,724   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:23,728   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T23:50:23,729   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T23:50:23,732   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T23:50:23,735   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:23,740   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T23:50:23,745   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2023-11-03T23:50:23,746   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2023-11-03T23:50:23,748   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2023-11-03T23:50:23,753   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,754   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,756   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,759   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,761   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,764   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,766   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,769   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,771   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,774   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,777   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,780   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,782   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,785   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,787   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,790   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,793   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,796   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,799   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,801   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,805   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,807   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,809   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,811   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,813   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,815   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,816   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,818   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,820   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,822   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T23:50:23,825   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2023-11-03T23:50:23,827   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2023-11-03T23:50:23,827   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2023-11-03T23:50:23,830   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2023-11-03T23:50:23,830   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2023-11-03T23:50:23,833   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2023-11-03T23:50:23,834   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2023-11-03T23:50:23,837   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2023-11-03T23:50:23,838   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2023-11-03T23:50:23,839   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2023-11-03T23:50:23,841   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2023-11-03T23:50:23,842   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2023-11-03T23:50:23,844   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2023-11-03T23:50:23,847   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T23:50:23,848   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T23:50:23,850   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T23:50:23,852   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T23:50:23,853   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T23:50:23,856   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T23:50:23,858   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T23:50:23,860   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2023-11-03T23:50:23,861   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T23:50:23,863   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T23:50:23,865   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T23:50:23,867   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T23:50:23,870   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,871   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,873   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,876   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,879   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,881   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,883   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,885   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,887   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,890   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,893   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T23:50:23,895   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T23:50:23,898   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T23:50:23,901   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T23:50:23,903   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T23:50:23,905   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T23:50:23,908   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T23:50:23,911   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T23:50:23,913   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T23:50:23,917   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T23:50:23,918   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T23:50:23,921   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T23:50:23,923   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T23:50:23,925   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T23:50:23,927   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T23:50:23,929   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T23:50:23,932   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T23:50:23,934   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2023-11-03T23:50:23,935   copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2023-11-03T23:50:23,937   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2023-11-03T23:50:23,938   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2023-11-03T23:50:23,940   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2023-11-03T23:50:23,941   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2023-11-03T23:50:23,944   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2023-11-03T23:50:23,945   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2023-11-03T23:50:23,947   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2023-11-03T23:50:23,949   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,950   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,952   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,954   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,956   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,958   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,960   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,962   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,963   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,966   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,967   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,969   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T23:50:23,971   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:23,972   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:23,974   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:23,976   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:23,978   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:23,979   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:23,982   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T23:50:23,984   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2023-11-03T23:50:23,985   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2023-11-03T23:50:23,987   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-11-03T23:50:23,988   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-11-03T23:50:23,990   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-11-03T23:50:23,992   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-11-03T23:50:23,994   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-11-03T23:50:23,996   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2023-11-03T23:50:23,997   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2023-11-03T23:50:23,999   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,000   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,002   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,005   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,006   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,008   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,010   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,012   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,014   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,016   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,019   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,021   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,023   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,025   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T23:50:24,027   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,029   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,031   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,033   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,035   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,037   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,039   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,042   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,043   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,045   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,046   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,048   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,050   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,052   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,054   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,056   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,058   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,060   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T23:50:24,062   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T23:50:24,064   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2023-11-03T23:50:24,067   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2023-11-03T23:50:24,068   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2023-11-03T23:50:24,070   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2023-11-03T23:50:24,073   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T23:50:24,074   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T23:50:24,075   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T23:50:24,077   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T23:50:24,080   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-11-03T23:50:24,080   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-11-03T23:50:24,082   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-11-03T23:50:24,084   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-11-03T23:50:24,086   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-11-03T23:50:24,088   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T23:50:24,090   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T23:50:24,093   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T23:50:24,095   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T23:50:24,098   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2023-11-03T23:50:24,098   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2023-11-03T23:50:24,100   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2023-11-03T23:50:24,102   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2023-11-03T23:50:24,103   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2023-11-03T23:50:24,105   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T23:50:24,107   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T23:50:24,108   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T23:50:24,110   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T23:50:24,113   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T23:50:24,115   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T23:50:24,116   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T23:50:24,118   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T23:50:24,120   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T23:50:24,122   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T23:50:24,124   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T23:50:24,126   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,127   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,129   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,131   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,133   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,135   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,136   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,139   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,142   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,143   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,145   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,147   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T23:50:24,148   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T23:50:24,150   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T23:50:24,152   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T23:50:24,155   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T23:50:24,157   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T23:50:24,159   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T23:50:24,162   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T23:50:24,164   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,166   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,168   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,171   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,173   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,176   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,178   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,180   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,183   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,186   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,188   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,191   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,193   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,195   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,197   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,200   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,202   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T23:50:24,204   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,207   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,209   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,212   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,214   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,216   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T23:50:24,219   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2023-11-03T23:50:24,220   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2023-11-03T23:50:24,223   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,223   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,226   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,228   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,230   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,232   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,234   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,236   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-11-03T23:50:24,237   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-11-03T23:50:24,240   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-11-03T23:50:24,242   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:24,243   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:24,245   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:24,247   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:24,249   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:24,251   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T23:50:24,253   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-11-03T23:50:24,256   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:24,257   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:24,258   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:24,261   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:24,263   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:24,265   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T23:50:24,268   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-11-03T23:50:24,270   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,273   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,275   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,278   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2023-11-03T23:50:24,279   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2023-11-03T23:50:24,281   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2023-11-03T23:50:24,283   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,285   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,291   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,293   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,296   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,298   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-11-03T23:50:24,299   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-11-03T23:50:24,301   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-11-03T23:50:24,303   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-11-03T23:50:24,305   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-11-03T23:50:24,307   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T23:50:24,308   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T23:50:24,310   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T23:50:24,312   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T23:50:24,315   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T23:50:24,317   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T23:50:24,319   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T23:50:24,321   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T23:50:24,323   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T23:50:24,325   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T23:50:24,327   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,331   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-11-03T23:50:24,332   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-11-03T23:50:24,334   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-11-03T23:50:24,337   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-11-03T23:50:24,339   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-11-03T23:50:24,340   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-11-03T23:50:24,342   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-11-03T23:50:24,345   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-11-03T23:50:24,347   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-11-03T23:50:24,350   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-11-03T23:50:24,351   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-11-03T23:50:24,353   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-11-03T23:50:24,356   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-11-03T23:50:24,357   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-11-03T23:50:24,358   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-11-03T23:50:24,361   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-11-03T23:50:24,364   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-11-03T23:50:24,366   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-11-03T23:50:24,369   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-11-03T23:50:24,372   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T23:50:24,373   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T23:50:24,375   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T23:50:24,377   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T23:50:24,380   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T23:50:24,382   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T23:50:24,385   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T23:50:24,387   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T23:50:24,390   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,390   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,392   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,397   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,399   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,401   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,403   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,405   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,409   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,412   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,414   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,418   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,420   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,423   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,425   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,427   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,429   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T23:50:24,431   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T23:50:24,432   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T23:50:24,434   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T23:50:24,436   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T23:50:24,438   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T23:50:24,440   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T23:50:24,442   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T23:50:24,445   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-11-03T23:50:24,446   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-11-03T23:50:24,448   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-11-03T23:50:24,450   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2023-11-03T23:50:24,451   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2023-11-03T23:50:24,452   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2023-11-03T23:50:24,455   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-11-03T23:50:24,457   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-11-03T23:50:24,458   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-11-03T23:50:24,460   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-11-03T23:50:24,462   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-11-03T23:50:24,463   running install_egg_info
2023-11-03T23:50:24,496   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.12.0-py3.11.egg-info
2023-11-03T23:50:24,509   running install_scripts
2023-11-03T23:50:24,510   creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data
2023-11-03T23:50:24,511   creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts
2023-11-03T23:50:24,512   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts
2023-11-03T23:50:24,515   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts
2023-11-03T23:50:24,517   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts
2023-11-03T23:50:24,519   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts
2023-11-03T23:50:24,521   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts
2023-11-03T23:50:24,523   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts
2023-11-03T23:50:24,525   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts
2023-11-03T23:50:24,527   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts
2023-11-03T23:50:24,529   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts/dsr to 755
2023-11-03T23:50:24,530   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts/ds_ssh to 755
2023-11-03T23:50:24,530   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts/ds_bench to 755
2023-11-03T23:50:24,531   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts/deepspeed.pt to 755
2023-11-03T23:50:24,532   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts/deepspeed to 755
2023-11-03T23:50:24,533   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts/ds to 755
2023-11-03T23:50:24,533   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts/ds_report to 755
2023-11-03T23:50:24,534   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.data/scripts/ds_elastic to 755
2023-11-03T23:50:24,593   creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.0.dist-info/WHEEL
2023-11-03T23:50:24,597   creating '/tmp/pip-wheel-xh2j8h2i/deepspeed-0.12.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-11-03T23:50:24,601   adding 'deepspeed/__init__.py'
2023-11-03T23:50:24,604   adding 'deepspeed/constants.py'
2023-11-03T23:50:24,606   adding 'deepspeed/env_report.py'
2023-11-03T23:50:24,607   adding 'deepspeed/git_version_info.py'
2023-11-03T23:50:24,609   adding 'deepspeed/git_version_info_installed.py'
2023-11-03T23:50:24,610   adding 'deepspeed/pydantic_v1.py'
2023-11-03T23:50:24,612   adding 'deepspeed/accelerator/__init__.py'
2023-11-03T23:50:24,614   adding 'deepspeed/accelerator/abstract_accelerator.py'
2023-11-03T23:50:24,615   adding 'deepspeed/accelerator/cpu_accelerator.py'
2023-11-03T23:50:24,617   adding 'deepspeed/accelerator/cuda_accelerator.py'
2023-11-03T23:50:24,618   adding 'deepspeed/accelerator/mps_accelerator.py'
2023-11-03T23:50:24,620   adding 'deepspeed/accelerator/npu_accelerator.py'
2023-11-03T23:50:24,621   adding 'deepspeed/accelerator/real_accelerator.py'
2023-11-03T23:50:24,623   adding 'deepspeed/autotuning/__init__.py'
2023-11-03T23:50:24,628   adding 'deepspeed/autotuning/autotuner.py'
2023-11-03T23:50:24,629   adding 'deepspeed/autotuning/config.py'
2023-11-03T23:50:24,631   adding 'deepspeed/autotuning/constants.py'
2023-11-03T23:50:24,633   adding 'deepspeed/autotuning/scheduler.py'
2023-11-03T23:50:24,636   adding 'deepspeed/autotuning/utils.py'
2023-11-03T23:50:24,637   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2023-11-03T23:50:24,638   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2023-11-03T23:50:24,639   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2023-11-03T23:50:24,640   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2023-11-03T23:50:24,642   adding 'deepspeed/autotuning/tuner/__init__.py'
2023-11-03T23:50:24,643   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2023-11-03T23:50:24,644   adding 'deepspeed/autotuning/tuner/cost_model.py'
2023-11-03T23:50:24,646   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2023-11-03T23:50:24,647   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2023-11-03T23:50:24,648   adding 'deepspeed/autotuning/tuner/utils.py'
2023-11-03T23:50:24,650   adding 'deepspeed/checkpoint/__init__.py'
2023-11-03T23:50:24,651   adding 'deepspeed/checkpoint/constants.py'
2023-11-03T23:50:24,653   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2023-11-03T23:50:24,655   adding 'deepspeed/checkpoint/ds_to_universal.py'
2023-11-03T23:50:24,657   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2023-11-03T23:50:24,659   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2023-11-03T23:50:24,660   adding 'deepspeed/checkpoint/reshape_utils.py'
2023-11-03T23:50:24,661   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2023-11-03T23:50:24,663   adding 'deepspeed/checkpoint/utils.py'
2023-11-03T23:50:24,665   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2023-11-03T23:50:24,666   adding 'deepspeed/comm/__init__.py'
2023-11-03T23:50:24,668   adding 'deepspeed/comm/backend.py'
2023-11-03T23:50:24,669   adding 'deepspeed/comm/ccl.py'
2023-11-03T23:50:24,673   adding 'deepspeed/comm/comm.py'
2023-11-03T23:50:24,675   adding 'deepspeed/comm/config.py'
2023-11-03T23:50:24,676   adding 'deepspeed/comm/constants.py'
2023-11-03T23:50:24,677   adding 'deepspeed/comm/reduce_op.py'
2023-11-03T23:50:24,679   adding 'deepspeed/comm/torch.py'
2023-11-03T23:50:24,681   adding 'deepspeed/comm/utils.py'
2023-11-03T23:50:24,682   adding 'deepspeed/compression/__init__.py'
2023-11-03T23:50:24,685   adding 'deepspeed/compression/basic_layer.py'
2023-11-03T23:50:24,688   adding 'deepspeed/compression/compress.py'
2023-11-03T23:50:24,690   adding 'deepspeed/compression/config.py'
2023-11-03T23:50:24,691   adding 'deepspeed/compression/constants.py'
2023-11-03T23:50:24,693   adding 'deepspeed/compression/helper.py'
2023-11-03T23:50:24,695   adding 'deepspeed/compression/scheduler.py'
2023-11-03T23:50:24,696   adding 'deepspeed/compression/utils.py'
2023-11-03T23:50:24,698   adding 'deepspeed/elasticity/__init__.py'
2023-11-03T23:50:24,700   adding 'deepspeed/elasticity/config.py'
2023-11-03T23:50:24,701   adding 'deepspeed/elasticity/constants.py'
2023-11-03T23:50:24,702   adding 'deepspeed/elasticity/elastic_agent.py'
2023-11-03T23:50:24,705   adding 'deepspeed/elasticity/elasticity.py'
2023-11-03T23:50:24,706   adding 'deepspeed/elasticity/utils.py'
2023-11-03T23:50:24,708   adding 'deepspeed/inference/__init__.py'
2023-11-03T23:50:24,710   adding 'deepspeed/inference/config.py'
2023-11-03T23:50:24,714   adding 'deepspeed/inference/engine.py'
2023-11-03T23:50:24,716   adding 'deepspeed/inference/quantization/__init__.py'
2023-11-03T23:50:24,717   adding 'deepspeed/inference/quantization/layers.py'
2023-11-03T23:50:24,718   adding 'deepspeed/inference/quantization/quantization.py'
2023-11-03T23:50:24,720   adding 'deepspeed/inference/quantization/quantization_context.py'
2023-11-03T23:50:24,721   adding 'deepspeed/inference/quantization/utils.py'
2023-11-03T23:50:24,723   adding 'deepspeed/inference/v2/__init__.py'
2023-11-03T23:50:24,724   adding 'deepspeed/inference/v2/allocator.py'
2023-11-03T23:50:24,725   adding 'deepspeed/inference/v2/config_v2.py'
2023-11-03T23:50:24,727   adding 'deepspeed/inference/v2/engine_factory.py'
2023-11-03T23:50:24,728   adding 'deepspeed/inference/v2/engine_v2.py'
2023-11-03T23:50:24,730   adding 'deepspeed/inference/v2/inference_utils.py'
2023-11-03T23:50:24,731   adding 'deepspeed/inference/v2/logging.py'
2023-11-03T23:50:24,732   adding 'deepspeed/inference/v2/scheduling_utils.py'
2023-11-03T23:50:24,733   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2023-11-03T23:50:24,735   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2023-11-03T23:50:24,736   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2023-11-03T23:50:24,737   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2023-11-03T23:50:24,739   adding 'deepspeed/inference/v2/kernels/__init__.py'
2023-11-03T23:50:24,740   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2023-11-03T23:50:24,742   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2023-11-03T23:50:24,743   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2023-11-03T23:50:24,745   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2023-11-03T23:50:24,746   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2023-11-03T23:50:24,748   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu'
2023-11-03T23:50:24,749   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2023-11-03T23:50:24,750   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2023-11-03T23:50:24,752   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2023-11-03T23:50:24,754   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2023-11-03T23:50:24,755   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2023-11-03T23:50:24,757   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2023-11-03T23:50:24,759   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2023-11-03T23:50:24,760   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2023-11-03T23:50:24,761   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2023-11-03T23:50:24,763   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2023-11-03T23:50:24,764   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2023-11-03T23:50:24,765   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2023-11-03T23:50:24,767   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu'
2023-11-03T23:50:24,768   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2023-11-03T23:50:24,770   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2023-11-03T23:50:24,771   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2023-11-03T23:50:24,773   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu'
2023-11-03T23:50:24,775   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2023-11-03T23:50:24,776   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2023-11-03T23:50:24,777   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2023-11-03T23:50:24,778   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2023-11-03T23:50:24,780   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2023-11-03T23:50:24,781   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2023-11-03T23:50:24,783   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2023-11-03T23:50:24,784   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu'
2023-11-03T23:50:24,785   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2023-11-03T23:50:24,787   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2023-11-03T23:50:24,788   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2023-11-03T23:50:24,790   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2023-11-03T23:50:24,791   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2023-11-03T23:50:24,793   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2023-11-03T23:50:24,794   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2023-11-03T23:50:24,795   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2023-11-03T23:50:24,797   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2023-11-03T23:50:24,798   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2023-11-03T23:50:24,799   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2023-11-03T23:50:24,801   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2023-11-03T23:50:24,802   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2023-11-03T23:50:24,803   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2023-11-03T23:50:24,805   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2023-11-03T23:50:24,807   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2023-11-03T23:50:24,808   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2023-11-03T23:50:24,810   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2023-11-03T23:50:24,811   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2023-11-03T23:50:24,812   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2023-11-03T23:50:24,813   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2023-11-03T23:50:24,815   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2023-11-03T23:50:24,816   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2023-11-03T23:50:24,818   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2023-11-03T23:50:24,819   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2023-11-03T23:50:24,820   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2023-11-03T23:50:24,822   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2023-11-03T23:50:24,823   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2023-11-03T23:50:24,825   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2023-11-03T23:50:24,826   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu'
2023-11-03T23:50:24,827   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2023-11-03T23:50:24,828   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2023-11-03T23:50:24,830   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2023-11-03T23:50:24,831   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2023-11-03T23:50:24,833   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2023-11-03T23:50:24,834   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu'
2023-11-03T23:50:24,835   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2023-11-03T23:50:24,837   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2023-11-03T23:50:24,838   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2023-11-03T23:50:24,839   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2023-11-03T23:50:24,840   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2023-11-03T23:50:24,842   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2023-11-03T23:50:24,843   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2023-11-03T23:50:24,845   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu'
2023-11-03T23:50:24,846   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2023-11-03T23:50:24,847   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2023-11-03T23:50:24,848   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2023-11-03T23:50:24,850   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2023-11-03T23:50:24,851   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2023-11-03T23:50:24,852   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu'
2023-11-03T23:50:24,854   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2023-11-03T23:50:24,855   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2023-11-03T23:50:24,856   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2023-11-03T23:50:24,858   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2023-11-03T23:50:24,859   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2023-11-03T23:50:24,860   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu'
2023-11-03T23:50:24,862   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2023-11-03T23:50:24,863   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2023-11-03T23:50:24,864   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2023-11-03T23:50:24,866   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2023-11-03T23:50:24,867   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2023-11-03T23:50:24,869   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2023-11-03T23:50:24,870   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py'
2023-11-03T23:50:24,871   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp'
2023-11-03T23:50:24,873   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu'
2023-11-03T23:50:24,874   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh'
2023-11-03T23:50:24,875   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h'
2023-11-03T23:50:24,877   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py'
2023-11-03T23:50:24,878   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2023-11-03T23:50:24,880   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2023-11-03T23:50:24,881   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2023-11-03T23:50:24,884   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2023-11-03T23:50:24,886   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2023-11-03T23:50:24,887   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2023-11-03T23:50:24,889   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2023-11-03T23:50:24,890   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2023-11-03T23:50:24,891   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2023-11-03T23:50:24,893   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2023-11-03T23:50:24,894   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2023-11-03T23:50:24,895   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2023-11-03T23:50:24,896   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2023-11-03T23:50:24,898   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2023-11-03T23:50:24,899   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2023-11-03T23:50:24,900   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2023-11-03T23:50:24,902   adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py'
2023-11-03T23:50:24,903   adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py'
2023-11-03T23:50:24,904   adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py'
2023-11-03T23:50:24,906   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2023-11-03T23:50:24,907   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2023-11-03T23:50:24,909   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2023-11-03T23:50:24,910   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2023-11-03T23:50:24,912   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2023-11-03T23:50:24,913   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2023-11-03T23:50:24,915   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2023-11-03T23:50:24,916   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2023-11-03T23:50:24,917   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2023-11-03T23:50:24,919   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2023-11-03T23:50:24,920   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2023-11-03T23:50:24,922   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2023-11-03T23:50:24,923   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2023-11-03T23:50:24,924   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2023-11-03T23:50:24,926   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2023-11-03T23:50:24,927   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2023-11-03T23:50:24,929   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2023-11-03T23:50:24,930   adding 'deepspeed/inference/v2/modules/__init__.py'
2023-11-03T23:50:24,932   adding 'deepspeed/inference/v2/modules/ds_module.py'
2023-11-03T23:50:24,933   adding 'deepspeed/inference/v2/modules/heuristics.py'
2023-11-03T23:50:24,934   adding 'deepspeed/inference/v2/modules/module_registry.py'
2023-11-03T23:50:24,936   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2023-11-03T23:50:24,938   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2023-11-03T23:50:24,939   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2023-11-03T23:50:24,940   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2023-11-03T23:50:24,941   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2023-11-03T23:50:24,942   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2023-11-03T23:50:24,943   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2023-11-03T23:50:24,945   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2023-11-03T23:50:24,946   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2023-11-03T23:50:24,947   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2023-11-03T23:50:24,949   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2023-11-03T23:50:24,950   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2023-11-03T23:50:24,952   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2023-11-03T23:50:24,953   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2023-11-03T23:50:24,955   adding 'deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py'
2023-11-03T23:50:24,956   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2023-11-03T23:50:24,958   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2023-11-03T23:50:24,959   adding 'deepspeed/inference/v2/modules/implementations/moe/gate_fn.py'
2023-11-03T23:50:24,960   adding 'deepspeed/inference/v2/modules/implementations/moe/test.py'
2023-11-03T23:50:24,962   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2023-11-03T23:50:24,963   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2023-11-03T23:50:24,965   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2023-11-03T23:50:24,966   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2023-11-03T23:50:24,968   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2023-11-03T23:50:24,969   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2023-11-03T23:50:24,971   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2023-11-03T23:50:24,973   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2023-11-03T23:50:24,974   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2023-11-03T23:50:24,975   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2023-11-03T23:50:24,977   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2023-11-03T23:50:24,978   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2023-11-03T23:50:24,979   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2023-11-03T23:50:24,981   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2023-11-03T23:50:24,982   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2023-11-03T23:50:24,984   adding 'deepspeed/inference/v2/ragged/__init__.py'
2023-11-03T23:50:24,985   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2023-11-03T23:50:24,987   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2023-11-03T23:50:24,988   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2023-11-03T23:50:24,990   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2023-11-03T23:50:24,992   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2023-11-03T23:50:24,994   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2023-11-03T23:50:24,995   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2023-11-03T23:50:24,997   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2023-11-03T23:50:24,998   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2023-11-03T23:50:25,000   adding 'deepspeed/launcher/__init__.py'
2023-11-03T23:50:25,001   adding 'deepspeed/launcher/constants.py'
2023-11-03T23:50:25,003   adding 'deepspeed/launcher/launch.py'
2023-11-03T23:50:25,005   adding 'deepspeed/launcher/multinode_runner.py'
2023-11-03T23:50:25,008   adding 'deepspeed/launcher/runner.py'
2023-11-03T23:50:25,010   adding 'deepspeed/model_implementations/__init__.py'
2023-11-03T23:50:25,012   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2023-11-03T23:50:25,013   adding 'deepspeed/model_implementations/diffusers/unet.py'
2023-11-03T23:50:25,014   adding 'deepspeed/model_implementations/diffusers/vae.py'
2023-11-03T23:50:25,016   adding 'deepspeed/model_implementations/features/__init__.py'
2023-11-03T23:50:25,017   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2023-11-03T23:50:25,018   adding 'deepspeed/model_implementations/transformers/__init__.py'
2023-11-03T23:50:25,019   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2023-11-03T23:50:25,021   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2023-11-03T23:50:25,022   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2023-11-03T23:50:25,023   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2023-11-03T23:50:25,024   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2023-11-03T23:50:25,025   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2023-11-03T23:50:25,026   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2023-11-03T23:50:25,027   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2023-11-03T23:50:25,029   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2023-11-03T23:50:25,031   adding 'deepspeed/module_inject/__init__.py'
2023-11-03T23:50:25,034   adding 'deepspeed/module_inject/auto_tp.py'
2023-11-03T23:50:25,036   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2023-11-03T23:50:25,037   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2023-11-03T23:50:25,038   adding 'deepspeed/module_inject/inject.py'
2023-11-03T23:50:25,040   adding 'deepspeed/module_inject/layers.py'
2023-11-03T23:50:25,042   adding 'deepspeed/module_inject/load_checkpoint.py'
2023-11-03T23:50:25,043   adding 'deepspeed/module_inject/module_quantize.py'
2023-11-03T23:50:25,045   adding 'deepspeed/module_inject/policy.py'
2023-11-03T23:50:25,048   adding 'deepspeed/module_inject/replace_module.py'
2023-11-03T23:50:25,050   adding 'deepspeed/module_inject/replace_policy.py'
2023-11-03T23:50:25,051   adding 'deepspeed/module_inject/tp_shard.py'
2023-11-03T23:50:25,052   adding 'deepspeed/module_inject/utils.py'
2023-11-03T23:50:25,054   adding 'deepspeed/module_inject/containers/__init__.py'
2023-11-03T23:50:25,056   adding 'deepspeed/module_inject/containers/base.py'
2023-11-03T23:50:25,058   adding 'deepspeed/module_inject/containers/base_moe.py'
2023-11-03T23:50:25,059   adding 'deepspeed/module_inject/containers/bert.py'
2023-11-03T23:50:25,061   adding 'deepspeed/module_inject/containers/bloom.py'
2023-11-03T23:50:25,062   adding 'deepspeed/module_inject/containers/clip.py'
2023-11-03T23:50:25,063   adding 'deepspeed/module_inject/containers/distil_bert.py'
2023-11-03T23:50:25,065   adding 'deepspeed/module_inject/containers/gpt2.py'
2023-11-03T23:50:25,066   adding 'deepspeed/module_inject/containers/gptj.py'
2023-11-03T23:50:25,068   adding 'deepspeed/module_inject/containers/gptneo.py'
2023-11-03T23:50:25,069   adding 'deepspeed/module_inject/containers/gptneox.py'
2023-11-03T23:50:25,071   adding 'deepspeed/module_inject/containers/internlm.py'
2023-11-03T23:50:25,072   adding 'deepspeed/module_inject/containers/llama.py'
2023-11-03T23:50:25,074   adding 'deepspeed/module_inject/containers/llama2.py'
2023-11-03T23:50:25,075   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2023-11-03T23:50:25,077   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2023-11-03T23:50:25,078   adding 'deepspeed/module_inject/containers/opt.py'
2023-11-03T23:50:25,079   adding 'deepspeed/module_inject/containers/unet.py'
2023-11-03T23:50:25,080   adding 'deepspeed/module_inject/containers/vae.py'
2023-11-03T23:50:25,082   adding 'deepspeed/module_inject/containers/features/__init__.py'
2023-11-03T23:50:25,083   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2023-11-03T23:50:25,085   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2023-11-03T23:50:25,086   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2023-11-03T23:50:25,087   adding 'deepspeed/module_inject/containers/features/megatron.py'
2023-11-03T23:50:25,088   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2023-11-03T23:50:25,090   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2023-11-03T23:50:25,091   adding 'deepspeed/moe/__init__.py'
2023-11-03T23:50:25,093   adding 'deepspeed/moe/experts.py'
2023-11-03T23:50:25,094   adding 'deepspeed/moe/layer.py'
2023-11-03T23:50:25,096   adding 'deepspeed/moe/mappings.py'
2023-11-03T23:50:25,098   adding 'deepspeed/moe/sharded_moe.py'
2023-11-03T23:50:25,100   adding 'deepspeed/moe/utils.py'
2023-11-03T23:50:25,102   adding 'deepspeed/monitor/__init__.py'
2023-11-03T23:50:25,103   adding 'deepspeed/monitor/config.py'
2023-11-03T23:50:25,104   adding 'deepspeed/monitor/csv_monitor.py'
2023-11-03T23:50:25,105   adding 'deepspeed/monitor/monitor.py'
2023-11-03T23:50:25,106   adding 'deepspeed/monitor/tensorboard.py'
2023-11-03T23:50:25,107   adding 'deepspeed/monitor/utils.py'
2023-11-03T23:50:25,109   adding 'deepspeed/monitor/wandb.py'
2023-11-03T23:50:25,110   adding 'deepspeed/nebula/__init__.py'
2023-11-03T23:50:25,111   adding 'deepspeed/nebula/config.py'
2023-11-03T23:50:25,113   adding 'deepspeed/nebula/constants.py'
2023-11-03T23:50:25,115   adding 'deepspeed/ops/__init__.py'
2023-11-03T23:50:25,116   adding 'deepspeed/ops/adagrad/__init__.py'
2023-11-03T23:50:25,118   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2023-11-03T23:50:25,119   adding 'deepspeed/ops/adam/__init__.py'
2023-11-03T23:50:25,121   adding 'deepspeed/ops/adam/cpu_adam.py'
2023-11-03T23:50:25,123   adding 'deepspeed/ops/adam/fused_adam.py'
2023-11-03T23:50:25,124   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2023-11-03T23:50:25,126   adding 'deepspeed/ops/aio/__init__.py'
2023-11-03T23:50:25,128   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2023-11-03T23:50:25,130   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2023-11-03T23:50:25,132   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2023-11-03T23:50:25,133   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2023-11-03T23:50:25,134   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2023-11-03T23:50:25,136   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2023-11-03T23:50:25,139   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2023-11-03T23:50:25,140   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2023-11-03T23:50:25,141   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2023-11-03T23:50:25,143   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2023-11-03T23:50:25,144   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2023-11-03T23:50:25,146   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2023-11-03T23:50:25,147   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2023-11-03T23:50:25,149   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2023-11-03T23:50:25,150   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2023-11-03T23:50:25,151   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2023-11-03T23:50:25,153   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2023-11-03T23:50:25,154   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2023-11-03T23:50:25,156   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2023-11-03T23:50:25,157   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2023-11-03T23:50:25,159   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2023-11-03T23:50:25,160   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2023-11-03T23:50:25,161   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2023-11-03T23:50:25,163   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2023-11-03T23:50:25,164   adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu'
2023-11-03T23:50:25,166   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2023-11-03T23:50:25,169   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2023-11-03T23:50:25,171   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2023-11-03T23:50:25,173   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2023-11-03T23:50:25,175   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2023-11-03T23:50:25,176   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2023-11-03T23:50:25,178   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2023-11-03T23:50:25,186   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2023-11-03T23:50:25,191   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2023-11-03T23:50:25,193   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2023-11-03T23:50:25,196   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2023-11-03T23:50:25,198   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2023-11-03T23:50:25,199   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2023-11-03T23:50:25,201   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2023-11-03T23:50:25,203   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2023-11-03T23:50:25,206   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2023-11-03T23:50:25,208   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2023-11-03T23:50:25,210   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2023-11-03T23:50:25,212   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2023-11-03T23:50:25,219   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2023-11-03T23:50:25,223   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2023-11-03T23:50:25,225   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2023-11-03T23:50:25,229   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2023-11-03T23:50:25,232   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2023-11-03T23:50:25,236   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2023-11-03T23:50:25,238   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2023-11-03T23:50:25,240   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2023-11-03T23:50:25,242   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2023-11-03T23:50:25,243   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2023-11-03T23:50:25,245   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2023-11-03T23:50:25,247   adding 'deepspeed/ops/csrc/includes/Timer.h'
2023-11-03T23:50:25,248   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2023-11-03T23:50:25,249   adding 'deepspeed/ops/csrc/includes/compat.h'
2023-11-03T23:50:25,251   adding 'deepspeed/ops/csrc/includes/context.h'
2023-11-03T23:50:25,252   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2023-11-03T23:50:25,254   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2023-11-03T23:50:25,255   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2023-11-03T23:50:25,257   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2023-11-03T23:50:25,258   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2023-11-03T23:50:25,259   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2023-11-03T23:50:25,261   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2023-11-03T23:50:25,262   adding 'deepspeed/ops/csrc/includes/dropout.h'
2023-11-03T23:50:25,263   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2023-11-03T23:50:25,265   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2023-11-03T23:50:25,266   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2023-11-03T23:50:25,267   adding 'deepspeed/ops/csrc/includes/gelu.h'
2023-11-03T23:50:25,269   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2023-11-03T23:50:25,270   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2023-11-03T23:50:25,272   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2023-11-03T23:50:25,274   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2023-11-03T23:50:25,275   adding 'deepspeed/ops/csrc/includes/quantization.h'
2023-11-03T23:50:25,277   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2023-11-03T23:50:25,278   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2023-11-03T23:50:25,281   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2023-11-03T23:50:25,282   adding 'deepspeed/ops/csrc/includes/simd.h'
2023-11-03T23:50:25,284   adding 'deepspeed/ops/csrc/includes/softmax.h'
2023-11-03T23:50:25,285   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2023-11-03T23:50:25,286   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2023-11-03T23:50:25,288   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2023-11-03T23:50:25,290   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2023-11-03T23:50:25,292   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2023-11-03T23:50:25,294   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2023-11-03T23:50:25,295   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2023-11-03T23:50:25,296   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2023-11-03T23:50:25,298   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2023-11-03T23:50:25,300   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2023-11-03T23:50:25,303   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2023-11-03T23:50:25,304   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2023-11-03T23:50:25,306   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2023-11-03T23:50:25,308   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2023-11-03T23:50:25,309   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2023-11-03T23:50:25,311   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2023-11-03T23:50:25,313   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2023-11-03T23:50:25,315   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2023-11-03T23:50:25,316   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2023-11-03T23:50:25,317   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2023-11-03T23:50:25,319   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2023-11-03T23:50:25,322   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2023-11-03T23:50:25,323   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2023-11-03T23:50:25,325   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2023-11-03T23:50:25,327   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2023-11-03T23:50:25,330   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2023-11-03T23:50:25,334   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2023-11-03T23:50:25,336   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2023-11-03T23:50:25,338   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2023-11-03T23:50:25,342   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2023-11-03T23:50:25,345   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2023-11-03T23:50:25,347   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2023-11-03T23:50:25,350   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2023-11-03T23:50:25,351   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2023-11-03T23:50:25,354   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2023-11-03T23:50:25,356   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2023-11-03T23:50:25,358   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2023-11-03T23:50:25,363   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2023-11-03T23:50:25,365   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2023-11-03T23:50:25,367   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2023-11-03T23:50:25,369   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2023-11-03T23:50:25,372   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2023-11-03T23:50:25,374   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2023-11-03T23:50:25,376   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2023-11-03T23:50:25,377   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2023-11-03T23:50:25,379   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2023-11-03T23:50:25,381   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2023-11-03T23:50:25,382   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2023-11-03T23:50:25,384   adding 'deepspeed/ops/lamb/__init__.py'
2023-11-03T23:50:25,385   adding 'deepspeed/ops/lamb/fused_lamb.py'
2023-11-03T23:50:25,387   adding 'deepspeed/ops/lion/__init__.py'
2023-11-03T23:50:25,389   adding 'deepspeed/ops/lion/cpu_lion.py'
2023-11-03T23:50:25,390   adding 'deepspeed/ops/lion/fused_lion.py'
2023-11-03T23:50:25,391   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2023-11-03T23:50:25,393   adding 'deepspeed/ops/op_builder/__init__.py'
2023-11-03T23:50:25,394   adding 'deepspeed/ops/op_builder/all_ops.py'
2023-11-03T23:50:25,396   adding 'deepspeed/ops/op_builder/async_io.py'
2023-11-03T23:50:25,399   adding 'deepspeed/ops/op_builder/builder.py'
2023-11-03T23:50:25,401   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2023-11-03T23:50:25,402   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2023-11-03T23:50:25,403   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2023-11-03T23:50:25,404   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2023-11-03T23:50:25,406   adding 'deepspeed/ops/op_builder/fused_adam.py'
2023-11-03T23:50:25,407   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2023-11-03T23:50:25,408   adding 'deepspeed/ops/op_builder/fused_lion.py'
2023-11-03T23:50:25,409   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2023-11-03T23:50:25,411   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2023-11-03T23:50:25,412   adding 'deepspeed/ops/op_builder/quantizer.py'
2023-11-03T23:50:25,413   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2023-11-03T23:50:25,415   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2023-11-03T23:50:25,416   adding 'deepspeed/ops/op_builder/random_ltd.py'
2023-11-03T23:50:25,417   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2023-11-03T23:50:25,419   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2023-11-03T23:50:25,420   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2023-11-03T23:50:25,421   adding 'deepspeed/ops/op_builder/transformer.py'
2023-11-03T23:50:25,422   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2023-11-03T23:50:25,424   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2023-11-03T23:50:25,425   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2023-11-03T23:50:25,427   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2023-11-03T23:50:25,428   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2023-11-03T23:50:25,429   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2023-11-03T23:50:25,430   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2023-11-03T23:50:25,431   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2023-11-03T23:50:25,433   adding 'deepspeed/ops/op_builder/npu/builder.py'
2023-11-03T23:50:25,434   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2023-11-03T23:50:25,435   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2023-11-03T23:50:25,437   adding 'deepspeed/ops/quantizer/__init__.py'
2023-11-03T23:50:25,438   adding 'deepspeed/ops/quantizer/quantizer.py'
2023-11-03T23:50:25,439   adding 'deepspeed/ops/random_ltd/__init__.py'
2023-11-03T23:50:25,441   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2023-11-03T23:50:25,442   adding 'deepspeed/ops/sparse_attention/__init__.py'
2023-11-03T23:50:25,444   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2023-11-03T23:50:25,447   adding 'deepspeed/ops/sparse_attention/matmul.py'
2023-11-03T23:50:25,449   adding 'deepspeed/ops/sparse_attention/softmax.py'
2023-11-03T23:50:25,451   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2023-11-03T23:50:25,453   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2023-11-03T23:50:25,456   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2023-11-03T23:50:25,458   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2023-11-03T23:50:25,459   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2023-11-03T23:50:25,461   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2023-11-03T23:50:25,462   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2023-11-03T23:50:25,464   adding 'deepspeed/ops/transformer/__init__.py'
2023-11-03T23:50:25,466   adding 'deepspeed/ops/transformer/transformer.py'
2023-11-03T23:50:25,468   adding 'deepspeed/ops/transformer/inference/__init__.py'
2023-11-03T23:50:25,469   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2023-11-03T23:50:25,471   adding 'deepspeed/ops/transformer/inference/config.py'
2023-11-03T23:50:25,472   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2023-11-03T23:50:25,474   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2023-11-03T23:50:25,475   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2023-11-03T23:50:25,477   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2023-11-03T23:50:25,479   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2023-11-03T23:50:25,481   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2023-11-03T23:50:25,483   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2023-11-03T23:50:25,485   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2023-11-03T23:50:25,486   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2023-11-03T23:50:25,488   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2023-11-03T23:50:25,489   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2023-11-03T23:50:25,491   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2023-11-03T23:50:25,492   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2023-11-03T23:50:25,494   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2023-11-03T23:50:25,495   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2023-11-03T23:50:25,497   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2023-11-03T23:50:25,498   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2023-11-03T23:50:25,500   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2023-11-03T23:50:25,502   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2023-11-03T23:50:25,504   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2023-11-03T23:50:25,506   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2023-11-03T23:50:25,507   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2023-11-03T23:50:25,509   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2023-11-03T23:50:25,510   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2023-11-03T23:50:25,511   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2023-11-03T23:50:25,512   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2023-11-03T23:50:25,514   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2023-11-03T23:50:25,516   adding 'deepspeed/pipe/__init__.py'
2023-11-03T23:50:25,517   adding 'deepspeed/profiling/__init__.py'
2023-11-03T23:50:25,518   adding 'deepspeed/profiling/config.py'
2023-11-03T23:50:25,520   adding 'deepspeed/profiling/constants.py'
2023-11-03T23:50:25,521   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2023-11-03T23:50:25,526   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2023-11-03T23:50:25,529   adding 'deepspeed/runtime/__init__.py'
2023-11-03T23:50:25,531   adding 'deepspeed/runtime/bf16_optimizer.py'
2023-11-03T23:50:25,535   adding 'deepspeed/runtime/config.py'
2023-11-03T23:50:25,537   adding 'deepspeed/runtime/config_utils.py'
2023-11-03T23:50:25,539   adding 'deepspeed/runtime/constants.py'
2023-11-03T23:50:25,541   adding 'deepspeed/runtime/dataloader.py'
2023-11-03T23:50:25,542   adding 'deepspeed/runtime/eigenvalue.py'
2023-11-03T23:50:25,560   adding 'deepspeed/runtime/engine.py'
2023-11-03T23:50:25,563   adding 'deepspeed/runtime/hybrid_engine.py'
2023-11-03T23:50:25,567   adding 'deepspeed/runtime/lr_schedules.py'
2023-11-03T23:50:25,568   adding 'deepspeed/runtime/progressive_layer_drop.py'
2023-11-03T23:50:25,570   adding 'deepspeed/runtime/quantize.py'
2023-11-03T23:50:25,571   adding 'deepspeed/runtime/sparse_tensor.py'
2023-11-03T23:50:25,573   adding 'deepspeed/runtime/state_dict_factory.py'
2023-11-03T23:50:25,578   adding 'deepspeed/runtime/utils.py'
2023-11-03T23:50:25,580   adding 'deepspeed/runtime/weight_quantizer.py'
2023-11-03T23:50:25,581   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2023-11-03T23:50:25,586   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2023-11-03T23:50:25,588   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2023-11-03T23:50:25,589   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2023-11-03T23:50:25,591   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2023-11-03T23:50:25,592   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2023-11-03T23:50:25,593   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2023-11-03T23:50:25,595   adding 'deepspeed/runtime/comm/__init__.py'
2023-11-03T23:50:25,596   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2023-11-03T23:50:25,598   adding 'deepspeed/runtime/comm/mpi.py'
2023-11-03T23:50:25,600   adding 'deepspeed/runtime/comm/nccl.py'
2023-11-03T23:50:25,601   adding 'deepspeed/runtime/compression/__init__.py'
2023-11-03T23:50:25,602   adding 'deepspeed/runtime/compression/cupy.py'
2023-11-03T23:50:25,604   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2023-11-03T23:50:25,606   adding 'deepspeed/runtime/data_pipeline/config.py'
2023-11-03T23:50:25,607   adding 'deepspeed/runtime/data_pipeline/constants.py'
2023-11-03T23:50:25,609   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2023-11-03T23:50:25,610   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2023-11-03T23:50:25,612   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2023-11-03T23:50:25,613   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2023-11-03T23:50:25,615   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2023-11-03T23:50:25,616   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2023-11-03T23:50:25,618   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2023-11-03T23:50:25,620   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2023-11-03T23:50:25,623   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2023-11-03T23:50:25,625   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2023-11-03T23:50:25,627   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2023-11-03T23:50:25,628   adding 'deepspeed/runtime/fp16/__init__.py'
2023-11-03T23:50:25,631   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2023-11-03T23:50:25,633   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2023-11-03T23:50:25,635   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2023-11-03T23:50:25,637   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2023-11-03T23:50:25,639   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2023-11-03T23:50:25,641   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2023-11-03T23:50:25,644   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2023-11-03T23:50:25,645   adding 'deepspeed/runtime/pipe/__init__.py'
2023-11-03T23:50:25,651   adding 'deepspeed/runtime/pipe/engine.py'
2023-11-03T23:50:25,655   adding 'deepspeed/runtime/pipe/module.py'
2023-11-03T23:50:25,657   adding 'deepspeed/runtime/pipe/p2p.py'
2023-11-03T23:50:25,659   adding 'deepspeed/runtime/pipe/schedule.py'
2023-11-03T23:50:25,661   adding 'deepspeed/runtime/pipe/topology.py'
2023-11-03T23:50:25,663   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2023-11-03T23:50:25,664   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2023-11-03T23:50:25,666   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2023-11-03T23:50:25,667   adding 'deepspeed/runtime/swap_tensor/constants.py'
2023-11-03T23:50:25,669   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2023-11-03T23:50:25,671   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2023-11-03T23:50:25,674   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2023-11-03T23:50:25,675   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2023-11-03T23:50:25,677   adding 'deepspeed/runtime/swap_tensor/utils.py'
2023-11-03T23:50:25,679   adding 'deepspeed/runtime/zero/__init__.py'
2023-11-03T23:50:25,681   adding 'deepspeed/runtime/zero/config.py'
2023-11-03T23:50:25,683   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2023-11-03T23:50:25,684   adding 'deepspeed/runtime/zero/linear.py'
2023-11-03T23:50:25,687   adding 'deepspeed/runtime/zero/mics.py'
2023-11-03T23:50:25,689   adding 'deepspeed/runtime/zero/mics_utils.py'
2023-11-03T23:50:25,690   adding 'deepspeed/runtime/zero/offload_config.py'
2023-11-03T23:50:25,693   adding 'deepspeed/runtime/zero/parameter_offload.py'
2023-11-03T23:50:25,704   adding 'deepspeed/runtime/zero/partition_parameters.py'
2023-11-03T23:50:25,708   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2023-11-03T23:50:25,709   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2023-11-03T23:50:25,723   adding 'deepspeed/runtime/zero/stage3.py'
2023-11-03T23:50:25,736   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2023-11-03T23:50:25,738   adding 'deepspeed/runtime/zero/test.py'
2023-11-03T23:50:25,740   adding 'deepspeed/runtime/zero/tiling.py'
2023-11-03T23:50:25,742   adding 'deepspeed/runtime/zero/utils.py'
2023-11-03T23:50:25,744   adding 'deepspeed/sequence/__init__.py'
2023-11-03T23:50:25,745   adding 'deepspeed/sequence/layer.py'
2023-11-03T23:50:25,747   adding 'deepspeed/utils/__init__.py'
2023-11-03T23:50:25,749   adding 'deepspeed/utils/comms_logging.py'
2023-11-03T23:50:25,750   adding 'deepspeed/utils/debug.py'
2023-11-03T23:50:25,751   adding 'deepspeed/utils/exceptions.py'
2023-11-03T23:50:25,754   adding 'deepspeed/utils/groups.py'
2023-11-03T23:50:25,755   adding 'deepspeed/utils/init_on_device.py'
2023-11-03T23:50:25,757   adding 'deepspeed/utils/logging.py'
2023-11-03T23:50:25,758   adding 'deepspeed/utils/mixed_precision_linkage.py'
2023-11-03T23:50:25,760   adding 'deepspeed/utils/numa.py'
2023-11-03T23:50:25,761   adding 'deepspeed/utils/nvtx.py'
2023-11-03T23:50:25,763   adding 'deepspeed/utils/tensor_fragment.py'
2023-11-03T23:50:25,764   adding 'deepspeed/utils/timer.py'
2023-11-03T23:50:25,766   adding 'deepspeed/utils/types.py'
2023-11-03T23:50:25,768   adding 'deepspeed/utils/zero_to_fp32.py'
2023-11-03T23:50:25,771   adding 'deepspeed-0.12.0.data/scripts/deepspeed'
2023-11-03T23:50:25,772   adding 'deepspeed-0.12.0.data/scripts/deepspeed.pt'
2023-11-03T23:50:25,773   adding 'deepspeed-0.12.0.data/scripts/ds'
2023-11-03T23:50:25,774   adding 'deepspeed-0.12.0.data/scripts/ds_bench'
2023-11-03T23:50:25,775   adding 'deepspeed-0.12.0.data/scripts/ds_elastic'
2023-11-03T23:50:25,776   adding 'deepspeed-0.12.0.data/scripts/ds_report'
2023-11-03T23:50:25,777   adding 'deepspeed-0.12.0.data/scripts/ds_ssh'
2023-11-03T23:50:25,778   adding 'deepspeed-0.12.0.data/scripts/dsr'
2023-11-03T23:50:25,784   adding 'deepspeed-0.12.0.dist-info/METADATA'
2023-11-03T23:50:25,785   adding 'deepspeed-0.12.0.dist-info/WHEEL'
2023-11-03T23:50:25,786   adding 'deepspeed-0.12.0.dist-info/entry_points.txt'
2023-11-03T23:50:25,787   adding 'deepspeed-0.12.0.dist-info/top_level.txt'
2023-11-03T23:50:25,799   adding 'deepspeed-0.12.0.dist-info/RECORD'
2023-11-03T23:50:25,822   removing build/bdist.linux-armv7l/wheel
2023-11-03T23:50:25,997   deepspeed build time = 8.663199186325073 secs
2023-11-03T23:50:26,116   Building wheel for deepspeed (setup.py): finished with status 'done'
2023-11-03T23:50:26,134   Created wheel for deepspeed: filename=deepspeed-0.12.0-py3-none-any.whl size=1265549 sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677
2023-11-03T23:50:26,135   Stored in directory: /tmp/pip-ephem-wheel-cache-5_b3wdvt/wheels/24/5d/80/3b6aaa4063a7bca3dca66f30cb819d54fb5565efaf9594fa1a
2023-11-03T23:50:26,171 Successfully built deepspeed
2023-11-03T23:50:26,210 Removed build tracker: '/tmp/pip-build-tracker-2r1ir139'