2024-01-24T00:02:49,646 Created temporary directory: /tmp/pip-build-tracker-715yxzy3
2024-01-24T00:02:49,647 Initialized build tracking at /tmp/pip-build-tracker-715yxzy3
2024-01-24T00:02:49,647 Created build tracker: /tmp/pip-build-tracker-715yxzy3
2024-01-24T00:02:49,648 Entered build tracker: /tmp/pip-build-tracker-715yxzy3
2024-01-24T00:02:49,649 Created temporary directory: /tmp/pip-wheel-6pgs4r2y
2024-01-24T00:02:49,652 Created temporary directory: /tmp/pip-ephem-wheel-cache-mley3y5l
2024-01-24T00:02:49,675 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-01-24T00:02:49,678 2 location(s) to search for versions of deepspeed:
2024-01-24T00:02:49,678 * https://pypi.org/simple/deepspeed/
2024-01-24T00:02:49,678 * https://www.piwheels.org/simple/deepspeed/
2024-01-24T00:02:49,679 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-01-24T00:02:49,680 Getting page https://pypi.org/simple/deepspeed/
2024-01-24T00:02:49,681 Found index url https://pypi.org/simple/
2024-01-24T00:02:49,906 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-01-24T00:02:49,921   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-01-24T00:02:49,922   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-01-24T00:02:49,922   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-01-24T00:02:49,923   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-01-24T00:02:49,924   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-01-24T00:02:49,925   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-01-24T00:02:49,925   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-01-24T00:02:49,926   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-01-24T00:02:49,927   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-01-24T00:02:49,928   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-01-24T00:02:49,928   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-01-24T00:02:49,929   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-01-24T00:02:49,930   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-01-24T00:02:49,931   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-01-24T00:02:49,932   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-01-24T00:02:49,932   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-01-24T00:02:49,933   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-01-24T00:02:49,933   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-01-24T00:02:49,934   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-01-24T00:02:49,935   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-01-24T00:02:49,935   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-01-24T00:02:49,936   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-01-24T00:02:49,937   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-01-24T00:02:49,938   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-01-24T00:02:49,938   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-01-24T00:02:49,939   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-01-24T00:02:49,940   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-01-24T00:02:49,941   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-01-24T00:02:49,941   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-01-24T00:02:49,942   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-01-24T00:02:49,943   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-01-24T00:02:49,944   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-01-24T00:02:49,944   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-01-24T00:02:49,945   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-01-24T00:02:49,946   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-01-24T00:02:49,946   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-01-24T00:02:49,947   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-01-24T00:02:49,947   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-01-24T00:02:49,948   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-01-24T00:02:49,948   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-01-24T00:02:49,949   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-01-24T00:02:49,950   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-01-24T00:02:49,951   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-01-24T00:02:49,951   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-01-24T00:02:49,952   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-01-24T00:02:49,953   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-01-24T00:02:49,954   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-01-24T00:02:49,954   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-01-24T00:02:49,955   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-01-24T00:02:49,956   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-01-24T00:02:49,957   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-01-24T00:02:49,957   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-01-24T00:02:49,958   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-01-24T00:02:49,958   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-01-24T00:02:49,959   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-01-24T00:02:49,960   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-01-24T00:02:49,960   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-01-24T00:02:49,961   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-01-24T00:02:49,961   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-01-24T00:02:49,962   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-01-24T00:02:49,963   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-01-24T00:02:49,964   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-01-24T00:02:49,964   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-01-24T00:02:49,965   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-01-24T00:02:49,966   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-01-24T00:02:49,966   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-01-24T00:02:49,967   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-01-24T00:02:49,968   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-01-24T00:02:49,969   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-01-24T00:02:49,969   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-01-24T00:02:49,970   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-01-24T00:02:49,970   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-01-24T00:02:49,971   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-01-24T00:02:49,972   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-01-24T00:02:49,972   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-01-24T00:02:49,973   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-01-24T00:02:49,973   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-01-24T00:02:49,974   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-01-24T00:02:49,975   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-01-24T00:02:49,975   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-01-24T00:02:49,976   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-01-24T00:02:49,977   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-01-24T00:02:49,978   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-01-24T00:02:49,978   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-01-24T00:02:49,979   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-01-24T00:02:49,980   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-01-24T00:02:49,981   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-01-24T00:02:49,981 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-01-24T00:02:49,982 Getting page https://www.piwheels.org/simple/deepspeed/
2024-01-24T00:02:49,983 Found index url https://www.piwheels.org/simple/
2024-01-24T00:02:50,147 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-01-24T00:02:50,162   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,163   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,163   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,164   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,165   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,165   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,166   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,166   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,167   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,168   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,168   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,169   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,170   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,170   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,171   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,171   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,172   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,172   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,173   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,173   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,174   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,175   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,175   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,176   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,176   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,177   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,177   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,178   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,179   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,179   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,180   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,180   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,181   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,181   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,182   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,182   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,183   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,183   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,184   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,185   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,185   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,186   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,186   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,187   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,188   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,188   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,188   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,189   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,189   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,190   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,191   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,191   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,192   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,192   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,193   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,193   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-01-24T00:02:50,194 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-01-24T00:02:50,195 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-01-24T00:02:50,223 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-01-24T00:02:50,241 Collecting deepspeed==0.13.1
2024-01-24T00:02:50,243   Created temporary directory: /tmp/pip-unpack-_yd9zcze
2024-01-24T00:02:50,471   Downloading deepspeed-0.13.1.tar.gz (1.3 MB)
2024-01-24T00:02:52,724   Added deepspeed==0.13.1 from https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz to build tracker '/tmp/pip-build-tracker-715yxzy3'
2024-01-24T00:02:52,726   Running setup.py (path:/tmp/pip-wheel-6pgs4r2y/deepspeed_57fa24ee174f449095a130862a1379f1/setup.py) egg_info for package deepspeed
2024-01-24T00:02:52,727   Created temporary directory: /tmp/pip-pip-egg-info-64ce4p2k
2024-01-24T00:02:52,727   Preparing metadata (setup.py): started
2024-01-24T00:02:52,728   Running command python setup.py egg_info
2024-01-24T00:02:53,645   fatal: not a git repository (or any of the parent directories): .git
2024-01-24T00:02:54,296   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-01-24T00:02:54,297    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-01-24T00:02:54,297   DS_BUILD_OPS=0
2024-01-24T00:02:54,298    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-01-24T00:02:54,298    [WARNING]  async_io: please install the libaio-dev package with apt
2024-01-24T00:02:54,298    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-01-24T00:02:54,299    [WARNING]  Please install torch if trying to pre-compile kernels
2024-01-24T00:02:54,299    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:54,300    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:54,301    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:54,301    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:54,302    [WARNING]  unable to import torch, please install it first
2024-01-24T00:02:54,303    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:54,303    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:54,304   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False}
2024-01-24T00:02:54,304   version=0.13.1, git_hash=unknown, git_branch=unknown
2024-01-24T00:02:54,305   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-01-24T00:02:54,305   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False}
2024-01-24T00:02:54,306   ext_modules=[]
2024-01-24T00:02:54,307   running egg_info
2024-01-24T00:02:54,307   creating /tmp/pip-pip-egg-info-64ce4p2k/deepspeed.egg-info
2024-01-24T00:02:54,328   writing /tmp/pip-pip-egg-info-64ce4p2k/deepspeed.egg-info/PKG-INFO
2024-01-24T00:02:54,360   writing dependency_links to /tmp/pip-pip-egg-info-64ce4p2k/deepspeed.egg-info/dependency_links.txt
2024-01-24T00:02:54,362   writing entry points to /tmp/pip-pip-egg-info-64ce4p2k/deepspeed.egg-info/entry_points.txt
2024-01-24T00:02:54,378   writing requirements to /tmp/pip-pip-egg-info-64ce4p2k/deepspeed.egg-info/requires.txt
2024-01-24T00:02:54,380   writing top-level names to /tmp/pip-pip-egg-info-64ce4p2k/deepspeed.egg-info/top_level.txt
2024-01-24T00:02:54,381   writing manifest file '/tmp/pip-pip-egg-info-64ce4p2k/deepspeed.egg-info/SOURCES.txt'
2024-01-24T00:02:54,584   reading manifest file '/tmp/pip-pip-egg-info-64ce4p2k/deepspeed.egg-info/SOURCES.txt'
2024-01-24T00:02:54,586   reading manifest template 'MANIFEST.in'
2024-01-24T00:02:54,587   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-01-24T00:02:54,588   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-01-24T00:02:55,733   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-01-24T00:02:56,583   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-01-24T00:02:57,099   warning: no files found matching '*.tr' under directory 'csrc'
2024-01-24T00:02:57,202   warning: no files found matching '*.cc' under directory 'csrc'
2024-01-24T00:02:57,235   warning: no files found matching '*.py' under directory 'benchmarks'
2024-01-24T00:02:57,271   writing manifest file '/tmp/pip-pip-egg-info-64ce4p2k/deepspeed.egg-info/SOURCES.txt'
2024-01-24T00:02:57,273   deepspeed build time = 3.624372959136963 secs
2024-01-24T00:02:57,387   Preparing metadata (setup.py): finished with status 'done'
2024-01-24T00:02:57,393   Source in /tmp/pip-wheel-6pgs4r2y/deepspeed_57fa24ee174f449095a130862a1379f1 has version 0.13.1, which satisfies requirement deepspeed==0.13.1 from https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz
2024-01-24T00:02:57,394   Removed deepspeed==0.13.1 from https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz from build tracker '/tmp/pip-build-tracker-715yxzy3'
2024-01-24T00:02:57,402 Created temporary directory: /tmp/pip-unpack-9ct8mt16
2024-01-24T00:02:57,403 Created temporary directory: /tmp/pip-unpack-7qnwg8zz
2024-01-24T00:02:57,654 Building wheels for collected packages: deepspeed
2024-01-24T00:02:57,658   Created temporary directory: /tmp/pip-wheel-ywhcicex
2024-01-24T00:02:57,659   Building wheel for deepspeed (setup.py): started
2024-01-24T00:02:57,661   Destination directory: /tmp/pip-wheel-ywhcicex
2024-01-24T00:02:57,661   Running command python setup.py bdist_wheel
2024-01-24T00:02:58,086   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-01-24T00:02:58,093    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-01-24T00:02:58,165   DS_BUILD_OPS=0
2024-01-24T00:02:58,279    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-01-24T00:02:58,338    [WARNING]  async_io: please install the libaio-dev package with apt
2024-01-24T00:02:58,338    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-01-24T00:02:58,339    [WARNING]  Please install torch if trying to pre-compile kernels
2024-01-24T00:02:58,340    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:58,340    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:58,341    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:58,342    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:58,343    [WARNING]  unable to import torch, please install it first
2024-01-24T00:02:58,343    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:58,343    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-01-24T00:02:58,344   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False}
2024-01-24T00:02:58,351   fatal: not a git repository (or any of the parent directories): .git
2024-01-24T00:02:58,353   version=0.13.1, git_hash=unknown, git_branch=unknown
2024-01-24T00:02:58,354   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-01-24T00:02:58,355   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False}
2024-01-24T00:02:58,355   ext_modules=[]
2024-01-24T00:02:58,978   running bdist_wheel
2024-01-24T00:02:59,078   running build
2024-01-24T00:02:59,079   running build_py
2024-01-24T00:02:59,109   creating build
2024-01-24T00:02:59,109   creating build/lib
2024-01-24T00:02:59,110   creating build/lib/deepspeed
2024-01-24T00:02:59,111   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-01-24T00:02:59,113   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2024-01-24T00:02:59,115   copying deepspeed/constants.py -> build/lib/deepspeed
2024-01-24T00:02:59,117   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-01-24T00:02:59,118   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-01-24T00:02:59,120   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-01-24T00:02:59,123   creating build/lib/deepspeed/model_implementations
2024-01-24T00:02:59,124   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-01-24T00:02:59,126   creating build/lib/deepspeed/autotuning
2024-01-24T00:02:59,127   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-01-24T00:02:59,129   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-01-24T00:02:59,132   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-01-24T00:02:59,135   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-01-24T00:02:59,137   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-01-24T00:02:59,139   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-01-24T00:02:59,142   creating build/lib/deepspeed/profiling
2024-01-24T00:02:59,143   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-01-24T00:02:59,145   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-01-24T00:02:59,146   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-01-24T00:02:59,149   creating build/lib/deepspeed/moe
2024-01-24T00:02:59,150   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-01-24T00:02:59,152   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-01-24T00:02:59,154   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-01-24T00:02:59,156   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-01-24T00:02:59,158   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-01-24T00:02:59,160   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-01-24T00:02:59,163   creating build/lib/deepspeed/runtime
2024-01-24T00:02:59,164   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,166   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,168   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,170   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,173   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,175   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,177   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,179   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,181   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,183   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,185   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,187   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,192   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,195   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,198   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,200   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-01-24T00:02:59,203   creating build/lib/deepspeed/nebula
2024-01-24T00:02:59,204   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-01-24T00:02:59,206   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-01-24T00:02:59,208   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-01-24T00:02:59,210   creating build/lib/deepspeed/compression
2024-01-24T00:02:59,211   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-01-24T00:02:59,214   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-01-24T00:02:59,216   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-01-24T00:02:59,218   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-01-24T00:02:59,221   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-01-24T00:02:59,223   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-01-24T00:02:59,225   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-01-24T00:02:59,228   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-01-24T00:02:59,230   creating build/lib/deepspeed/pipe
2024-01-24T00:02:59,231   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-01-24T00:02:59,234   creating build/lib/deepspeed/launcher
2024-01-24T00:02:59,235   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-01-24T00:02:59,237   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-01-24T00:02:59,240   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-01-24T00:02:59,243   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-01-24T00:02:59,244   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-01-24T00:02:59,247   creating build/lib/deepspeed/utils
2024-01-24T00:02:59,248   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,250   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,252   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,254   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,257   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,258   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,260   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,262   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,263   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,265   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,267   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,269   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,271   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,273   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,275   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-01-24T00:02:59,277   creating build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,278   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,280   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,283   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,285   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,287   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,289   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,291   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,293   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,295   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,297   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-01-24T00:02:59,299   creating build/lib/deepspeed/inference
2024-01-24T00:02:59,300   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-01-24T00:02:59,302   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-01-24T00:02:59,305   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-01-24T00:02:59,307   creating build/lib/deepspeed/monitor
2024-01-24T00:02:59,308   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-01-24T00:02:59,310   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-01-24T00:02:59,312   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-01-24T00:02:59,314   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-01-24T00:02:59,316   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-01-24T00:02:59,317   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-01-24T00:02:59,319   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-01-24T00:02:59,322   creating build/lib/deepspeed/sequence
2024-01-24T00:02:59,322   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-01-24T00:02:59,324   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-01-24T00:02:59,326   creating build/lib/deepspeed/ops
2024-01-24T00:02:59,328   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-01-24T00:02:59,330   creating build/lib/deepspeed/module_inject
2024-01-24T00:02:59,331   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,334   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,336   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,338   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,340   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,343   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,344   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,346   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,348   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,350   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,353   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,354   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,356   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-01-24T00:02:59,358   creating build/lib/deepspeed/accelerator
2024-01-24T00:02:59,359   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-01-24T00:02:59,361   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-01-24T00:02:59,363   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-01-24T00:02:59,366   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-01-24T00:02:59,368   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-01-24T00:02:59,370   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-01-24T00:02:59,372   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-01-24T00:02:59,374   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-01-24T00:02:59,376   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-01-24T00:02:59,379   creating build/lib/deepspeed/elasticity
2024-01-24T00:02:59,380   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-01-24T00:02:59,382   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-01-24T00:02:59,384   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-01-24T00:02:59,386   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-01-24T00:02:59,387   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-01-24T00:02:59,389   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-01-24T00:02:59,392   creating build/lib/deepspeed/comm
2024-01-24T00:02:59,393   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-01-24T00:02:59,395   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-01-24T00:02:59,396   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-01-24T00:02:59,399   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-01-24T00:02:59,401   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-01-24T00:02:59,403   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-01-24T00:02:59,405   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-01-24T00:02:59,407   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-01-24T00:02:59,409   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-01-24T00:02:59,411   creating build/lib/deepspeed/model_implementations/features
2024-01-24T00:02:59,412   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-01-24T00:02:59,414   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-01-24T00:02:59,416   creating build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,417   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,419   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,421   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,422   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,424   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,426   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,427   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,429   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,431   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,433   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-01-24T00:02:59,436   creating build/lib/deepspeed/model_implementations/diffusers
2024-01-24T00:02:59,437   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-01-24T00:02:59,439   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-01-24T00:02:59,441   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-01-24T00:02:59,443   creating build/lib/deepspeed/autotuning/tuner
2024-01-24T00:02:59,444   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-01-24T00:02:59,446   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-01-24T00:02:59,447   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-01-24T00:02:59,449   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-01-24T00:02:59,451   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-01-24T00:02:59,453   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-01-24T00:02:59,455   creating build/lib/deepspeed/profiling/flops_profiler
2024-01-24T00:02:59,456   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-01-24T00:02:59,459   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-01-24T00:02:59,462   creating build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,463   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,465   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,467   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,470   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,472   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,475   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,477   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,479   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,484   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,486   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,488   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,493   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,497   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,499   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,501   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,503   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-01-24T00:02:59,505   creating build/lib/deepspeed/runtime/swap_tensor
2024-01-24T00:02:59,506   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-01-24T00:02:59,508   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-01-24T00:02:59,511   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-01-24T00:02:59,513   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-01-24T00:02:59,515   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-01-24T00:02:59,517   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-01-24T00:02:59,519   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-01-24T00:02:59,521   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-01-24T00:02:59,524   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-01-24T00:02:59,526   creating build/lib/deepspeed/runtime/data_pipeline
2024-01-24T00:02:59,527   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-01-24T00:02:59,529   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-01-24T00:02:59,531   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-01-24T00:02:59,533   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-01-24T00:02:59,535   creating build/lib/deepspeed/runtime/compression
2024-01-24T00:02:59,536   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-01-24T00:02:59,538   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-01-24T00:02:59,540   creating build/lib/deepspeed/runtime/pipe
2024-01-24T00:02:59,541   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-01-24T00:02:59,544   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-01-24T00:02:59,546   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-01-24T00:02:59,549   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-01-24T00:02:59,552   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-01-24T00:02:59,554   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-01-24T00:02:59,556   creating build/lib/deepspeed/runtime/fp16
2024-01-24T00:02:59,557   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-01-24T00:02:59,560   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-01-24T00:02:59,562   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-01-24T00:02:59,564   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-01-24T00:02:59,566   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-01-24T00:02:59,567   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-01-24T00:02:59,570   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-01-24T00:02:59,571   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-01-24T00:02:59,574   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-01-24T00:02:59,574   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-01-24T00:02:59,576   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-01-24T00:02:59,578   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-01-24T00:02:59,580   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-01-24T00:02:59,582   creating build/lib/deepspeed/runtime/comm
2024-01-24T00:02:59,583   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-01-24T00:02:59,586   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-01-24T00:02:59,588   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-01-24T00:02:59,590   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-01-24T00:02:59,592   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-01-24T00:02:59,594   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:02:59,595   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:02:59,597   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:02:59,600   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:02:59,602   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:02:59,604   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:02:59,607   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:02:59,608   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:02:59,610   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:02:59,611   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:02:59,613   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:02:59,615   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:02:59,617   creating build/lib/deepspeed/runtime/fp16/onebit
2024-01-24T00:02:59,618   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-01-24T00:02:59,621   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-01-24T00:02:59,623   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-01-24T00:02:59,626   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-01-24T00:02:59,628   creating build/lib/deepspeed/inference/quantization
2024-01-24T00:02:59,629   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-01-24T00:02:59,631   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-01-24T00:02:59,633   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-01-24T00:02:59,635   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-01-24T00:02:59,637   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-01-24T00:02:59,639   creating build/lib/deepspeed/inference/v2
2024-01-24T00:02:59,640   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-01-24T00:02:59,642   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-01-24T00:02:59,644   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-01-24T00:02:59,645   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-01-24T00:02:59,647   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-01-24T00:02:59,648   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-01-24T00:02:59,651   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-01-24T00:02:59,652   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-01-24T00:02:59,654   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-01-24T00:02:59,656   creating build/lib/deepspeed/inference/v2/model_implementations
2024-01-24T00:02:59,657   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-01-24T00:02:59,660   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-01-24T00:02:59,662   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-01-24T00:02:59,664   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-01-24T00:02:59,667   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-01-24T00:02:59,669   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-01-24T00:02:59,671   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-01-24T00:02:59,673   creating build/lib/deepspeed/inference/v2/kernels
2024-01-24T00:02:59,674   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-01-24T00:02:59,676   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-01-24T00:02:59,679   creating build/lib/deepspeed/inference/v2/ragged
2024-01-24T00:02:59,680   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-01-24T00:02:59,682   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-01-24T00:02:59,684   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-01-24T00:02:59,686   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-01-24T00:02:59,688   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-01-24T00:02:59,690   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-01-24T00:02:59,693   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-01-24T00:02:59,695   creating build/lib/deepspeed/inference/v2/checkpoint
2024-01-24T00:02:59,696   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-01-24T00:02:59,698   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-01-24T00:02:59,699   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-01-24T00:02:59,701   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-01-24T00:02:59,704   creating build/lib/deepspeed/inference/v2/modules
2024-01-24T00:02:59,705   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-01-24T00:02:59,706   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-01-24T00:02:59,708   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-01-24T00:02:59,710   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-01-24T00:02:59,712   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:02:59,713   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:02:59,715   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:02:59,718   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:02:59,720   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:02:59,722   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:02:59,724   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:02:59,726   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:02:59,728   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:02:59,730   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:02:59,732   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-01-24T00:02:59,733   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-01-24T00:02:59,735   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-01-24T00:02:59,737   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-01-24T00:02:59,739   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-01-24T00:02:59,742   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-01-24T00:02:59,743   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-01-24T00:02:59,745   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-01-24T00:02:59,747   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-01-24T00:02:59,749   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-01-24T00:02:59,751   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-01-24T00:02:59,752   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-01-24T00:02:59,754   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-01-24T00:02:59,756   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-01-24T00:02:59,758   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-01-24T00:02:59,760   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-01-24T00:02:59,761   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-01-24T00:02:59,763   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-01-24T00:02:59,765   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-01-24T00:02:59,767   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-01-24T00:02:59,769   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-01-24T00:02:59,770   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-01-24T00:02:59,772   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-01-24T00:02:59,774   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-01-24T00:02:59,776   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-01-24T00:02:59,779   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-01-24T00:02:59,780   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-01-24T00:02:59,782   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-01-24T00:02:59,784   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-01-24T00:02:59,786   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-01-24T00:02:59,789   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:02:59,790   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:02:59,792   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:02:59,794   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:02:59,796   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:02:59,798   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:02:59,800   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:02:59,801   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:02:59,803   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:02:59,805   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:02:59,807   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-01-24T00:02:59,808   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-01-24T00:02:59,810   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-01-24T00:02:59,812   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-01-24T00:02:59,814   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-01-24T00:02:59,817   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-01-24T00:02:59,817   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-01-24T00:02:59,820   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-01-24T00:02:59,821   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-01-24T00:02:59,823   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-01-24T00:02:59,824   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-01-24T00:02:59,827   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:02:59,828   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:02:59,830   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:02:59,832   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:02:59,833   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:02:59,835   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:02:59,838   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:02:59,839   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:02:59,841   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:02:59,843   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:02:59,844   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:02:59,846   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:02:59,848   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:02:59,850   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:02:59,852   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:02:59,853   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:02:59,855   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:02:59,857   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:02:59,858   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:02:59,860   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:02:59,862   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-01-24T00:02:59,863   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-01-24T00:02:59,865   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-01-24T00:02:59,867   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:02:59,869   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:02:59,870   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:02:59,873   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:02:59,874   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:02:59,876   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:02:59,878   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-01-24T00:02:59,879   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-01-24T00:02:59,881   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-01-24T00:02:59,883   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:02:59,884   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:02:59,886   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:02:59,889   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:02:59,890   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:02:59,892   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:02:59,894   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:02:59,896   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:02:59,898   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:02:59,900   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:02:59,901   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:02:59,903   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:02:59,905   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:02:59,906   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:02:59,909   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:02:59,910   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:02:59,912   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:02:59,913   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:02:59,916   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:02:59,917   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:02:59,919   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:02:59,921   creating build/lib/deepspeed/inference/v2/modules/configs
2024-01-24T00:02:59,922   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-01-24T00:02:59,924   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-01-24T00:02:59,926   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-01-24T00:02:59,928   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-01-24T00:02:59,930   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-01-24T00:02:59,932   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-01-24T00:02:59,934   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-01-24T00:02:59,936   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-01-24T00:02:59,937   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-01-24T00:02:59,940   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:02:59,941   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:02:59,943   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:02:59,945   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:02:59,947   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:02:59,949   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:02:59,950   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:02:59,952   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:02:59,954   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:02:59,956   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-01-24T00:02:59,957   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-01-24T00:02:59,960   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-01-24T00:02:59,962   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-01-24T00:02:59,963   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-01-24T00:02:59,965   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-01-24T00:02:59,968   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-01-24T00:02:59,969   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-01-24T00:02:59,971   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-01-24T00:02:59,973   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-01-24T00:02:59,974   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-01-24T00:02:59,976   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-01-24T00:02:59,978   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-01-24T00:02:59,981   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-01-24T00:02:59,982   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-01-24T00:02:59,984   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-01-24T00:02:59,986   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-01-24T00:02:59,987   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-01-24T00:02:59,989   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-01-24T00:02:59,992   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-01-24T00:02:59,993   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-01-24T00:02:59,995   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-01-24T00:02:59,998   creating build/lib/deepspeed/ops/deepspeed4science
2024-01-24T00:02:59,999   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-01-24T00:03:00,001   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-01-24T00:03:00,003   creating build/lib/deepspeed/ops/adagrad
2024-01-24T00:03:00,004   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-01-24T00:03:00,006   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-01-24T00:03:00,008   creating build/lib/deepspeed/ops/transformer
2024-01-24T00:03:00,009   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-01-24T00:03:00,012   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-01-24T00:03:00,015   creating build/lib/deepspeed/ops/sparse_attention
2024-01-24T00:03:00,016   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-01-24T00:03:00,020   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-01-24T00:03:00,023   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-01-24T00:03:00,026   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-01-24T00:03:00,028   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-01-24T00:03:00,031   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-01-24T00:03:00,034   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-01-24T00:03:00,036   creating build/lib/deepspeed/ops/quantizer
2024-01-24T00:03:00,038   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-01-24T00:03:00,040   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-01-24T00:03:00,042   creating build/lib/deepspeed/ops/adam
2024-01-24T00:03:00,044   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-01-24T00:03:00,046   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-01-24T00:03:00,049   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-01-24T00:03:00,051   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-01-24T00:03:00,054   creating build/lib/deepspeed/ops/lamb
2024-01-24T00:03:00,055   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-01-24T00:03:00,058   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-01-24T00:03:00,060   creating build/lib/deepspeed/ops/aio
2024-01-24T00:03:00,062   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-01-24T00:03:00,064   creating build/lib/deepspeed/ops/random_ltd
2024-01-24T00:03:00,065   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-01-24T00:03:00,068   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-01-24T00:03:00,070   creating build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,071   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,073   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,075   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,078   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,079   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,082   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,084   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,086   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,088   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,089   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,091   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,093   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,095   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,096   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,098   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,101   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,102   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,104   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,106   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,108   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,110   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,111   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-01-24T00:03:00,114   creating build/lib/deepspeed/ops/lion
2024-01-24T00:03:00,115   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-01-24T00:03:00,117   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-01-24T00:03:00,119   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-01-24T00:03:00,120   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-01-24T00:03:00,123   creating build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,124   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,127   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,129   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,131   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,133   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,135   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,138   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,140   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,142   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,144   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-01-24T00:03:00,147   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,148   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,150   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,153   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,155   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,157   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,159   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,161   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,163   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,165   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,167   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:00,170   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,171   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,173   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,175   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,177   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,179   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,181   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,183   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,185   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,186   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,188   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:00,191   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-01-24T00:03:00,192   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-01-24T00:03:00,195   creating build/lib/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:00,196   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:00,198   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:00,199   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:00,201   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:00,203   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:00,205   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:00,207   creating build/lib/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:00,208   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:00,210   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:00,212   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:00,214   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:00,216   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:00,218   creating build/lib/deepspeed/ops/op_builder/npu
2024-01-24T00:03:00,219   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-01-24T00:03:00,221   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-01-24T00:03:00,223   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-01-24T00:03:00,225   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-01-24T00:03:00,227   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-01-24T00:03:00,229   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-01-24T00:03:00,230   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-01-24T00:03:00,232   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-01-24T00:03:00,235   creating build/lib/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:00,236   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:00,238   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:00,239   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:00,241   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:00,244   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:00,245   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:00,248   creating build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,249   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,252   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,254   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,256   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,258   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,260   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,262   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,265   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,267   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,269   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,271   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,273   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,275   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,277   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,279   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,282   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,284   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,286   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,288   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-01-24T00:03:00,291   creating build/lib/deepspeed/module_inject/containers/features
2024-01-24T00:03:00,292   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-01-24T00:03:00,294   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-01-24T00:03:00,296   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-01-24T00:03:00,298   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-01-24T00:03:00,301   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-01-24T00:03:00,302   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-01-24T00:03:00,304   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-01-24T00:03:00,307   running egg_info
2024-01-24T00:03:00,358   writing deepspeed.egg-info/PKG-INFO
2024-01-24T00:03:00,390   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-01-24T00:03:00,392   writing entry points to deepspeed.egg-info/entry_points.txt
2024-01-24T00:03:00,408   writing requirements to deepspeed.egg-info/requires.txt
2024-01-24T00:03:00,410   writing top-level names to deepspeed.egg-info/top_level.txt
2024-01-24T00:03:00,523   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-01-24T00:03:00,570   reading manifest template 'MANIFEST.in'
2024-01-24T00:03:00,572   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-01-24T00:03:00,572   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-01-24T00:03:01,680   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-01-24T00:03:02,477   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-01-24T00:03:02,960   warning: no files found matching '*.tr' under directory 'csrc'
2024-01-24T00:03:03,070   warning: no files found matching '*.cc' under directory 'csrc'
2024-01-24T00:03:03,105   warning: no files found matching '*.py' under directory 'benchmarks'
2024-01-24T00:03:03,152   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-01-24T00:03:03,163   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-01-24T00:03:03,164   !!

2024-01-24T00:03:03,165           ********************************************************************************
2024-01-24T00:03:03,166           ############################
2024-01-24T00:03:03,166           # Package would be ignored #
2024-01-24T00:03:03,167           ############################
2024-01-24T00:03:03,168           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-01-24T00:03:03,168           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,170           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,170           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-01-24T00:03:03,171           to the `packages` configuration field.

2024-01-24T00:03:03,172           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,173           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,173           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,174           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,175           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,176           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-01-24T00:03:03,177           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-01-24T00:03:03,177           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,178           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,178           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,180           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,181           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,182           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,183                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,183                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,184                 directory, all directories are treated like packages.
2024-01-24T00:03:03,185           ********************************************************************************

2024-01-24T00:03:03,186   !!
2024-01-24T00:03:03,187     check.warn(importable)
2024-01-24T00:03:03,188   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-01-24T00:03:03,189   !!

2024-01-24T00:03:03,190           ********************************************************************************
2024-01-24T00:03:03,191           ############################
2024-01-24T00:03:03,192           # Package would be ignored #
2024-01-24T00:03:03,192           ############################
2024-01-24T00:03:03,193           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-01-24T00:03:03,194           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,195           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,196           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-01-24T00:03:03,196           to the `packages` configuration field.

2024-01-24T00:03:03,198           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,198           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,199           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,200           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,201           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,203           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-01-24T00:03:03,204           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-01-24T00:03:03,204           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,205           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,206           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,207           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,208           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,210           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,210                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,211                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,211                 directory, all directories are treated like packages.
2024-01-24T00:03:03,212           ********************************************************************************

2024-01-24T00:03:03,213   !!
2024-01-24T00:03:03,214     check.warn(importable)
2024-01-24T00:03:03,214   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-01-24T00:03:03,215   !!

2024-01-24T00:03:03,216           ********************************************************************************
2024-01-24T00:03:03,217           ############################
2024-01-24T00:03:03,217           # Package would be ignored #
2024-01-24T00:03:03,218           ############################
2024-01-24T00:03:03,218           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-01-24T00:03:03,219           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,221           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,221           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-01-24T00:03:03,222           to the `packages` configuration field.

2024-01-24T00:03:03,224           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,224           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,225           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,226           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,228           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,229           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-01-24T00:03:03,230           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-01-24T00:03:03,231           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,231           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,232           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,233           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,234           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,236           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,237                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,237                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,238                 directory, all directories are treated like packages.
2024-01-24T00:03:03,238           ********************************************************************************

2024-01-24T00:03:03,240   !!
2024-01-24T00:03:03,240     check.warn(importable)
2024-01-24T00:03:03,241   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-01-24T00:03:03,242   !!

2024-01-24T00:03:03,243           ********************************************************************************
2024-01-24T00:03:03,244           ############################
2024-01-24T00:03:03,244           # Package would be ignored #
2024-01-24T00:03:03,245           ############################
2024-01-24T00:03:03,245           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-01-24T00:03:03,245           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,246           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,247           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-01-24T00:03:03,247           to the `packages` configuration field.

2024-01-24T00:03:03,248           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,248           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,249           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,250           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,251           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,252           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-01-24T00:03:03,252           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-01-24T00:03:03,253           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,253           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,254           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,255           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,256           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,257           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,258                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,258                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,259                 directory, all directories are treated like packages.
2024-01-24T00:03:03,259           ********************************************************************************

2024-01-24T00:03:03,260   !!
2024-01-24T00:03:03,260     check.warn(importable)
2024-01-24T00:03:03,260   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-01-24T00:03:03,261   !!

2024-01-24T00:03:03,262           ********************************************************************************
2024-01-24T00:03:03,262           ############################
2024-01-24T00:03:03,263           # Package would be ignored #
2024-01-24T00:03:03,263           ############################
2024-01-24T00:03:03,263           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-01-24T00:03:03,264           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,265           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,265           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-01-24T00:03:03,266           to the `packages` configuration field.

2024-01-24T00:03:03,267           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,268           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,268           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,269           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,270           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,271           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-01-24T00:03:03,271           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-01-24T00:03:03,271           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,272           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,272           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,273           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,274           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,276           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,276                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,277                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,277                 directory, all directories are treated like packages.
2024-01-24T00:03:03,278           ********************************************************************************

2024-01-24T00:03:03,278   !!
2024-01-24T00:03:03,279     check.warn(importable)
2024-01-24T00:03:03,279   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-01-24T00:03:03,280   !!

2024-01-24T00:03:03,281           ********************************************************************************
2024-01-24T00:03:03,282           ############################
2024-01-24T00:03:03,282           # Package would be ignored #
2024-01-24T00:03:03,283           ############################
2024-01-24T00:03:03,283           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-01-24T00:03:03,284           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,285           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,286           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-01-24T00:03:03,286           to the `packages` configuration field.

2024-01-24T00:03:03,287           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,288           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,288           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,289           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,290           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,291           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-01-24T00:03:03,291           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-01-24T00:03:03,292           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,292           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,293           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,294           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,295           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,297           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,297                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,298                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,298                 directory, all directories are treated like packages.
2024-01-24T00:03:03,299           ********************************************************************************

2024-01-24T00:03:03,299   !!
2024-01-24T00:03:03,300     check.warn(importable)
2024-01-24T00:03:03,300   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-01-24T00:03:03,300   !!

2024-01-24T00:03:03,301           ********************************************************************************
2024-01-24T00:03:03,301           ############################
2024-01-24T00:03:03,302           # Package would be ignored #
2024-01-24T00:03:03,302           ############################
2024-01-24T00:03:03,302           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-01-24T00:03:03,303           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,303           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,304           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-01-24T00:03:03,304           to the `packages` configuration field.

2024-01-24T00:03:03,305           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,305           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,305           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,306           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,308           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,309           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-01-24T00:03:03,309           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-01-24T00:03:03,309           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,310           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,311           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,312           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,313           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,314           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,314                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,315                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,315                 directory, all directories are treated like packages.
2024-01-24T00:03:03,316           ********************************************************************************

2024-01-24T00:03:03,317   !!
2024-01-24T00:03:03,317     check.warn(importable)
2024-01-24T00:03:03,318   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-01-24T00:03:03,318   !!

2024-01-24T00:03:03,319           ********************************************************************************
2024-01-24T00:03:03,320           ############################
2024-01-24T00:03:03,320           # Package would be ignored #
2024-01-24T00:03:03,321           ############################
2024-01-24T00:03:03,321           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-01-24T00:03:03,322           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,323           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,323           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-01-24T00:03:03,324           to the `packages` configuration field.

2024-01-24T00:03:03,324           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,325           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,325           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,326           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,326           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,327           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-01-24T00:03:03,327           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-01-24T00:03:03,328           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,328           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,328           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,329           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,330           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,331           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,331                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,332                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,333                 directory, all directories are treated like packages.
2024-01-24T00:03:03,333           ********************************************************************************

2024-01-24T00:03:03,334   !!
2024-01-24T00:03:03,335     check.warn(importable)
2024-01-24T00:03:03,335   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-01-24T00:03:03,336   !!

2024-01-24T00:03:03,337           ********************************************************************************
2024-01-24T00:03:03,337           ############################
2024-01-24T00:03:03,338           # Package would be ignored #
2024-01-24T00:03:03,338           ############################
2024-01-24T00:03:03,339           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-01-24T00:03:03,340           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,341           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,341           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-01-24T00:03:03,341           to the `packages` configuration field.

2024-01-24T00:03:03,342           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,343           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,343           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,344           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,345           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,346           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-01-24T00:03:03,347           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-01-24T00:03:03,348           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,348           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,349           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,350           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,350           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,351           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,352                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,352                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,352                 directory, all directories are treated like packages.
2024-01-24T00:03:03,353           ********************************************************************************

2024-01-24T00:03:03,353   !!
2024-01-24T00:03:03,354     check.warn(importable)
2024-01-24T00:03:03,354   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-01-24T00:03:03,354   !!

2024-01-24T00:03:03,355           ********************************************************************************
2024-01-24T00:03:03,355           ############################
2024-01-24T00:03:03,356           # Package would be ignored #
2024-01-24T00:03:03,356           ############################
2024-01-24T00:03:03,356           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-01-24T00:03:03,357           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,358           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,358           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-01-24T00:03:03,359           to the `packages` configuration field.

2024-01-24T00:03:03,360           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,360           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,361           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,362           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,363           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,364           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-01-24T00:03:03,365           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-01-24T00:03:03,365           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,366           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,366           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,367           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,368           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,369           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,370                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,370                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,371                 directory, all directories are treated like packages.
2024-01-24T00:03:03,371           ********************************************************************************

2024-01-24T00:03:03,372   !!
2024-01-24T00:03:03,373     check.warn(importable)
2024-01-24T00:03:03,373   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-01-24T00:03:03,374   !!

2024-01-24T00:03:03,375           ********************************************************************************
2024-01-24T00:03:03,375           ############################
2024-01-24T00:03:03,375           # Package would be ignored #
2024-01-24T00:03:03,376           ############################
2024-01-24T00:03:03,376           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-01-24T00:03:03,376           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,377           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,377           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-01-24T00:03:03,378           to the `packages` configuration field.

2024-01-24T00:03:03,378           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,379           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,379           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,380           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,381           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,381           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-01-24T00:03:03,382           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-01-24T00:03:03,382           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,382           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,383           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,384           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,385           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,386           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,387                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,387                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,388                 directory, all directories are treated like packages.
2024-01-24T00:03:03,389           ********************************************************************************

2024-01-24T00:03:03,390   !!
2024-01-24T00:03:03,390     check.warn(importable)
2024-01-24T00:03:03,391   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-01-24T00:03:03,391   !!

2024-01-24T00:03:03,392           ********************************************************************************
2024-01-24T00:03:03,393           ############################
2024-01-24T00:03:03,393           # Package would be ignored #
2024-01-24T00:03:03,394           ############################
2024-01-24T00:03:03,394           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-01-24T00:03:03,395           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,396           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,396           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-01-24T00:03:03,397           to the `packages` configuration field.

2024-01-24T00:03:03,398           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,398           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,399           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,400           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,401           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,402           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-01-24T00:03:03,402           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-01-24T00:03:03,403           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,403           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,403           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,404           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,405           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,406           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,406                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,406                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,407                 directory, all directories are treated like packages.
2024-01-24T00:03:03,407           ********************************************************************************

2024-01-24T00:03:03,408   !!
2024-01-24T00:03:03,408     check.warn(importable)
2024-01-24T00:03:03,409   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration.
2024-01-24T00:03:03,409   !!

2024-01-24T00:03:03,410           ********************************************************************************
2024-01-24T00:03:03,410           ############################
2024-01-24T00:03:03,410           # Package would be ignored #
2024-01-24T00:03:03,411           ############################
2024-01-24T00:03:03,411           Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1],
2024-01-24T00:03:03,412           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,413           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,414           package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added
2024-01-24T00:03:03,414           to the `packages` configuration field.

2024-01-24T00:03:03,415           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,416           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,416           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,417           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,421           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,422           If you don't want 'deepspeed.ops.csrc.common' to be distributed and are
2024-01-24T00:03:03,422           already explicitly excluding 'deepspeed.ops.csrc.common' via
2024-01-24T00:03:03,423           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,423           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,424           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,425           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,426           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,427           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,428                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,428                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,429                 directory, all directories are treated like packages.
2024-01-24T00:03:03,429           ********************************************************************************

2024-01-24T00:03:03,431   !!
2024-01-24T00:03:03,431     check.warn(importable)
2024-01-24T00:03:03,431   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-01-24T00:03:03,432   !!

2024-01-24T00:03:03,432           ********************************************************************************
2024-01-24T00:03:03,433           ############################
2024-01-24T00:03:03,433           # Package would be ignored #
2024-01-24T00:03:03,433           ############################
2024-01-24T00:03:03,434           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-01-24T00:03:03,434           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,435           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,435           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-01-24T00:03:03,435           to the `packages` configuration field.

2024-01-24T00:03:03,436           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,436           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,437           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,438           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,438           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,439           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-01-24T00:03:03,439           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-01-24T00:03:03,440           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,441           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,441           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,442           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,443           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,445           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,446                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,446                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,447                 directory, all directories are treated like packages.
2024-01-24T00:03:03,447           ********************************************************************************

2024-01-24T00:03:03,448   !!
2024-01-24T00:03:03,449     check.warn(importable)
2024-01-24T00:03:03,449   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-01-24T00:03:03,450   !!

2024-01-24T00:03:03,451           ********************************************************************************
2024-01-24T00:03:03,451           ############################
2024-01-24T00:03:03,452           # Package would be ignored #
2024-01-24T00:03:03,452           ############################
2024-01-24T00:03:03,453           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-01-24T00:03:03,453           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,454           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,455           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-01-24T00:03:03,455           to the `packages` configuration field.

2024-01-24T00:03:03,457           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,457           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,457           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,458           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,459           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,459           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-01-24T00:03:03,460           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-01-24T00:03:03,460           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,461           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,461           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,462           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,462           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,463           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,464                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,464                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,465                 directory, all directories are treated like packages.
2024-01-24T00:03:03,465           ********************************************************************************

2024-01-24T00:03:03,466   !!
2024-01-24T00:03:03,466     check.warn(importable)
2024-01-24T00:03:03,467   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-01-24T00:03:03,467   !!

2024-01-24T00:03:03,468           ********************************************************************************
2024-01-24T00:03:03,469           ############################
2024-01-24T00:03:03,469           # Package would be ignored #
2024-01-24T00:03:03,470           ############################
2024-01-24T00:03:03,470           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-01-24T00:03:03,471           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,472           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,472           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-01-24T00:03:03,473           to the `packages` configuration field.

2024-01-24T00:03:03,474           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,474           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,475           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,475           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,476           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,477           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-01-24T00:03:03,478           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-01-24T00:03:03,478           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,479           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,479           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,480           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,481           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,483           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,483                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,484                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,484                 directory, all directories are treated like packages.
2024-01-24T00:03:03,484           ********************************************************************************

2024-01-24T00:03:03,485   !!
2024-01-24T00:03:03,485     check.warn(importable)
2024-01-24T00:03:03,486   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-01-24T00:03:03,486   !!

2024-01-24T00:03:03,487           ********************************************************************************
2024-01-24T00:03:03,487           ############################
2024-01-24T00:03:03,487           # Package would be ignored #
2024-01-24T00:03:03,488           ############################
2024-01-24T00:03:03,488           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-01-24T00:03:03,488           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,489           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,489           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-01-24T00:03:03,490           to the `packages` configuration field.

2024-01-24T00:03:03,491           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,493           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,493           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,494           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,496           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,497           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-01-24T00:03:03,497           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-01-24T00:03:03,498           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,498           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,499           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,500           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,501           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,502           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,503                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,503                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,504                 directory, all directories are treated like packages.
2024-01-24T00:03:03,504           ********************************************************************************

2024-01-24T00:03:03,505   !!
2024-01-24T00:03:03,506     check.warn(importable)
2024-01-24T00:03:03,506   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-01-24T00:03:03,507   !!

2024-01-24T00:03:03,508           ********************************************************************************
2024-01-24T00:03:03,509           ############################
2024-01-24T00:03:03,509           # Package would be ignored #
2024-01-24T00:03:03,510           ############################
2024-01-24T00:03:03,510           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-01-24T00:03:03,511           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,511           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,512           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-01-24T00:03:03,512           to the `packages` configuration field.

2024-01-24T00:03:03,513           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,513           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,513           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,514           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,515           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,515           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-01-24T00:03:03,516           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-01-24T00:03:03,516           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,516           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,517           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,517           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,518           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,520           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,520                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,521                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,521                 directory, all directories are treated like packages.
2024-01-24T00:03:03,522           ********************************************************************************

2024-01-24T00:03:03,523   !!
2024-01-24T00:03:03,524     check.warn(importable)
2024-01-24T00:03:03,524   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-01-24T00:03:03,525   !!

2024-01-24T00:03:03,526           ********************************************************************************
2024-01-24T00:03:03,526           ############################
2024-01-24T00:03:03,527           # Package would be ignored #
2024-01-24T00:03:03,527           ############################
2024-01-24T00:03:03,527           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-01-24T00:03:03,528           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,529           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,529           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-01-24T00:03:03,530           to the `packages` configuration field.

2024-01-24T00:03:03,531           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,532           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,532           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,533           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,535           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,535           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-01-24T00:03:03,535           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-01-24T00:03:03,536           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,536           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,536           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,537           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,538           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,539           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,539                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,539                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,540                 directory, all directories are treated like packages.
2024-01-24T00:03:03,540           ********************************************************************************

2024-01-24T00:03:03,541   !!
2024-01-24T00:03:03,541     check.warn(importable)
2024-01-24T00:03:03,542   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-01-24T00:03:03,542   !!

2024-01-24T00:03:03,543           ********************************************************************************
2024-01-24T00:03:03,543           ############################
2024-01-24T00:03:03,544           # Package would be ignored #
2024-01-24T00:03:03,545           ############################
2024-01-24T00:03:03,545           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-01-24T00:03:03,546           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,547           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,547           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-01-24T00:03:03,548           to the `packages` configuration field.

2024-01-24T00:03:03,549           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,550           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,550           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,551           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,552           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,553           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-01-24T00:03:03,553           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-01-24T00:03:03,554           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,554           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,555           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,556           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,557           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,559           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,559                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,560                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,561                 directory, all directories are treated like packages.
2024-01-24T00:03:03,561           ********************************************************************************

2024-01-24T00:03:03,562   !!
2024-01-24T00:03:03,562     check.warn(importable)
2024-01-24T00:03:03,563   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-01-24T00:03:03,567   !!

2024-01-24T00:03:03,569           ********************************************************************************
2024-01-24T00:03:03,570           ############################
2024-01-24T00:03:03,570           # Package would be ignored #
2024-01-24T00:03:03,571           ############################
2024-01-24T00:03:03,572           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-01-24T00:03:03,573           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,574           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,574           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-01-24T00:03:03,574           to the `packages` configuration field.

2024-01-24T00:03:03,575           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,576           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,576           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,577           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,578           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,579           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-01-24T00:03:03,580           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-01-24T00:03:03,581           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,581           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,582           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,583           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,584           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,586           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,586                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,587                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,587                 directory, all directories are treated like packages.
2024-01-24T00:03:03,588           ********************************************************************************

2024-01-24T00:03:03,589   !!
2024-01-24T00:03:03,590     check.warn(importable)
2024-01-24T00:03:03,590   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-01-24T00:03:03,591   !!

2024-01-24T00:03:03,592           ********************************************************************************
2024-01-24T00:03:03,592           ############################
2024-01-24T00:03:03,593           # Package would be ignored #
2024-01-24T00:03:03,594           ############################
2024-01-24T00:03:03,594           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-01-24T00:03:03,595           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,596           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,596           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-01-24T00:03:03,597           to the `packages` configuration field.

2024-01-24T00:03:03,598           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,598           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,599           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,600           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,601           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,602           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-01-24T00:03:03,602           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-01-24T00:03:03,602           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,603           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,603           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,604           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,605           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,606           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,607                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,607                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,608                 directory, all directories are treated like packages.
2024-01-24T00:03:03,608           ********************************************************************************

2024-01-24T00:03:03,609   !!
2024-01-24T00:03:03,610     check.warn(importable)
2024-01-24T00:03:03,610   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-01-24T00:03:03,611   !!

2024-01-24T00:03:03,612           ********************************************************************************
2024-01-24T00:03:03,612           ############################
2024-01-24T00:03:03,613           # Package would be ignored #
2024-01-24T00:03:03,614           ############################
2024-01-24T00:03:03,614           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-01-24T00:03:03,615           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,616           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,616           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-01-24T00:03:03,617           to the `packages` configuration field.

2024-01-24T00:03:03,618           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,619           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,619           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,620           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,621           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,623           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-01-24T00:03:03,623           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-01-24T00:03:03,624           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,624           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,625           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,626           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,626           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,628           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,628                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,628                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,629                 directory, all directories are treated like packages.
2024-01-24T00:03:03,629           ********************************************************************************

2024-01-24T00:03:03,630   !!
2024-01-24T00:03:03,630     check.warn(importable)
2024-01-24T00:03:03,631   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-01-24T00:03:03,631   !!

2024-01-24T00:03:03,632           ********************************************************************************
2024-01-24T00:03:03,633           ############################
2024-01-24T00:03:03,633           # Package would be ignored #
2024-01-24T00:03:03,633           ############################
2024-01-24T00:03:03,634           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-01-24T00:03:03,634           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,635           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,635           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-01-24T00:03:03,636           to the `packages` configuration field.

2024-01-24T00:03:03,637           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,637           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,638           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,639           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,639           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,641           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-01-24T00:03:03,641           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-01-24T00:03:03,642           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,642           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,643           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,644           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,645           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,647           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,647                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,648                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,648                 directory, all directories are treated like packages.
2024-01-24T00:03:03,649           ********************************************************************************

2024-01-24T00:03:03,650   !!
2024-01-24T00:03:03,650     check.warn(importable)
2024-01-24T00:03:03,651   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-01-24T00:03:03,651   !!

2024-01-24T00:03:03,653           ********************************************************************************
2024-01-24T00:03:03,653           ############################
2024-01-24T00:03:03,654           # Package would be ignored #
2024-01-24T00:03:03,654           ############################
2024-01-24T00:03:03,654           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-01-24T00:03:03,655           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,656           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,656           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-01-24T00:03:03,657           to the `packages` configuration field.

2024-01-24T00:03:03,657           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,658           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,658           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,659           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,660           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,661           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-01-24T00:03:03,662           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-01-24T00:03:03,663           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,663           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,664           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,665           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,666           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,667           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,668                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,668                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,669                 directory, all directories are treated like packages.
2024-01-24T00:03:03,669           ********************************************************************************

2024-01-24T00:03:03,670   !!
2024-01-24T00:03:03,671     check.warn(importable)
2024-01-24T00:03:03,671   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-01-24T00:03:03,672   !!

2024-01-24T00:03:03,673           ********************************************************************************
2024-01-24T00:03:03,673           ############################
2024-01-24T00:03:03,674           # Package would be ignored #
2024-01-24T00:03:03,674           ############################
2024-01-24T00:03:03,675           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-01-24T00:03:03,675           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,676           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,677           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-01-24T00:03:03,677           to the `packages` configuration field.

2024-01-24T00:03:03,678           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,679           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,679           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,680           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,682           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,682           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-01-24T00:03:03,683           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-01-24T00:03:03,683           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,684           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,684           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,685           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,686           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,687           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,687                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,688                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,688                 directory, all directories are treated like packages.
2024-01-24T00:03:03,689           ********************************************************************************

2024-01-24T00:03:03,689   !!
2024-01-24T00:03:03,690     check.warn(importable)
2024-01-24T00:03:03,690   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-01-24T00:03:03,691   !!

2024-01-24T00:03:03,692           ********************************************************************************
2024-01-24T00:03:03,692           ############################
2024-01-24T00:03:03,693           # Package would be ignored #
2024-01-24T00:03:03,693           ############################
2024-01-24T00:03:03,694           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-01-24T00:03:03,694           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,695           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,695           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-01-24T00:03:03,696           to the `packages` configuration field.

2024-01-24T00:03:03,697           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,697           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,698           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,699           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,700           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,701           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-01-24T00:03:03,702           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-01-24T00:03:03,702           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,703           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,703           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,704           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,705           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,707           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,708                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,708                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,709                 directory, all directories are treated like packages.
2024-01-24T00:03:03,709           ********************************************************************************

2024-01-24T00:03:03,711   !!
2024-01-24T00:03:03,711     check.warn(importable)
2024-01-24T00:03:03,712   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-01-24T00:03:03,712   !!

2024-01-24T00:03:03,713           ********************************************************************************
2024-01-24T00:03:03,713           ############################
2024-01-24T00:03:03,713           # Package would be ignored #
2024-01-24T00:03:03,714           ############################
2024-01-24T00:03:03,714           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-01-24T00:03:03,715           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,715           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,716           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-01-24T00:03:03,716           to the `packages` configuration field.

2024-01-24T00:03:03,717           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,718           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,718           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,719           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,720           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,721           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-01-24T00:03:03,722           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-01-24T00:03:03,722           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,722           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,723           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,724           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,725           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,727           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,727                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,728                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,728                 directory, all directories are treated like packages.
2024-01-24T00:03:03,729           ********************************************************************************

2024-01-24T00:03:03,730   !!
2024-01-24T00:03:03,730     check.warn(importable)
2024-01-24T00:03:03,731   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-01-24T00:03:03,731   !!

2024-01-24T00:03:03,733           ********************************************************************************
2024-01-24T00:03:03,733           ############################
2024-01-24T00:03:03,734           # Package would be ignored #
2024-01-24T00:03:03,734           ############################
2024-01-24T00:03:03,735           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-01-24T00:03:03,735           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,737           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,738           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-01-24T00:03:03,738           to the `packages` configuration field.

2024-01-24T00:03:03,739           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,740           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,740           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,741           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,742           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,743           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-01-24T00:03:03,743           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-01-24T00:03:03,744           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,744           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,745           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,746           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,746           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,748           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,748                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,749                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,749                 directory, all directories are treated like packages.
2024-01-24T00:03:03,749           ********************************************************************************

2024-01-24T00:03:03,750   !!
2024-01-24T00:03:03,751     check.warn(importable)
2024-01-24T00:03:03,751   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-01-24T00:03:03,752   !!

2024-01-24T00:03:03,753           ********************************************************************************
2024-01-24T00:03:03,753           ############################
2024-01-24T00:03:03,754           # Package would be ignored #
2024-01-24T00:03:03,754           ############################
2024-01-24T00:03:03,755           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-01-24T00:03:03,755           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,756           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,757           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-01-24T00:03:03,757           to the `packages` configuration field.

2024-01-24T00:03:03,758           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,759           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,759           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,760           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,761           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,762           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-01-24T00:03:03,763           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-01-24T00:03:03,763           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,764           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,764           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,765           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,767           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,768           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,768                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,768                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,769                 directory, all directories are treated like packages.
2024-01-24T00:03:03,769           ********************************************************************************

2024-01-24T00:03:03,770   !!
2024-01-24T00:03:03,771     check.warn(importable)
2024-01-24T00:03:03,771   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-01-24T00:03:03,772   !!

2024-01-24T00:03:03,773           ********************************************************************************
2024-01-24T00:03:03,773           ############################
2024-01-24T00:03:03,773           # Package would be ignored #
2024-01-24T00:03:03,774           ############################
2024-01-24T00:03:03,774           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-01-24T00:03:03,775           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,776           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,776           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-01-24T00:03:03,777           to the `packages` configuration field.

2024-01-24T00:03:03,778           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,778           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,779           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,780           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,781           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,782           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-01-24T00:03:03,783           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-01-24T00:03:03,783           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,784           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,784           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,785           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,786           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,788           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,788                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,789                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,789                 directory, all directories are treated like packages.
2024-01-24T00:03:03,790           ********************************************************************************

2024-01-24T00:03:03,791   !!
2024-01-24T00:03:03,791     check.warn(importable)
2024-01-24T00:03:03,792   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-01-24T00:03:03,792   !!

2024-01-24T00:03:03,794           ********************************************************************************
2024-01-24T00:03:03,794           ############################
2024-01-24T00:03:03,795           # Package would be ignored #
2024-01-24T00:03:03,795           ############################
2024-01-24T00:03:03,795           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-01-24T00:03:03,796           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,797           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,797           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-01-24T00:03:03,798           to the `packages` configuration field.

2024-01-24T00:03:03,798           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,799           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,799           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,801           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,801           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,802           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-01-24T00:03:03,803           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-01-24T00:03:03,803           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,804           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,804           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,805           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,806           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,808           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,808                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,808                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,809                 directory, all directories are treated like packages.
2024-01-24T00:03:03,809           ********************************************************************************

2024-01-24T00:03:03,810   !!
2024-01-24T00:03:03,811     check.warn(importable)
2024-01-24T00:03:03,812   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-01-24T00:03:03,812   !!

2024-01-24T00:03:03,813           ********************************************************************************
2024-01-24T00:03:03,814           ############################
2024-01-24T00:03:03,814           # Package would be ignored #
2024-01-24T00:03:03,815           ############################
2024-01-24T00:03:03,815           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-01-24T00:03:03,816           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,817           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,817           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-01-24T00:03:03,817           to the `packages` configuration field.

2024-01-24T00:03:03,818           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,819           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,819           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,821           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,821           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,823           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-01-24T00:03:03,823           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-01-24T00:03:03,824           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,824           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,824           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,825           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,826           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,827           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,828                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,828                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,829                 directory, all directories are treated like packages.
2024-01-24T00:03:03,829           ********************************************************************************

2024-01-24T00:03:03,830   !!
2024-01-24T00:03:03,831     check.warn(importable)
2024-01-24T00:03:03,831   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-01-24T00:03:03,831   !!

2024-01-24T00:03:03,832           ********************************************************************************
2024-01-24T00:03:03,833           ############################
2024-01-24T00:03:03,833           # Package would be ignored #
2024-01-24T00:03:03,834           ############################
2024-01-24T00:03:03,834           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-01-24T00:03:03,835           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,836           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,836           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-01-24T00:03:03,836           to the `packages` configuration field.

2024-01-24T00:03:03,837           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,838           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,838           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,839           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,840           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,841           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-01-24T00:03:03,842           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-01-24T00:03:03,842           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,843           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,843           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,844           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,845           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,847           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,848                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,848                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,849                 directory, all directories are treated like packages.
2024-01-24T00:03:03,849           ********************************************************************************

2024-01-24T00:03:03,850   !!
2024-01-24T00:03:03,851     check.warn(importable)
2024-01-24T00:03:03,851   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-01-24T00:03:03,851   !!

2024-01-24T00:03:03,852           ********************************************************************************
2024-01-24T00:03:03,853           ############################
2024-01-24T00:03:03,853           # Package would be ignored #
2024-01-24T00:03:03,853           ############################
2024-01-24T00:03:03,854           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-01-24T00:03:03,854           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,855           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,856           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-01-24T00:03:03,856           to the `packages` configuration field.

2024-01-24T00:03:03,857           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,858           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,858           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,859           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,860           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,861           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-01-24T00:03:03,861           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-01-24T00:03:03,862           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,862           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,863           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,864           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,865           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,866           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,867                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,867                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,868                 directory, all directories are treated like packages.
2024-01-24T00:03:03,868           ********************************************************************************

2024-01-24T00:03:03,869   !!
2024-01-24T00:03:03,870     check.warn(importable)
2024-01-24T00:03:03,870   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-01-24T00:03:03,871   !!

2024-01-24T00:03:03,872           ********************************************************************************
2024-01-24T00:03:03,872           ############################
2024-01-24T00:03:03,873           # Package would be ignored #
2024-01-24T00:03:03,873           ############################
2024-01-24T00:03:03,874           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-01-24T00:03:03,874           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,875           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,876           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-01-24T00:03:03,876           to the `packages` configuration field.

2024-01-24T00:03:03,878           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,878           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,879           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,880           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,881           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,882           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-01-24T00:03:03,882           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-01-24T00:03:03,883           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,883           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,884           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,884           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,886           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,887           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,887                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,888                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,888                 directory, all directories are treated like packages.
2024-01-24T00:03:03,889           ********************************************************************************

2024-01-24T00:03:03,890   !!
2024-01-24T00:03:03,890     check.warn(importable)
2024-01-24T00:03:03,891   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-01-24T00:03:03,891   !!

2024-01-24T00:03:03,892           ********************************************************************************
2024-01-24T00:03:03,893           ############################
2024-01-24T00:03:03,893           # Package would be ignored #
2024-01-24T00:03:03,894           ############################
2024-01-24T00:03:03,894           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-01-24T00:03:03,894           but it is absent from setuptools' `packages` configuration.

2024-01-24T00:03:03,895           This leads to an ambiguous overall configuration. If you want to distribute this
2024-01-24T00:03:03,896           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-01-24T00:03:03,896           to the `packages` configuration field.

2024-01-24T00:03:03,897           Alternatively, you can also rely on setuptools' discovery methods
2024-01-24T00:03:03,898           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-01-24T00:03:03,898           instead of `find_packages(...)`/`find:`).

2024-01-24T00:03:03,899           You can read more about "package discovery" on setuptools documentation page:

2024-01-24T00:03:03,900           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-01-24T00:03:03,901           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-01-24T00:03:03,902           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-01-24T00:03:03,902           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-01-24T00:03:03,903           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-01-24T00:03:03,903           combination with a more fine grained `package-data` configuration.

2024-01-24T00:03:03,904           You can read more about "package data files" on setuptools documentation page:

2024-01-24T00:03:03,905           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-01-24T00:03:03,907           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-01-24T00:03:03,907                 even if it does not contain any `.py` files.
2024-01-24T00:03:03,908                 On the other hand, currently there is no concept of package data
2024-01-24T00:03:03,908                 directory, all directories are treated like packages.
2024-01-24T00:03:03,909           ********************************************************************************

2024-01-24T00:03:03,909   !!
2024-01-24T00:03:03,910     check.warn(importable)
2024-01-24T00:03:03,910   creating build/lib/deepspeed/autotuning/config_templates
2024-01-24T00:03:03,911   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-01-24T00:03:03,911   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-01-24T00:03:03,911   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-01-24T00:03:03,912   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-01-24T00:03:03,912   creating build/lib/deepspeed/ops/csrc
2024-01-24T00:03:03,913   creating build/lib/deepspeed/ops/csrc/adagrad
2024-01-24T00:03:03,913   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-01-24T00:03:03,914   creating build/lib/deepspeed/ops/csrc/adam
2024-01-24T00:03:03,914   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-01-24T00:03:03,915   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-01-24T00:03:03,915   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-01-24T00:03:03,915   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-01-24T00:03:03,916   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-01-24T00:03:03,917   creating build/lib/deepspeed/ops/csrc/aio
2024-01-24T00:03:03,917   creating build/lib/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:03,918   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:03,918   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:03,918   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:03,919   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:03,919   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:03,920   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:03,920   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,921   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,921   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,922   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,923   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,923   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,924   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,924   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,925   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,926   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,926   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,927   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:03,927   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-01-24T00:03:03,927   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-01-24T00:03:03,928   creating build/lib/deepspeed/ops/csrc/common
2024-01-24T00:03:03,928   copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common
2024-01-24T00:03:03,929   creating build/lib/deepspeed/ops/csrc/cpu
2024-01-24T00:03:03,929   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-01-24T00:03:03,930   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-01-24T00:03:03,930   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-01-24T00:03:03,930   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-01-24T00:03:03,931   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-01-24T00:03:03,931   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-01-24T00:03:03,932   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-01-24T00:03:03,932   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:03,933   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:03,933   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:03,934   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:03,935   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:03,935   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:03,935   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:03,936   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-01-24T00:03:03,936   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-01-24T00:03:03,937   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-01-24T00:03:03,938   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-01-24T00:03:03,938   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-01-24T00:03:03,939   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:03,939   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:03,940   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:03,940   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:03,941   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:03,941   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:03,942   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:03,942   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:03,943   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:03,943   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:03,944   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:03,944   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:03,945   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:03,945   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:03,945   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:03,946   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:03,946   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-01-24T00:03:03,947   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-01-24T00:03:03,947   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-01-24T00:03:03,948   creating build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,949   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,949   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,950   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,950   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,951   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,951   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,951   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,952   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,953   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,953   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,954   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,954   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,955   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,955   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,955   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,956   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,956   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,957   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,957   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,958   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,958   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,959   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,959   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,960   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,961   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,961   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,962   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,963   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,963   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-01-24T00:03:03,964   creating build/lib/deepspeed/ops/csrc/lamb
2024-01-24T00:03:03,965   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-01-24T00:03:03,966   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-01-24T00:03:03,966   creating build/lib/deepspeed/ops/csrc/lion
2024-01-24T00:03:03,967   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-01-24T00:03:03,968   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-01-24T00:03:03,968   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-01-24T00:03:03,969   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-01-24T00:03:03,970   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-01-24T00:03:03,970   creating build/lib/deepspeed/ops/csrc/quantization
2024-01-24T00:03:03,971   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-01-24T00:03:03,972   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-01-24T00:03:03,973   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-01-24T00:03:03,973   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-01-24T00:03:03,974   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-01-24T00:03:03,975   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-01-24T00:03:03,976   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-01-24T00:03:03,976   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-01-24T00:03:03,977   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-01-24T00:03:03,978   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-01-24T00:03:03,979   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-01-24T00:03:03,979   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-01-24T00:03:03,980   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-01-24T00:03:03,980   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-01-24T00:03:03,981   creating build/lib/deepspeed/ops/csrc/spatial
2024-01-24T00:03:03,982   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-01-24T00:03:03,983   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-01-24T00:03:03,983   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-01-24T00:03:03,984   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-01-24T00:03:03,985   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-01-24T00:03:03,985   creating build/lib/deepspeed/ops/csrc/transformer
2024-01-24T00:03:03,986   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-01-24T00:03:03,986   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-01-24T00:03:03,987   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-01-24T00:03:03,988   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-01-24T00:03:03,989   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-01-24T00:03:03,992   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-01-24T00:03:03,997   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-01-24T00:03:04,002   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-01-24T00:03:04,005   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-01-24T00:03:04,006   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,007   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,011   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,014   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,017   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,021   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,024   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,029   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,032   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,036   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,040   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:04,044   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-01-24T00:03:04,045   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-01-24T00:03:04,048   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-01-24T00:03:04,052   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-01-24T00:03:04,055   creating build/lib/deepspeed/ops/csrc/utils
2024-01-24T00:03:04,056   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-01-24T00:03:04,059   creating build/lib/deepspeed/ops/csrc/xpu
2024-01-24T00:03:04,059   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-01-24T00:03:04,060   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-01-24T00:03:04,064   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-01-24T00:03:04,065   copying deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-01-24T00:03:04,067   copying deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-01-24T00:03:04,069   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-01-24T00:03:04,071   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-01-24T00:03:04,074   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-01-24T00:03:04,075   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-01-24T00:03:04,077   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:04,078   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:04,081   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:04,083   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:04,086   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:04,088   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:04,091   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:04,092   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:04,095   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:04,097   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:04,100   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:04,103   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:04,106   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-01-24T00:03:04,107   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-01-24T00:03:04,110   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-01-24T00:03:04,112   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-01-24T00:03:04,113   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-01-24T00:03:04,115   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-01-24T00:03:04,118   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-01-24T00:03:04,119   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-01-24T00:03:04,121   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-01-24T00:03:04,122   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-01-24T00:03:04,124   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-01-24T00:03:04,126   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-01-24T00:03:04,129   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-01-24T00:03:04,131   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-01-24T00:03:04,133   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-01-24T00:03:04,134   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-01-24T00:03:04,135   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:04,138   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:04,140   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:04,142   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:04,145   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:04,147   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:04,149   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:04,151   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:04,153   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:04,155   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:04,158   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:04,160   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:04,162   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:04,165   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:04,168   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:04,170   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:04,173   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:04,175   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:04,177   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:04,179   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:04,181   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:04,183   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:04,186   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:04,188   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:04,190   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-01-24T00:03:04,192   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-01-24T00:03:04,194   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:04,197   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:04,199   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:04,201   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:04,204   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:03:04,206   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:03:04,208   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:03:04,210   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-01-24T00:03:04,213   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-01-24T00:03:04,216   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:03:04,218   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:03:04,220   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:03:04,223   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:04,225   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:04,228   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:04,230   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:04,233   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:04,235   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:04,237   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:03:04,240   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:03:04,242   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:03:04,244   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:03:04,247   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:03:04,249   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:03:04,251   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-01-24T00:03:04,254   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-01-24T00:03:04,256   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-01-24T00:03:04,305   running build_scripts
2024-01-24T00:03:04,306   creating build/scripts-3.11
2024-01-24T00:03:04,307   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-01-24T00:03:04,308   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-01-24T00:03:04,310   copying and adjusting bin/ds -> build/scripts-3.11
2024-01-24T00:03:04,312   copying bin/ds_ssh -> build/scripts-3.11
2024-01-24T00:03:04,314   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-01-24T00:03:04,315   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-01-24T00:03:04,316   copying and adjusting bin/dsr -> build/scripts-3.11
2024-01-24T00:03:04,318   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-01-24T00:03:04,319   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-01-24T00:03:04,320   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-01-24T00:03:04,321   changing mode of build/scripts-3.11/ds from 644 to 755
2024-01-24T00:03:04,321   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-01-24T00:03:04,322   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-01-24T00:03:04,322   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-01-24T00:03:04,323   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-01-24T00:03:04,347   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-01-24T00:03:04,348   !!

2024-01-24T00:03:04,349           ********************************************************************************
2024-01-24T00:03:04,350           Please avoid running ``setup.py`` directly.
2024-01-24T00:03:04,350           Instead, use pypa/build, pypa/installer or other
2024-01-24T00:03:04,350           standards-based tools.

2024-01-24T00:03:04,351           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-01-24T00:03:04,352           ********************************************************************************

2024-01-24T00:03:04,353   !!
2024-01-24T00:03:04,353     self.initialize_options()
2024-01-24T00:03:04,373   installing to build/bdist.linux-armv7l/wheel
2024-01-24T00:03:04,373   running install
2024-01-24T00:03:04,397   running install_lib
2024-01-24T00:03:04,422   creating build/bdist.linux-armv7l
2024-01-24T00:03:04,422   creating build/bdist.linux-armv7l/wheel
2024-01-24T00:03:04,424   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-01-24T00:03:04,425   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-01-24T00:03:04,427   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-01-24T00:03:04,428   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-01-24T00:03:04,430   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-01-24T00:03:04,432   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,433   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,435   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,437   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,439   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,441   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,442   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,444   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,446   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,448   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,450   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-01-24T00:03:04,453   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-01-24T00:03:04,454   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-01-24T00:03:04,456   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-01-24T00:03:04,458   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-01-24T00:03:04,460   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-01-24T00:03:04,462   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-01-24T00:03:04,464   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-01-24T00:03:04,465   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-01-24T00:03:04,467   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-01-24T00:03:04,468   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-01-24T00:03:04,470   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-01-24T00:03:04,472   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-01-24T00:03:04,474   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-01-24T00:03:04,476   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-01-24T00:03:04,477   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-01-24T00:03:04,479   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-01-24T00:03:04,481   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-01-24T00:03:04,483   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-01-24T00:03:04,484   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-01-24T00:03:04,487   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-01-24T00:03:04,489   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-01-24T00:03:04,492   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-01-24T00:03:04,494   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-01-24T00:03:04,497   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-01-24T00:03:04,499   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-01-24T00:03:04,500   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-01-24T00:03:04,502   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-01-24T00:03:04,503   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-01-24T00:03:04,507   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-01-24T00:03:04,509   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-01-24T00:03:04,511   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-01-24T00:03:04,513   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-01-24T00:03:04,515   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-01-24T00:03:04,516   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-01-24T00:03:04,518   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-01-24T00:03:04,520   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-01-24T00:03:04,522   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-01-24T00:03:04,525   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-01-24T00:03:04,526   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-01-24T00:03:04,530   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,531   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,534   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,534   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,537   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,539   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,542   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,545   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,547   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,550   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,552   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,556   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,559   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,561   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,565   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,569   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,571   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,573   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,575   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-01-24T00:03:04,576   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,579   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,581   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,585   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,587   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-01-24T00:03:04,588   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-01-24T00:03:04,591   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-01-24T00:03:04,594   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-01-24T00:03:04,597   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-01-24T00:03:04,599   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-01-24T00:03:04,601   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-01-24T00:03:04,603   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-01-24T00:03:04,605   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-01-24T00:03:04,608   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-01-24T00:03:04,611   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-01-24T00:03:04,611   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-01-24T00:03:04,614   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-01-24T00:03:04,616   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:03:04,617   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:03:04,620   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:03:04,623   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:03:04,625   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:03:04,627   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-01-24T00:03:04,629   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-01-24T00:03:04,632   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:03:04,633   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:03:04,635   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:03:04,637   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:03:04,639   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:03:04,641   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-01-24T00:03:04,643   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-01-24T00:03:04,645   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,647   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,649   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,652   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-01-24T00:03:04,653   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-01-24T00:03:04,654   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-01-24T00:03:04,656   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-01-24T00:03:04,657   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-01-24T00:03:04,659   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-01-24T00:03:04,662   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-01-24T00:03:04,664   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-01-24T00:03:04,667   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-01-24T00:03:04,670   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-01-24T00:03:04,672   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-01-24T00:03:04,672   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-01-24T00:03:04,675   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-01-24T00:03:04,677   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-01-24T00:03:04,680   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-01-24T00:03:04,681   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-01-24T00:03:04,684   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-01-24T00:03:04,686   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-01-24T00:03:04,689   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-01-24T00:03:04,690   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-01-24T00:03:04,693   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-01-24T00:03:04,693   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-01-24T00:03:04,696   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-01-24T00:03:04,698   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-01-24T00:03:04,700   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,702   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,705   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,708   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,712   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,715   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,718   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-01-24T00:03:04,719   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-01-24T00:03:04,721   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-01-24T00:03:04,723   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-01-24T00:03:04,725   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-01-24T00:03:04,726   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,728   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-01-24T00:03:04,731   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-01-24T00:03:04,732   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-01-24T00:03:04,734   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-01-24T00:03:04,737   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-01-24T00:03:04,739   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-01-24T00:03:04,741   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-01-24T00:03:04,743   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-01-24T00:03:04,745   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-01-24T00:03:04,746   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-01-24T00:03:04,748   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-01-24T00:03:04,750   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-01-24T00:03:04,752   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-01-24T00:03:04,753   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-01-24T00:03:04,755   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-01-24T00:03:04,758   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-01-24T00:03:04,760   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-01-24T00:03:04,762   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-01-24T00:03:04,765   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-01-24T00:03:04,767   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-01-24T00:03:04,770   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-01-24T00:03:04,772   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-01-24T00:03:04,773   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-01-24T00:03:04,776   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-01-24T00:03:04,777   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-01-24T00:03:04,780   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-01-24T00:03:04,783   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-01-24T00:03:04,785   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-01-24T00:03:04,787   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-01-24T00:03:04,789   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,790   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,792   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,794   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,797   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,799   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,801   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,803   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,805   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,806   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,809   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,811   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,813   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,815   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,817   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,819   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-01-24T00:03:04,821   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,822   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,824   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,826   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,829   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,831   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,833   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,835   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,837   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,839   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,841   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-01-24T00:03:04,843   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-01-24T00:03:04,844   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-01-24T00:03:04,847   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-01-24T00:03:04,848   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-01-24T00:03:04,851   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-01-24T00:03:04,853   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-01-24T00:03:04,855   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-01-24T00:03:04,857   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-01-24T00:03:04,859   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-01-24T00:03:04,861   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-01-24T00:03:04,862   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-01-24T00:03:04,864   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-01-24T00:03:04,867   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-01-24T00:03:04,869   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-01-24T00:03:04,872   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:03:04,873   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:03:04,875   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:03:04,878   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:03:04,880   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:03:04,882   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:03:04,884   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:03:04,886   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:03:04,888   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:03:04,890   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-01-24T00:03:04,892   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-01-24T00:03:04,893   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-01-24T00:03:04,895   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-01-24T00:03:04,897   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-01-24T00:03:04,900   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-01-24T00:03:04,901   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-01-24T00:03:04,904   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-01-24T00:03:04,905   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-01-24T00:03:04,907   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-01-24T00:03:04,909   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-01-24T00:03:04,911   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-01-24T00:03:04,913   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-01-24T00:03:04,914   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-01-24T00:03:04,916   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-01-24T00:03:04,918   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-01-24T00:03:04,921   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-01-24T00:03:04,923   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-01-24T00:03:04,924   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-01-24T00:03:04,926   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-01-24T00:03:04,928   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-01-24T00:03:04,930   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-01-24T00:03:04,932   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-01-24T00:03:04,934   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-01-24T00:03:04,935   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-01-24T00:03:04,937   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-01-24T00:03:04,939   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-01-24T00:03:04,942   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-01-24T00:03:04,944   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-01-24T00:03:04,945   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-01-24T00:03:04,946   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-01-24T00:03:04,948   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-01-24T00:03:04,950   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-01-24T00:03:04,953   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:03:04,954   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:03:04,956   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:03:04,957   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:03:04,959   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:03:04,961   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:03:04,963   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:03:04,965   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:03:04,967   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:03:04,969   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-01-24T00:03:04,971   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-01-24T00:03:04,973   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-01-24T00:03:04,974   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-01-24T00:03:04,976   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-01-24T00:03:04,978   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-01-24T00:03:04,980   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-01-24T00:03:04,982   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-01-24T00:03:04,984   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-01-24T00:03:04,986   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-01-24T00:03:04,988   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-01-24T00:03:04,990   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-01-24T00:03:04,991   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:04,993   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:04,994   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:04,997   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:05,000   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:05,002   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-01-24T00:03:05,005   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-01-24T00:03:05,006   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-01-24T00:03:05,007   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-01-24T00:03:05,009   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:05,010   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:05,012   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:05,015   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:05,017   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:05,019   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:05,021   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-01-24T00:03:05,024   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:05,025   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:05,027   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:05,029   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:05,030   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:05,032   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:05,034   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-01-24T00:03:05,036   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:05,037   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:05,039   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:05,040   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:05,042   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:05,044   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:05,046   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-01-24T00:03:05,048   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:05,049   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:05,051   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:05,054   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:05,056   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:05,058   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:05,060   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:05,062   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:05,064   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-01-24T00:03:05,066   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:05,067   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:05,069   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:05,071   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:05,076   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:05,078   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:05,080   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-01-24T00:03:05,081   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-01-24T00:03:05,083   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:05,084   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:05,086   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:05,088   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:05,090   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:05,092   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:05,094   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-01-24T00:03:05,096   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-01-24T00:03:05,097   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-01-24T00:03:05,099   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-01-24T00:03:05,101   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-01-24T00:03:05,103   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-01-24T00:03:05,105   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-01-24T00:03:05,106   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-01-24T00:03:05,108   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-01-24T00:03:05,110   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-01-24T00:03:05,112   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:05,113   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:05,114   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:05,116   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:05,118   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:05,120   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:05,122   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-01-24T00:03:05,124   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-01-24T00:03:05,126   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-01-24T00:03:05,127   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-01-24T00:03:05,130   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-01-24T00:03:05,131   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:03:05,132   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:03:05,134   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:03:05,136   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:03:05,138   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:03:05,140   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-01-24T00:03:05,142   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-01-24T00:03:05,143   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-01-24T00:03:05,145   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-01-24T00:03:05,147   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-01-24T00:03:05,149   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-01-24T00:03:05,152   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:03:05,153   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:03:05,155   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:03:05,157   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:03:05,158   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:03:05,160   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-01-24T00:03:05,162   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-01-24T00:03:05,164   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:05,165   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:05,167   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:05,169   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:05,170   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:05,172   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:05,174   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:05,177   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:05,179   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-01-24T00:03:05,181   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-01-24T00:03:05,183   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:05,184   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:05,186   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:05,187   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:05,190   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:05,191   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:05,193   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:05,195   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-01-24T00:03:05,197   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-01-24T00:03:05,199   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-01-24T00:03:05,200   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-01-24T00:03:05,202   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:03:05,203   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:03:05,205   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:03:05,207   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:03:05,208   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:03:05,211   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:03:05,212   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-01-24T00:03:05,215   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:03:05,216   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:03:05,218   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:03:05,220   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:03:05,222   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:03:05,224   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-01-24T00:03:05,225   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-01-24T00:03:05,227   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-01-24T00:03:05,229   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-01-24T00:03:05,231   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-01-24T00:03:05,232   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-01-24T00:03:05,233   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-01-24T00:03:05,236   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-01-24T00:03:05,236   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-01-24T00:03:05,238   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-01-24T00:03:05,240   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-01-24T00:03:05,242   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-01-24T00:03:05,244   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-01-24T00:03:05,246   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-01-24T00:03:05,248   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-01-24T00:03:05,251   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-01-24T00:03:05,253   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-01-24T00:03:05,255   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-01-24T00:03:05,256   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-01-24T00:03:05,258   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-01-24T00:03:05,260   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-01-24T00:03:05,262   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-01-24T00:03:05,263   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-01-24T00:03:05,266   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-01-24T00:03:05,267   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-01-24T00:03:05,269   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-01-24T00:03:05,271   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-01-24T00:03:05,272   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-01-24T00:03:05,274   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-01-24T00:03:05,276   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-01-24T00:03:05,278   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-01-24T00:03:05,279   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-01-24T00:03:05,281   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-01-24T00:03:05,283   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-01-24T00:03:05,286   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-01-24T00:03:05,287   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-01-24T00:03:05,288   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-01-24T00:03:05,290   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-01-24T00:03:05,292   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-01-24T00:03:05,293   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-01-24T00:03:05,296   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-01-24T00:03:05,298   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-01-24T00:03:05,299   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-01-24T00:03:05,301   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-01-24T00:03:05,303   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-01-24T00:03:05,304   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-01-24T00:03:05,306   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-01-24T00:03:05,308   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-01-24T00:03:05,310   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-01-24T00:03:05,311   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-01-24T00:03:05,313   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-01-24T00:03:05,315   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-01-24T00:03:05,316   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-01-24T00:03:05,318   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-01-24T00:03:05,320   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-01-24T00:03:05,322   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-01-24T00:03:05,323   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-01-24T00:03:05,325   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-01-24T00:03:05,327   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-01-24T00:03:05,329   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:03:05,330   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:03:05,332   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:03:05,334   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:03:05,336   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:03:05,337   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:03:05,339   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:03:05,341   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:03:05,343   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-01-24T00:03:05,345   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-01-24T00:03:05,347   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-01-24T00:03:05,348   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-01-24T00:03:05,350   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-01-24T00:03:05,352   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-01-24T00:03:05,355   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-01-24T00:03:05,357   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-01-24T00:03:05,358   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-01-24T00:03:05,360   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-01-24T00:03:05,362   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-01-24T00:03:05,364   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-01-24T00:03:05,365   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-01-24T00:03:05,367   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-01-24T00:03:05,369   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-01-24T00:03:05,370   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-01-24T00:03:05,373   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-01-24T00:03:05,373   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-01-24T00:03:05,375   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-01-24T00:03:05,378   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-01-24T00:03:05,379   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-01-24T00:03:05,381   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,382   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,384   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,386   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,388   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,390   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,392   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,395   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,397   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,399   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,401   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,403   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,406   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,407   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,409   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,412   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,414   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,416   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,418   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,420   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,422   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,424   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,426   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,429   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,431   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,433   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,435   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,437   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,439   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,441   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-01-24T00:03:05,443   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-01-24T00:03:05,445   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:05,446   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:05,450   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:05,452   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:05,455   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-01-24T00:03:05,456   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-01-24T00:03:05,458   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-01-24T00:03:05,461   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-01-24T00:03:05,462   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-01-24T00:03:05,464   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-01-24T00:03:05,467   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-01-24T00:03:05,469   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-01-24T00:03:05,473   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:05,475   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:05,478   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:05,483   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:05,486   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:05,491   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:05,494   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:05,497   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-01-24T00:03:05,499   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:05,503   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:05,506   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:05,507   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:05,510   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:05,514   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:05,519   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:05,522   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:05,525   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:05,528   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-01-24T00:03:05,531   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-01-24T00:03:05,535   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-01-24T00:03:05,536   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-01-24T00:03:05,539   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-01-24T00:03:05,542   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-01-24T00:03:05,543   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-01-24T00:03:05,546   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-01-24T00:03:05,547   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-01-24T00:03:05,550   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-01-24T00:03:05,551   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-01-24T00:03:05,555   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-01-24T00:03:05,557   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-01-24T00:03:05,561   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-01-24T00:03:05,564   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-01-24T00:03:05,567   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-01-24T00:03:05,571   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-01-24T00:03:05,574   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-01-24T00:03:05,575   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-01-24T00:03:05,576   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-01-24T00:03:05,579   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-01-24T00:03:05,581   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-01-24T00:03:05,584   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,585   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,587   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,589   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,592   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,596   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,599   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,601   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,604   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,607   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,609   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-01-24T00:03:05,611   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-01-24T00:03:05,614   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-01-24T00:03:05,618   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-01-24T00:03:05,620   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-01-24T00:03:05,621   copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-01-24T00:03:05,624   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-01-24T00:03:05,625   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-01-24T00:03:05,626   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-01-24T00:03:05,628   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-01-24T00:03:05,629   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-01-24T00:03:05,631   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-01-24T00:03:05,633   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-01-24T00:03:05,634   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-01-24T00:03:05,637   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-01-24T00:03:05,638   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-01-24T00:03:05,640   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-01-24T00:03:05,642   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-01-24T00:03:05,644   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-01-24T00:03:05,646   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-01-24T00:03:05,649   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-01-24T00:03:05,650   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-01-24T00:03:05,652   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-01-24T00:03:05,655   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-01-24T00:03:05,656   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:05,657   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:05,659   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:05,662   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:05,664   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:05,666   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:05,668   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-01-24T00:03:05,671   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-01-24T00:03:05,672   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-01-24T00:03:05,675   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,675   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,678   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,680   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,682   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,684   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,686   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,688   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,690   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,692   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,694   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,696   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-01-24T00:03:05,698   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-01-24T00:03:05,699   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-01-24T00:03:05,702   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-01-24T00:03:05,702   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-01-24T00:03:05,705   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-01-24T00:03:05,707   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-01-24T00:03:05,709   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-01-24T00:03:05,712   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-01-24T00:03:05,713   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-01-24T00:03:05,715   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-01-24T00:03:05,718   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-01-24T00:03:05,721   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-01-24T00:03:05,724   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-01-24T00:03:05,726   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-01-24T00:03:05,728   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-01-24T00:03:05,731   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-01-24T00:03:05,732   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:05,733   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:05,735   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:05,737   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:05,739   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:05,742   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-01-24T00:03:05,744   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-01-24T00:03:05,745   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-01-24T00:03:05,748   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-01-24T00:03:05,749   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-01-24T00:03:05,751   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-01-24T00:03:05,752   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-01-24T00:03:05,754   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-01-24T00:03:05,756   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-01-24T00:03:05,758   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-01-24T00:03:05,761   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-01-24T00:03:05,762   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-01-24T00:03:05,764   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-01-24T00:03:05,766   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-01-24T00:03:05,768   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-01-24T00:03:05,770   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-01-24T00:03:05,772   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-01-24T00:03:05,773   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-01-24T00:03:05,776   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-01-24T00:03:05,778   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-01-24T00:03:05,779   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-01-24T00:03:05,781   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-01-24T00:03:05,783   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-01-24T00:03:05,784   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-01-24T00:03:05,788   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,789   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,791   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,793   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,795   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,798   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,799   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,802   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,805   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,806   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,808   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,810   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,812   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,814   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,816   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,818   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,820   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,822   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,825   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-01-24T00:03:05,827   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,828   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,830   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,832   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,835   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,837   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,839   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,841   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,843   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,844   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,846   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-01-24T00:03:05,848   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,850   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,852   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-01-24T00:03:05,854   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-01-24T00:03:05,856   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-01-24T00:03:05,857   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-01-24T00:03:05,860   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-01-24T00:03:05,863   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-01-24T00:03:05,865   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-01-24T00:03:05,867   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-01-24T00:03:05,869   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-01-24T00:03:05,872   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-01-24T00:03:05,873   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-01-24T00:03:05,875   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-01-24T00:03:05,877   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-01-24T00:03:05,879   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-01-24T00:03:05,881   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-01-24T00:03:05,883   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-01-24T00:03:05,884   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-01-24T00:03:05,886   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-01-24T00:03:05,889   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-01-24T00:03:05,890   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-01-24T00:03:05,892   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-01-24T00:03:05,894   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-01-24T00:03:05,896   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-01-24T00:03:05,898   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-01-24T00:03:05,899   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-01-24T00:03:05,902   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-01-24T00:03:05,904   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-01-24T00:03:05,905   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-01-24T00:03:05,907   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-01-24T00:03:05,908   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-01-24T00:03:05,910   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-01-24T00:03:05,912   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,913   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,915   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,917   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,919   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:05,920   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:05,922   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:05,924   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:05,926   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:05,927   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:05,929   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-01-24T00:03:05,931   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,933   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,935   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:05,936   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:05,938   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:05,940   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:05,942   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:05,943   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-01-24T00:03:05,945   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,948   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,949   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,951   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,953   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,955   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,956   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,958   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,960   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,962   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-01-24T00:03:05,963   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-01-24T00:03:05,965   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-01-24T00:03:05,966   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-01-24T00:03:05,968   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-01-24T00:03:05,970   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-01-24T00:03:05,972   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-01-24T00:03:05,973   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-01-24T00:03:05,975   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-01-24T00:03:05,977   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,979   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:05,980   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:05,983   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:05,984   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:05,986   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:05,988   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:05,990   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-01-24T00:03:05,992   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,993   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,995   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,997   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:05,999   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:06,001   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:06,002   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-01-24T00:03:06,004   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-01-24T00:03:06,005   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-01-24T00:03:06,007   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-01-24T00:03:06,009   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-01-24T00:03:06,011   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-01-24T00:03:06,013   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-01-24T00:03:06,015   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-01-24T00:03:06,018   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,018   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,021   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,023   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-01-24T00:03:06,024   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-01-24T00:03:06,026   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-01-24T00:03:06,028   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-01-24T00:03:06,030   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-01-24T00:03:06,032   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-01-24T00:03:06,034   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-01-24T00:03:06,036   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-01-24T00:03:06,038   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,041   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,042   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,044   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,046   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,049   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,051   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,053   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,055   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,057   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,059   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,061   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,063   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,065   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,067   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,069   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,071   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,074   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,076   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-01-24T00:03:06,078   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,081   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,084   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,086   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,089   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,091   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,093   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,096   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,098   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,101   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,103   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,105   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-01-24T00:03:06,108   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-01-24T00:03:06,111   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-01-24T00:03:06,112   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-01-24T00:03:06,115   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-01-24T00:03:06,117   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-01-24T00:03:06,120   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-01-24T00:03:06,122   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-01-24T00:03:06,124   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-01-24T00:03:06,127   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-01-24T00:03:06,129   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-01-24T00:03:06,132   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-01-24T00:03:06,134   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-01-24T00:03:06,135   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-01-24T00:03:06,137   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-01-24T00:03:06,139   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-01-24T00:03:06,141   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-01-24T00:03:06,143   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-01-24T00:03:06,145   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-01-24T00:03:06,147   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-01-24T00:03:06,149   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-01-24T00:03:06,150   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-01-24T00:03:06,152   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-01-24T00:03:06,154   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-01-24T00:03:06,156   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-01-24T00:03:06,158   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-01-24T00:03:06,160   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-01-24T00:03:06,162   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-01-24T00:03:06,164   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-01-24T00:03:06,166   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-01-24T00:03:06,168   running install_egg_info
2024-01-24T00:03:06,198   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.13.1-py3.11.egg-info
2024-01-24T00:03:06,211   running install_scripts
2024-01-24T00:03:06,212   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data
2024-01-24T00:03:06,213   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts
2024-01-24T00:03:06,214   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts
2024-01-24T00:03:06,215   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts
2024-01-24T00:03:06,217   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts
2024-01-24T00:03:06,219   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts
2024-01-24T00:03:06,221   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts
2024-01-24T00:03:06,223   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts
2024-01-24T00:03:06,224   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts
2024-01-24T00:03:06,226   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts
2024-01-24T00:03:06,227   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts/deepspeed.pt to 755
2024-01-24T00:03:06,228   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts/ds_report to 755
2024-01-24T00:03:06,228   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts/ds to 755
2024-01-24T00:03:06,229   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts/ds_bench to 755
2024-01-24T00:03:06,229   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts/ds_elastic to 755
2024-01-24T00:03:06,230   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts/ds_ssh to 755
2024-01-24T00:03:06,230   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts/dsr to 755
2024-01-24T00:03:06,231   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.data/scripts/deepspeed to 755
2024-01-24T00:03:06,273   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.1.dist-info/WHEEL
2024-01-24T00:03:06,275   creating '/tmp/pip-wheel-ywhcicex/deepspeed-0.13.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-01-24T00:03:06,280   adding 'deepspeed/__init__.py'
2024-01-24T00:03:06,281   adding 'deepspeed/constants.py'
2024-01-24T00:03:06,284   adding 'deepspeed/env_report.py'
2024-01-24T00:03:06,285   adding 'deepspeed/git_version_info.py'
2024-01-24T00:03:06,287   adding 'deepspeed/git_version_info_installed.py'
2024-01-24T00:03:06,288   adding 'deepspeed/pydantic_v1.py'
2024-01-24T00:03:06,290   adding 'deepspeed/accelerator/__init__.py'
2024-01-24T00:03:06,292   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-01-24T00:03:06,294   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-01-24T00:03:06,297   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-01-24T00:03:06,299   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-01-24T00:03:06,301   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-01-24T00:03:06,303   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-01-24T00:03:06,305   adding 'deepspeed/accelerator/real_accelerator.py'
2024-01-24T00:03:06,308   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-01-24T00:03:06,310   adding 'deepspeed/autotuning/__init__.py'
2024-01-24T00:03:06,317   adding 'deepspeed/autotuning/autotuner.py'
2024-01-24T00:03:06,319   adding 'deepspeed/autotuning/config.py'
2024-01-24T00:03:06,321   adding 'deepspeed/autotuning/constants.py'
2024-01-24T00:03:06,325   adding 'deepspeed/autotuning/scheduler.py'
2024-01-24T00:03:06,328   adding 'deepspeed/autotuning/utils.py'
2024-01-24T00:03:06,330   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-01-24T00:03:06,332   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-01-24T00:03:06,334   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-01-24T00:03:06,335   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-01-24T00:03:06,337   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-01-24T00:03:06,339   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-01-24T00:03:06,341   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-01-24T00:03:06,343   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-01-24T00:03:06,345   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-01-24T00:03:06,347   adding 'deepspeed/autotuning/tuner/utils.py'
2024-01-24T00:03:06,349   adding 'deepspeed/checkpoint/__init__.py'
2024-01-24T00:03:06,351   adding 'deepspeed/checkpoint/constants.py'
2024-01-24T00:03:06,354   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-01-24T00:03:06,356   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-01-24T00:03:06,359   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-01-24T00:03:06,361   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-01-24T00:03:06,363   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-01-24T00:03:06,365   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-01-24T00:03:06,366   adding 'deepspeed/checkpoint/utils.py'
2024-01-24T00:03:06,368   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-01-24T00:03:06,371   adding 'deepspeed/comm/__init__.py'
2024-01-24T00:03:06,372   adding 'deepspeed/comm/backend.py'
2024-01-24T00:03:06,374   adding 'deepspeed/comm/ccl.py'
2024-01-24T00:03:06,378   adding 'deepspeed/comm/comm.py'
2024-01-24T00:03:06,379   adding 'deepspeed/comm/config.py'
2024-01-24T00:03:06,381   adding 'deepspeed/comm/constants.py'
2024-01-24T00:03:06,382   adding 'deepspeed/comm/reduce_op.py'
2024-01-24T00:03:06,384   adding 'deepspeed/comm/torch.py'
2024-01-24T00:03:06,385   adding 'deepspeed/comm/utils.py'
2024-01-24T00:03:06,387   adding 'deepspeed/compression/__init__.py'
2024-01-24T00:03:06,390   adding 'deepspeed/compression/basic_layer.py'
2024-01-24T00:03:06,392   adding 'deepspeed/compression/compress.py'
2024-01-24T00:03:06,394   adding 'deepspeed/compression/config.py'
2024-01-24T00:03:06,395   adding 'deepspeed/compression/constants.py'
2024-01-24T00:03:06,397   adding 'deepspeed/compression/helper.py'
2024-01-24T00:03:06,399   adding 'deepspeed/compression/scheduler.py'
2024-01-24T00:03:06,400   adding 'deepspeed/compression/utils.py'
2024-01-24T00:03:06,402   adding 'deepspeed/elasticity/__init__.py'
2024-01-24T00:03:06,403   adding 'deepspeed/elasticity/config.py'
2024-01-24T00:03:06,405   adding 'deepspeed/elasticity/constants.py'
2024-01-24T00:03:06,406   adding 'deepspeed/elasticity/elastic_agent.py'
2024-01-24T00:03:06,409   adding 'deepspeed/elasticity/elasticity.py'
2024-01-24T00:03:06,410   adding 'deepspeed/elasticity/utils.py'
2024-01-24T00:03:06,412   adding 'deepspeed/inference/__init__.py'
2024-01-24T00:03:06,413   adding 'deepspeed/inference/config.py'
2024-01-24T00:03:06,417   adding 'deepspeed/inference/engine.py'
2024-01-24T00:03:06,419   adding 'deepspeed/inference/quantization/__init__.py'
2024-01-24T00:03:06,420   adding 'deepspeed/inference/quantization/layers.py'
2024-01-24T00:03:06,422   adding 'deepspeed/inference/quantization/quantization.py'
2024-01-24T00:03:06,423   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-01-24T00:03:06,425   adding 'deepspeed/inference/quantization/utils.py'
2024-01-24T00:03:06,427   adding 'deepspeed/inference/v2/__init__.py'
2024-01-24T00:03:06,428   adding 'deepspeed/inference/v2/allocator.py'
2024-01-24T00:03:06,429   adding 'deepspeed/inference/v2/config_v2.py'
2024-01-24T00:03:06,431   adding 'deepspeed/inference/v2/engine_factory.py'
2024-01-24T00:03:06,432   adding 'deepspeed/inference/v2/engine_v2.py'
2024-01-24T00:03:06,434   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-01-24T00:03:06,435   adding 'deepspeed/inference/v2/inference_utils.py'
2024-01-24T00:03:06,437   adding 'deepspeed/inference/v2/logging.py'
2024-01-24T00:03:06,438   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-01-24T00:03:06,440   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-01-24T00:03:06,441   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-01-24T00:03:06,443   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-01-24T00:03:06,444   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-01-24T00:03:06,446   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-01-24T00:03:06,447   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-01-24T00:03:06,449   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-01-24T00:03:06,450   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-01-24T00:03:06,452   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-01-24T00:03:06,453   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-01-24T00:03:06,455   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu'
2024-01-24T00:03:06,456   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-01-24T00:03:06,457   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-01-24T00:03:06,459   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-01-24T00:03:06,460   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-01-24T00:03:06,461   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-01-24T00:03:06,463   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-01-24T00:03:06,465   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-01-24T00:03:06,466   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-01-24T00:03:06,467   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-01-24T00:03:06,468   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-01-24T00:03:06,470   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-01-24T00:03:06,471   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-01-24T00:03:06,473   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu'
2024-01-24T00:03:06,474   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-01-24T00:03:06,476   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-01-24T00:03:06,477   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-01-24T00:03:06,479   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu'
2024-01-24T00:03:06,481   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-01-24T00:03:06,482   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-01-24T00:03:06,483   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-01-24T00:03:06,484   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-01-24T00:03:06,486   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-01-24T00:03:06,487   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-01-24T00:03:06,489   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-01-24T00:03:06,490   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu'
2024-01-24T00:03:06,491   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-01-24T00:03:06,493   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-01-24T00:03:06,494   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-01-24T00:03:06,496   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-01-24T00:03:06,497   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-01-24T00:03:06,499   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-01-24T00:03:06,500   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-01-24T00:03:06,501   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-01-24T00:03:06,503   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-01-24T00:03:06,505   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-01-24T00:03:06,506   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-01-24T00:03:06,507   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-01-24T00:03:06,509   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-01-24T00:03:06,510   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-01-24T00:03:06,512   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-01-24T00:03:06,513   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-01-24T00:03:06,515   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-01-24T00:03:06,516   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-01-24T00:03:06,518   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-01-24T00:03:06,521   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-01-24T00:03:06,523   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-01-24T00:03:06,524   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-01-24T00:03:06,526   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-01-24T00:03:06,527   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-01-24T00:03:06,528   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-01-24T00:03:06,530   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-01-24T00:03:06,531   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-01-24T00:03:06,533   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-01-24T00:03:06,534   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-01-24T00:03:06,535   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-01-24T00:03:06,537   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-01-24T00:03:06,538   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-01-24T00:03:06,540   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-01-24T00:03:06,541   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-01-24T00:03:06,543   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu'
2024-01-24T00:03:06,544   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-01-24T00:03:06,545   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-01-24T00:03:06,547   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-01-24T00:03:06,549   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-01-24T00:03:06,550   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-01-24T00:03:06,552   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-01-24T00:03:06,554   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu'
2024-01-24T00:03:06,555   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-01-24T00:03:06,557   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-01-24T00:03:06,558   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-01-24T00:03:06,559   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-01-24T00:03:06,561   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-01-24T00:03:06,563   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-01-24T00:03:06,564   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-01-24T00:03:06,565   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu'
2024-01-24T00:03:06,567   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-01-24T00:03:06,568   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-01-24T00:03:06,569   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-01-24T00:03:06,571   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-01-24T00:03:06,572   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-01-24T00:03:06,573   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu'
2024-01-24T00:03:06,574   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-01-24T00:03:06,576   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-01-24T00:03:06,577   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-01-24T00:03:06,579   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-01-24T00:03:06,580   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-01-24T00:03:06,582   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu'
2024-01-24T00:03:06,583   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-01-24T00:03:06,584   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-01-24T00:03:06,585   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-01-24T00:03:06,587   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-01-24T00:03:06,588   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-01-24T00:03:06,589   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-01-24T00:03:06,591   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-01-24T00:03:06,593   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-01-24T00:03:06,594   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cu'
2024-01-24T00:03:06,595   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-01-24T00:03:06,596   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-01-24T00:03:06,598   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-01-24T00:03:06,600   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-01-24T00:03:06,601   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-01-24T00:03:06,603   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-01-24T00:03:06,605   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-01-24T00:03:06,608   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-01-24T00:03:06,610   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-01-24T00:03:06,612   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-01-24T00:03:06,614   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-01-24T00:03:06,615   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-01-24T00:03:06,616   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-01-24T00:03:06,618   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-01-24T00:03:06,619   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-01-24T00:03:06,620   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-01-24T00:03:06,622   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-01-24T00:03:06,623   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-01-24T00:03:06,624   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-01-24T00:03:06,626   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-01-24T00:03:06,627   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-01-24T00:03:06,629   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-01-24T00:03:06,630   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-01-24T00:03:06,632   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-01-24T00:03:06,633   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-01-24T00:03:06,634   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-01-24T00:03:06,636   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-01-24T00:03:06,637   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-01-24T00:03:06,638   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-01-24T00:03:06,640   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-01-24T00:03:06,641   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-01-24T00:03:06,643   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-01-24T00:03:06,644   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-01-24T00:03:06,646   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-01-24T00:03:06,647   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-01-24T00:03:06,649   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-01-24T00:03:06,650   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-01-24T00:03:06,652   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-01-24T00:03:06,653   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-01-24T00:03:06,654   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-01-24T00:03:06,656   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-01-24T00:03:06,657   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-01-24T00:03:06,659   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-01-24T00:03:06,661   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-01-24T00:03:06,662   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-01-24T00:03:06,664   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-01-24T00:03:06,665   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-01-24T00:03:06,667   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-01-24T00:03:06,668   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-01-24T00:03:06,670   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-01-24T00:03:06,671   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-01-24T00:03:06,673   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-01-24T00:03:06,674   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-01-24T00:03:06,675   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-01-24T00:03:06,677   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-01-24T00:03:06,678   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-01-24T00:03:06,680   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-01-24T00:03:06,681   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-01-24T00:03:06,683   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-01-24T00:03:06,684   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-01-24T00:03:06,686   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-01-24T00:03:06,687   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-01-24T00:03:06,688   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-01-24T00:03:06,689   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-01-24T00:03:06,690   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-01-24T00:03:06,692   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-01-24T00:03:06,693   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-01-24T00:03:06,695   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-01-24T00:03:06,696   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-01-24T00:03:06,698   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-01-24T00:03:06,700   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-01-24T00:03:06,701   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-01-24T00:03:06,703   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-01-24T00:03:06,704   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-01-24T00:03:06,705   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-01-24T00:03:06,707   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-01-24T00:03:06,709   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-01-24T00:03:06,710   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-01-24T00:03:06,712   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-01-24T00:03:06,713   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-01-24T00:03:06,714   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-01-24T00:03:06,716   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-01-24T00:03:06,717   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-01-24T00:03:06,719   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-01-24T00:03:06,721   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-01-24T00:03:06,722   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-01-24T00:03:06,723   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-01-24T00:03:06,725   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-01-24T00:03:06,726   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-01-24T00:03:06,727   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-01-24T00:03:06,729   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-01-24T00:03:06,730   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-01-24T00:03:06,732   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-01-24T00:03:06,734   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-01-24T00:03:06,735   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-01-24T00:03:06,737   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-01-24T00:03:06,739   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-01-24T00:03:06,741   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-01-24T00:03:06,742   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-01-24T00:03:06,744   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-01-24T00:03:06,746   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-01-24T00:03:06,747   adding 'deepspeed/launcher/__init__.py'
2024-01-24T00:03:06,749   adding 'deepspeed/launcher/constants.py'
2024-01-24T00:03:06,751   adding 'deepspeed/launcher/launch.py'
2024-01-24T00:03:06,753   adding 'deepspeed/launcher/multinode_runner.py'
2024-01-24T00:03:06,756   adding 'deepspeed/launcher/runner.py'
2024-01-24T00:03:06,757   adding 'deepspeed/model_implementations/__init__.py'
2024-01-24T00:03:06,759   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-01-24T00:03:06,760   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-01-24T00:03:06,762   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-01-24T00:03:06,763   adding 'deepspeed/model_implementations/features/__init__.py'
2024-01-24T00:03:06,764   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-01-24T00:03:06,766   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-01-24T00:03:06,767   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-01-24T00:03:06,768   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-01-24T00:03:06,770   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-01-24T00:03:06,771   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-01-24T00:03:06,772   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-01-24T00:03:06,773   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-01-24T00:03:06,774   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-01-24T00:03:06,775   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-01-24T00:03:06,777   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-01-24T00:03:06,779   adding 'deepspeed/module_inject/__init__.py'
2024-01-24T00:03:06,782   adding 'deepspeed/module_inject/auto_tp.py'
2024-01-24T00:03:06,784   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-01-24T00:03:06,785   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-01-24T00:03:06,786   adding 'deepspeed/module_inject/inject.py'
2024-01-24T00:03:06,788   adding 'deepspeed/module_inject/layers.py'
2024-01-24T00:03:06,790   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-01-24T00:03:06,791   adding 'deepspeed/module_inject/module_quantize.py'
2024-01-24T00:03:06,793   adding 'deepspeed/module_inject/policy.py'
2024-01-24T00:03:06,797   adding 'deepspeed/module_inject/replace_module.py'
2024-01-24T00:03:06,798   adding 'deepspeed/module_inject/replace_policy.py'
2024-01-24T00:03:06,799   adding 'deepspeed/module_inject/tp_shard.py'
2024-01-24T00:03:06,801   adding 'deepspeed/module_inject/utils.py'
2024-01-24T00:03:06,803   adding 'deepspeed/module_inject/containers/__init__.py'
2024-01-24T00:03:06,805   adding 'deepspeed/module_inject/containers/base.py'
2024-01-24T00:03:06,806   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-01-24T00:03:06,808   adding 'deepspeed/module_inject/containers/bert.py'
2024-01-24T00:03:06,809   adding 'deepspeed/module_inject/containers/bloom.py'
2024-01-24T00:03:06,810   adding 'deepspeed/module_inject/containers/clip.py'
2024-01-24T00:03:06,812   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-01-24T00:03:06,813   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-01-24T00:03:06,815   adding 'deepspeed/module_inject/containers/gptj.py'
2024-01-24T00:03:06,816   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-01-24T00:03:06,817   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-01-24T00:03:06,819   adding 'deepspeed/module_inject/containers/internlm.py'
2024-01-24T00:03:06,821   adding 'deepspeed/module_inject/containers/llama.py'
2024-01-24T00:03:06,822   adding 'deepspeed/module_inject/containers/llama2.py'
2024-01-24T00:03:06,824   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-01-24T00:03:06,825   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-01-24T00:03:06,827   adding 'deepspeed/module_inject/containers/opt.py'
2024-01-24T00:03:06,828   adding 'deepspeed/module_inject/containers/unet.py'
2024-01-24T00:03:06,829   adding 'deepspeed/module_inject/containers/vae.py'
2024-01-24T00:03:06,831   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-01-24T00:03:06,832   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-01-24T00:03:06,834   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-01-24T00:03:06,835   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-01-24T00:03:06,836   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-01-24T00:03:06,838   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-01-24T00:03:06,839   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-01-24T00:03:06,841   adding 'deepspeed/moe/__init__.py'
2024-01-24T00:03:06,842   adding 'deepspeed/moe/experts.py'
2024-01-24T00:03:06,843   adding 'deepspeed/moe/layer.py'
2024-01-24T00:03:06,845   adding 'deepspeed/moe/mappings.py'
2024-01-24T00:03:06,848   adding 'deepspeed/moe/sharded_moe.py'
2024-01-24T00:03:06,849   adding 'deepspeed/moe/utils.py'
2024-01-24T00:03:06,851   adding 'deepspeed/monitor/__init__.py'
2024-01-24T00:03:06,852   adding 'deepspeed/monitor/config.py'
2024-01-24T00:03:06,853   adding 'deepspeed/monitor/csv_monitor.py'
2024-01-24T00:03:06,855   adding 'deepspeed/monitor/monitor.py'
2024-01-24T00:03:06,856   adding 'deepspeed/monitor/tensorboard.py'
2024-01-24T00:03:06,857   adding 'deepspeed/monitor/utils.py'
2024-01-24T00:03:06,858   adding 'deepspeed/monitor/wandb.py'
2024-01-24T00:03:06,860   adding 'deepspeed/nebula/__init__.py'
2024-01-24T00:03:06,861   adding 'deepspeed/nebula/config.py'
2024-01-24T00:03:06,863   adding 'deepspeed/nebula/constants.py'
2024-01-24T00:03:06,865   adding 'deepspeed/ops/__init__.py'
2024-01-24T00:03:06,866   adding 'deepspeed/ops/adagrad/__init__.py'
2024-01-24T00:03:06,868   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-01-24T00:03:06,869   adding 'deepspeed/ops/adam/__init__.py'
2024-01-24T00:03:06,871   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-01-24T00:03:06,873   adding 'deepspeed/ops/adam/fused_adam.py'
2024-01-24T00:03:06,874   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-01-24T00:03:06,875   adding 'deepspeed/ops/aio/__init__.py'
2024-01-24T00:03:06,878   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-01-24T00:03:06,880   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-01-24T00:03:06,882   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-01-24T00:03:06,883   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-01-24T00:03:06,884   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-01-24T00:03:06,886   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-01-24T00:03:06,889   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-01-24T00:03:06,890   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-01-24T00:03:06,891   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-01-24T00:03:06,893   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-01-24T00:03:06,894   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-01-24T00:03:06,895   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-01-24T00:03:06,898   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-01-24T00:03:06,899   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-01-24T00:03:06,900   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-01-24T00:03:06,901   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-01-24T00:03:06,903   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-01-24T00:03:06,904   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-01-24T00:03:06,906   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-01-24T00:03:06,907   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-01-24T00:03:06,908   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-01-24T00:03:06,910   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-01-24T00:03:06,911   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-01-24T00:03:06,913   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-01-24T00:03:06,914   adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu'
2024-01-24T00:03:06,916   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-01-24T00:03:06,919   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-01-24T00:03:06,921   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-01-24T00:03:06,924   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-01-24T00:03:06,925   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-01-24T00:03:06,927   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-01-24T00:03:06,928   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-01-24T00:03:06,936   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-01-24T00:03:06,941   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-01-24T00:03:06,943   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-01-24T00:03:06,946   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-01-24T00:03:06,948   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-01-24T00:03:06,949   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-01-24T00:03:06,951   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-01-24T00:03:06,953   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-01-24T00:03:06,956   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-01-24T00:03:06,958   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-01-24T00:03:06,960   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-01-24T00:03:06,962   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-01-24T00:03:06,969   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-01-24T00:03:06,972   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-01-24T00:03:06,974   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-01-24T00:03:06,978   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-01-24T00:03:06,981   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-01-24T00:03:06,985   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-01-24T00:03:06,987   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-01-24T00:03:06,989   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-01-24T00:03:06,991   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-01-24T00:03:06,992   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-01-24T00:03:06,995   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-01-24T00:03:06,997   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-01-24T00:03:06,998   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-01-24T00:03:06,999   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-01-24T00:03:07,001   adding 'deepspeed/ops/csrc/includes/context.h'
2024-01-24T00:03:07,002   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-01-24T00:03:07,004   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-01-24T00:03:07,006   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-01-24T00:03:07,007   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-01-24T00:03:07,008   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-01-24T00:03:07,010   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-01-24T00:03:07,011   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-01-24T00:03:07,013   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-01-24T00:03:07,014   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-01-24T00:03:07,015   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-01-24T00:03:07,017   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-01-24T00:03:07,018   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-01-24T00:03:07,019   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-01-24T00:03:07,021   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-01-24T00:03:07,023   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-01-24T00:03:07,025   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-01-24T00:03:07,026   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-01-24T00:03:07,028   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-01-24T00:03:07,030   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-01-24T00:03:07,032   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-01-24T00:03:07,034   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-01-24T00:03:07,035   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-01-24T00:03:07,036   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-01-24T00:03:07,038   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-01-24T00:03:07,040   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-01-24T00:03:07,042   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-01-24T00:03:07,044   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-01-24T00:03:07,045   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-01-24T00:03:07,046   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-01-24T00:03:07,048   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-01-24T00:03:07,049   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-01-24T00:03:07,051   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-01-24T00:03:07,054   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-01-24T00:03:07,056   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-01-24T00:03:07,058   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-01-24T00:03:07,059   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-01-24T00:03:07,061   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-01-24T00:03:07,063   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-01-24T00:03:07,065   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-01-24T00:03:07,066   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-01-24T00:03:07,068   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-01-24T00:03:07,069   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-01-24T00:03:07,071   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-01-24T00:03:07,074   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-01-24T00:03:07,075   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-01-24T00:03:07,077   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-01-24T00:03:07,079   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-01-24T00:03:07,082   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-01-24T00:03:07,086   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-01-24T00:03:07,090   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-01-24T00:03:07,091   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-01-24T00:03:07,096   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-01-24T00:03:07,098   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-01-24T00:03:07,101   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-01-24T00:03:07,104   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-01-24T00:03:07,105   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-01-24T00:03:07,108   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-01-24T00:03:07,110   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-01-24T00:03:07,111   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-01-24T00:03:07,116   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-01-24T00:03:07,118   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-01-24T00:03:07,120   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-01-24T00:03:07,122   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-01-24T00:03:07,125   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-01-24T00:03:07,127   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-01-24T00:03:07,129   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-01-24T00:03:07,131   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-01-24T00:03:07,132   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-01-24T00:03:07,135   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-01-24T00:03:07,137   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp'
2024-01-24T00:03:07,138   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp'
2024-01-24T00:03:07,139   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-01-24T00:03:07,141   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-01-24T00:03:07,143   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-01-24T00:03:07,145   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-01-24T00:03:07,146   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-01-24T00:03:07,148   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-01-24T00:03:07,149   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-01-24T00:03:07,151   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-01-24T00:03:07,153   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-01-24T00:03:07,154   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-01-24T00:03:07,156   adding 'deepspeed/ops/lamb/__init__.py'
2024-01-24T00:03:07,157   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-01-24T00:03:07,159   adding 'deepspeed/ops/lion/__init__.py'
2024-01-24T00:03:07,161   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-01-24T00:03:07,162   adding 'deepspeed/ops/lion/fused_lion.py'
2024-01-24T00:03:07,164   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-01-24T00:03:07,166   adding 'deepspeed/ops/op_builder/__init__.py'
2024-01-24T00:03:07,167   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-01-24T00:03:07,169   adding 'deepspeed/ops/op_builder/async_io.py'
2024-01-24T00:03:07,172   adding 'deepspeed/ops/op_builder/builder.py'
2024-01-24T00:03:07,173   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-01-24T00:03:07,175   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-01-24T00:03:07,176   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-01-24T00:03:07,177   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-01-24T00:03:07,179   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-01-24T00:03:07,180   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-01-24T00:03:07,181   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-01-24T00:03:07,183   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-01-24T00:03:07,184   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-01-24T00:03:07,185   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-01-24T00:03:07,187   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-01-24T00:03:07,188   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-01-24T00:03:07,189   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-01-24T00:03:07,190   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-01-24T00:03:07,191   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-01-24T00:03:07,193   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-01-24T00:03:07,194   adding 'deepspeed/ops/op_builder/transformer.py'
2024-01-24T00:03:07,195   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-01-24T00:03:07,197   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-01-24T00:03:07,198   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-01-24T00:03:07,199   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-01-24T00:03:07,200   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-01-24T00:03:07,201   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-01-24T00:03:07,203   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-01-24T00:03:07,204   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-01-24T00:03:07,206   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-01-24T00:03:07,207   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-01-24T00:03:07,208   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-01-24T00:03:07,209   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-01-24T00:03:07,211   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-01-24T00:03:07,212   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-01-24T00:03:07,214   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-01-24T00:03:07,215   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-01-24T00:03:07,216   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-01-24T00:03:07,217   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-01-24T00:03:07,218   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-01-24T00:03:07,220   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-01-24T00:03:07,221   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-01-24T00:03:07,223   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-01-24T00:03:07,224   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-01-24T00:03:07,226   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-01-24T00:03:07,227   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-01-24T00:03:07,228   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-01-24T00:03:07,230   adding 'deepspeed/ops/quantizer/__init__.py'
2024-01-24T00:03:07,231   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-01-24T00:03:07,233   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-01-24T00:03:07,234   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-01-24T00:03:07,236   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-01-24T00:03:07,237   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-01-24T00:03:07,241   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-01-24T00:03:07,243   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-01-24T00:03:07,245   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-01-24T00:03:07,247   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-01-24T00:03:07,250   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-01-24T00:03:07,252   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-01-24T00:03:07,254   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-01-24T00:03:07,255   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-01-24T00:03:07,257   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-01-24T00:03:07,259   adding 'deepspeed/ops/transformer/__init__.py'
2024-01-24T00:03:07,261   adding 'deepspeed/ops/transformer/transformer.py'
2024-01-24T00:03:07,263   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-01-24T00:03:07,265   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-01-24T00:03:07,266   adding 'deepspeed/ops/transformer/inference/config.py'
2024-01-24T00:03:07,267   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-01-24T00:03:07,269   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-01-24T00:03:07,270   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-01-24T00:03:07,272   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-01-24T00:03:07,274   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-01-24T00:03:07,276   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-01-24T00:03:07,278   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-01-24T00:03:07,279   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-01-24T00:03:07,281   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-01-24T00:03:07,282   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-01-24T00:03:07,283   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-01-24T00:03:07,285   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-01-24T00:03:07,286   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-01-24T00:03:07,288   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-01-24T00:03:07,289   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-01-24T00:03:07,290   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-01-24T00:03:07,291   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-01-24T00:03:07,293   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-01-24T00:03:07,295   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-01-24T00:03:07,297   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-01-24T00:03:07,298   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-01-24T00:03:07,300   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-01-24T00:03:07,301   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-01-24T00:03:07,303   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-01-24T00:03:07,304   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-01-24T00:03:07,306   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-01-24T00:03:07,308   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-01-24T00:03:07,310   adding 'deepspeed/pipe/__init__.py'
2024-01-24T00:03:07,311   adding 'deepspeed/profiling/__init__.py'
2024-01-24T00:03:07,313   adding 'deepspeed/profiling/config.py'
2024-01-24T00:03:07,314   adding 'deepspeed/profiling/constants.py'
2024-01-24T00:03:07,315   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-01-24T00:03:07,321   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-01-24T00:03:07,323   adding 'deepspeed/runtime/__init__.py'
2024-01-24T00:03:07,326   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-01-24T00:03:07,330   adding 'deepspeed/runtime/config.py'
2024-01-24T00:03:07,332   adding 'deepspeed/runtime/config_utils.py'
2024-01-24T00:03:07,334   adding 'deepspeed/runtime/constants.py'
2024-01-24T00:03:07,335   adding 'deepspeed/runtime/dataloader.py'
2024-01-24T00:03:07,337   adding 'deepspeed/runtime/eigenvalue.py'
2024-01-24T00:03:07,355   adding 'deepspeed/runtime/engine.py'
2024-01-24T00:03:07,358   adding 'deepspeed/runtime/hybrid_engine.py'
2024-01-24T00:03:07,362   adding 'deepspeed/runtime/lr_schedules.py'
2024-01-24T00:03:07,363   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-01-24T00:03:07,365   adding 'deepspeed/runtime/quantize.py'
2024-01-24T00:03:07,366   adding 'deepspeed/runtime/sparse_tensor.py'
2024-01-24T00:03:07,368   adding 'deepspeed/runtime/state_dict_factory.py'
2024-01-24T00:03:07,373   adding 'deepspeed/runtime/utils.py'
2024-01-24T00:03:07,375   adding 'deepspeed/runtime/weight_quantizer.py'
2024-01-24T00:03:07,377   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-01-24T00:03:07,381   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-01-24T00:03:07,383   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-01-24T00:03:07,384   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-01-24T00:03:07,385   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-01-24T00:03:07,387   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-01-24T00:03:07,388   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-01-24T00:03:07,390   adding 'deepspeed/runtime/comm/__init__.py'
2024-01-24T00:03:07,391   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-01-24T00:03:07,393   adding 'deepspeed/runtime/comm/hccl.py'
2024-01-24T00:03:07,394   adding 'deepspeed/runtime/comm/mpi.py'
2024-01-24T00:03:07,396   adding 'deepspeed/runtime/comm/nccl.py'
2024-01-24T00:03:07,397   adding 'deepspeed/runtime/compression/__init__.py'
2024-01-24T00:03:07,399   adding 'deepspeed/runtime/compression/cupy.py'
2024-01-24T00:03:07,400   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-01-24T00:03:07,402   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-01-24T00:03:07,403   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-01-24T00:03:07,404   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-01-24T00:03:07,406   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-01-24T00:03:07,408   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-01-24T00:03:07,409   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-01-24T00:03:07,410   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-01-24T00:03:07,411   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-01-24T00:03:07,413   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-01-24T00:03:07,415   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-01-24T00:03:07,418   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-01-24T00:03:07,421   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-01-24T00:03:07,422   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-01-24T00:03:07,424   adding 'deepspeed/runtime/fp16/__init__.py'
2024-01-24T00:03:07,426   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-01-24T00:03:07,428   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-01-24T00:03:07,430   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-01-24T00:03:07,432   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-01-24T00:03:07,434   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-01-24T00:03:07,437   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-01-24T00:03:07,440   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-01-24T00:03:07,442   adding 'deepspeed/runtime/pipe/__init__.py'
2024-01-24T00:03:07,448   adding 'deepspeed/runtime/pipe/engine.py'
2024-01-24T00:03:07,452   adding 'deepspeed/runtime/pipe/module.py'
2024-01-24T00:03:07,453   adding 'deepspeed/runtime/pipe/p2p.py'
2024-01-24T00:03:07,455   adding 'deepspeed/runtime/pipe/schedule.py'
2024-01-24T00:03:07,458   adding 'deepspeed/runtime/pipe/topology.py'
2024-01-24T00:03:07,460   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-01-24T00:03:07,461   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-01-24T00:03:07,463   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-01-24T00:03:07,464   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-01-24T00:03:07,466   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-01-24T00:03:07,468   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-01-24T00:03:07,471   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-01-24T00:03:07,473   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-01-24T00:03:07,474   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-01-24T00:03:07,476   adding 'deepspeed/runtime/zero/__init__.py'
2024-01-24T00:03:07,478   adding 'deepspeed/runtime/zero/config.py'
2024-01-24T00:03:07,480   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-01-24T00:03:07,482   adding 'deepspeed/runtime/zero/linear.py'
2024-01-24T00:03:07,485   adding 'deepspeed/runtime/zero/mics.py'
2024-01-24T00:03:07,486   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-01-24T00:03:07,488   adding 'deepspeed/runtime/zero/offload_config.py'
2024-01-24T00:03:07,490   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-01-24T00:03:07,502   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-01-24T00:03:07,505   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-01-24T00:03:07,506   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-01-24T00:03:07,520   adding 'deepspeed/runtime/zero/stage3.py'
2024-01-24T00:03:07,536   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-01-24T00:03:07,538   adding 'deepspeed/runtime/zero/test.py'
2024-01-24T00:03:07,540   adding 'deepspeed/runtime/zero/tiling.py'
2024-01-24T00:03:07,542   adding 'deepspeed/runtime/zero/utils.py'
2024-01-24T00:03:07,543   adding 'deepspeed/sequence/__init__.py'
2024-01-24T00:03:07,545   adding 'deepspeed/sequence/layer.py'
2024-01-24T00:03:07,546   adding 'deepspeed/utils/__init__.py'
2024-01-24T00:03:07,548   adding 'deepspeed/utils/comms_logging.py'
2024-01-24T00:03:07,549   adding 'deepspeed/utils/debug.py'
2024-01-24T00:03:07,550   adding 'deepspeed/utils/exceptions.py'
2024-01-24T00:03:07,553   adding 'deepspeed/utils/groups.py'
2024-01-24T00:03:07,555   adding 'deepspeed/utils/init_on_device.py'
2024-01-24T00:03:07,556   adding 'deepspeed/utils/logging.py'
2024-01-24T00:03:07,557   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-01-24T00:03:07,559   adding 'deepspeed/utils/numa.py'
2024-01-24T00:03:07,560   adding 'deepspeed/utils/nvtx.py'
2024-01-24T00:03:07,562   adding 'deepspeed/utils/tensor_fragment.py'
2024-01-24T00:03:07,564   adding 'deepspeed/utils/timer.py'
2024-01-24T00:03:07,565   adding 'deepspeed/utils/types.py'
2024-01-24T00:03:07,567   adding 'deepspeed/utils/z3_leaf_module.py'
2024-01-24T00:03:07,570   adding 'deepspeed/utils/zero_to_fp32.py'
2024-01-24T00:03:07,572   adding 'deepspeed-0.13.1.data/scripts/deepspeed'
2024-01-24T00:03:07,573   adding 'deepspeed-0.13.1.data/scripts/deepspeed.pt'
2024-01-24T00:03:07,574   adding 'deepspeed-0.13.1.data/scripts/ds'
2024-01-24T00:03:07,575   adding 'deepspeed-0.13.1.data/scripts/ds_bench'
2024-01-24T00:03:07,577   adding 'deepspeed-0.13.1.data/scripts/ds_elastic'
2024-01-24T00:03:07,578   adding 'deepspeed-0.13.1.data/scripts/ds_report'
2024-01-24T00:03:07,579   adding 'deepspeed-0.13.1.data/scripts/ds_ssh'
2024-01-24T00:03:07,580   adding 'deepspeed-0.13.1.data/scripts/dsr'
2024-01-24T00:03:07,585   adding 'deepspeed-0.13.1.dist-info/METADATA'
2024-01-24T00:03:07,587   adding 'deepspeed-0.13.1.dist-info/WHEEL'
2024-01-24T00:03:07,588   adding 'deepspeed-0.13.1.dist-info/entry_points.txt'
2024-01-24T00:03:07,589   adding 'deepspeed-0.13.1.dist-info/top_level.txt'
2024-01-24T00:03:07,602   adding 'deepspeed-0.13.1.dist-info/RECORD'
2024-01-24T00:03:07,628   removing build/bdist.linux-armv7l/wheel
2024-01-24T00:03:07,827   deepspeed build time = 9.471872091293335 secs
2024-01-24T00:03:07,947   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-01-24T00:03:07,963   Created wheel for deepspeed: filename=deepspeed-0.13.1-py3-none-any.whl size=1350261 sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1
2024-01-24T00:03:07,965   Stored in directory: /tmp/pip-ephem-wheel-cache-mley3y5l/wheels/c6/3c/1e/9c5c1ed97b6959417ffd9555090f7dcb915a6e5305b286cfab
2024-01-24T00:03:08,003 Successfully built deepspeed
2024-01-24T00:03:08,037 Removed build tracker: '/tmp/pip-build-tracker-715yxzy3'