2024-03-08T03:12:47,928 Created temporary directory: /tmp/pip-build-tracker-g9eq6m5o
2024-03-08T03:12:47,930 Initialized build tracking at /tmp/pip-build-tracker-g9eq6m5o
2024-03-08T03:12:47,930 Created build tracker: /tmp/pip-build-tracker-g9eq6m5o
2024-03-08T03:12:47,931 Entered build tracker: /tmp/pip-build-tracker-g9eq6m5o
2024-03-08T03:12:47,932 Created temporary directory: /tmp/pip-wheel-z2re_e0t
2024-03-08T03:12:47,934 Created temporary directory: /tmp/pip-ephem-wheel-cache-5hdkyxpg
2024-03-08T03:12:47,958 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-03-08T03:12:47,961 2 location(s) to search for versions of deepspeed:
2024-03-08T03:12:47,961 * https://pypi.org/simple/deepspeed/
2024-03-08T03:12:47,961 * https://www.piwheels.org/simple/deepspeed/
2024-03-08T03:12:47,962 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-03-08T03:12:47,963 Getting page https://pypi.org/simple/deepspeed/
2024-03-08T03:12:47,964 Found index url https://pypi.org/simple/
2024-03-08T03:12:48,182 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-03-08T03:12:48,198   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-03-08T03:12:48,199   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-03-08T03:12:48,199   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-03-08T03:12:48,200   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-03-08T03:12:48,201   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-03-08T03:12:48,201   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-03-08T03:12:48,202   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-03-08T03:12:48,203   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-03-08T03:12:48,204   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-03-08T03:12:48,205   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-03-08T03:12:48,205   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-03-08T03:12:48,206   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-03-08T03:12:48,207   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-03-08T03:12:48,208   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-03-08T03:12:48,208   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-03-08T03:12:48,209   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-03-08T03:12:48,210   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-03-08T03:12:48,210   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-03-08T03:12:48,211   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-03-08T03:12:48,212   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-03-08T03:12:48,212   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-03-08T03:12:48,213   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-03-08T03:12:48,214   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-03-08T03:12:48,215   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-03-08T03:12:48,215   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-03-08T03:12:48,216   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-03-08T03:12:48,217   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-03-08T03:12:48,217   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-03-08T03:12:48,218   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-03-08T03:12:48,219   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-03-08T03:12:48,220   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-03-08T03:12:48,221   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-03-08T03:12:48,221   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-03-08T03:12:48,222   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-03-08T03:12:48,223   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-03-08T03:12:48,223   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-03-08T03:12:48,224   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-03-08T03:12:48,225   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-03-08T03:12:48,225   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-03-08T03:12:48,226   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-03-08T03:12:48,227   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-03-08T03:12:48,227   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-03-08T03:12:48,228   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-03-08T03:12:48,229   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-03-08T03:12:48,229   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-03-08T03:12:48,230   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-03-08T03:12:48,231   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-03-08T03:12:48,232   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-03-08T03:12:48,232   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-03-08T03:12:48,233   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-03-08T03:12:48,234   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-03-08T03:12:48,235   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-03-08T03:12:48,235   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-03-08T03:12:48,236   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-03-08T03:12:48,237   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-03-08T03:12:48,237   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-03-08T03:12:48,238   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-03-08T03:12:48,239   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-03-08T03:12:48,239   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-03-08T03:12:48,240   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-03-08T03:12:48,241   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-03-08T03:12:48,241   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-03-08T03:12:48,242   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-03-08T03:12:48,243   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-03-08T03:12:48,243   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-03-08T03:12:48,244   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-03-08T03:12:48,245   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-03-08T03:12:48,246   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-03-08T03:12:48,246   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-03-08T03:12:48,247   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-03-08T03:12:48,248   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-03-08T03:12:48,249   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-03-08T03:12:48,249   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-03-08T03:12:48,250   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-03-08T03:12:48,251   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-03-08T03:12:48,251   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-03-08T03:12:48,252   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-03-08T03:12:48,253   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-03-08T03:12:48,253   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-03-08T03:12:48,254   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-03-08T03:12:48,255   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-03-08T03:12:48,255   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-03-08T03:12:48,256   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-03-08T03:12:48,257   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-03-08T03:12:48,257   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-03-08T03:12:48,258   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-03-08T03:12:48,259   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-03-08T03:12:48,260   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-03-08T03:12:48,260   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-03-08T03:12:48,261   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-03-08T03:12:48,261   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-03-08T03:12:48,262   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-03-08T03:12:48,263 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-03-08T03:12:48,263 Getting page https://www.piwheels.org/simple/deepspeed/
2024-03-08T03:12:48,265 Found index url https://www.piwheels.org/simple/
2024-03-08T03:12:48,480 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-03-08T03:12:48,496   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,497   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,497   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,498   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,499   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,499   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,500   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,501   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,501   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,502   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,503   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,503   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,504   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,504   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,505   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,505   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,506   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,507   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,507   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,508   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,509   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,509   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,510   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,511   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,511   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,512   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,513   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,513   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,514   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,514   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,515   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,516   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,516   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,517   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,517   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,518   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,519   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,519   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,520   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,521   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,522   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,522   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,523   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,523   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,524   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,524   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,525   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,525   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,526   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,526   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,527   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,528   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,528   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,529   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,529   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,530   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,530   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,531   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,531   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,532   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,533   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-03-08T03:12:48,533 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-03-08T03:12:48,534 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-03-08T03:12:48,562 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-03-08T03:12:48,581 Collecting deepspeed==0.14.0
2024-03-08T03:12:48,584   Created temporary directory: /tmp/pip-unpack-w8snewxj
2024-03-08T03:12:48,800   Downloading deepspeed-0.14.0.tar.gz (1.3 MB)
2024-03-08T03:12:51,493   Added deepspeed==0.14.0 from https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz to build tracker '/tmp/pip-build-tracker-g9eq6m5o'
2024-03-08T03:12:51,495   Running setup.py (path:/tmp/pip-wheel-z2re_e0t/deepspeed_3542ef7e24284a33b9256a40bfe75bc2/setup.py) egg_info for package deepspeed
2024-03-08T03:12:51,496   Created temporary directory: /tmp/pip-pip-egg-info-_9toz2jr
2024-03-08T03:12:51,497   Preparing metadata (setup.py): started
2024-03-08T03:12:51,498   Running command python setup.py egg_info
2024-03-08T03:12:52,406   fatal: not a git repository (or any of the parent directories): .git
2024-03-08T03:12:53,359   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-03-08T03:12:53,360    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-03-08T03:12:53,360   DS_BUILD_OPS=0
2024-03-08T03:12:53,361    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-03-08T03:12:53,361    [WARNING]  async_io: please install the libaio-dev package with apt
2024-03-08T03:12:53,362    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-03-08T03:12:53,363    [WARNING]  Please install torch if trying to pre-compile kernels
2024-03-08T03:12:53,363    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:53,364    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:53,364    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:53,365    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:53,365    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:53,366    [WARNING]  unable to import torch, please install it first
2024-03-08T03:12:53,366    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:53,367   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-03-08T03:12:53,367   version=0.14.0, git_hash=unknown, git_branch=unknown
2024-03-08T03:12:53,368   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-03-08T03:12:53,368   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False}
2024-03-08T03:12:53,369   ext_modules=[]
2024-03-08T03:12:53,370   running egg_info
2024-03-08T03:12:53,371   creating /tmp/pip-pip-egg-info-_9toz2jr/deepspeed.egg-info
2024-03-08T03:12:53,388   writing /tmp/pip-pip-egg-info-_9toz2jr/deepspeed.egg-info/PKG-INFO
2024-03-08T03:12:53,420   writing dependency_links to /tmp/pip-pip-egg-info-_9toz2jr/deepspeed.egg-info/dependency_links.txt
2024-03-08T03:12:53,422   writing entry points to /tmp/pip-pip-egg-info-_9toz2jr/deepspeed.egg-info/entry_points.txt
2024-03-08T03:12:53,439   writing requirements to /tmp/pip-pip-egg-info-_9toz2jr/deepspeed.egg-info/requires.txt
2024-03-08T03:12:53,440   writing top-level names to /tmp/pip-pip-egg-info-_9toz2jr/deepspeed.egg-info/top_level.txt
2024-03-08T03:12:53,442   writing manifest file '/tmp/pip-pip-egg-info-_9toz2jr/deepspeed.egg-info/SOURCES.txt'
2024-03-08T03:12:53,665   reading manifest file '/tmp/pip-pip-egg-info-_9toz2jr/deepspeed.egg-info/SOURCES.txt'
2024-03-08T03:12:53,666   reading manifest template 'MANIFEST.in'
2024-03-08T03:12:53,669   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-03-08T03:12:53,669   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-03-08T03:12:55,163   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-03-08T03:12:56,274   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-03-08T03:12:56,871   warning: no files found matching '*.tr' under directory 'csrc'
2024-03-08T03:12:56,981   warning: no files found matching '*.cc' under directory 'csrc'
2024-03-08T03:12:57,017   warning: no files found matching '*.py' under directory 'benchmarks'
2024-03-08T03:12:57,056   writing manifest file '/tmp/pip-pip-egg-info-_9toz2jr/deepspeed.egg-info/SOURCES.txt'
2024-03-08T03:12:57,059   deepspeed build time = 4.648874998092651 secs
2024-03-08T03:12:57,173   Preparing metadata (setup.py): finished with status 'done'
2024-03-08T03:12:57,179   Source in /tmp/pip-wheel-z2re_e0t/deepspeed_3542ef7e24284a33b9256a40bfe75bc2 has version 0.14.0, which satisfies requirement deepspeed==0.14.0 from https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz
2024-03-08T03:12:57,180   Removed deepspeed==0.14.0 from https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz from build tracker '/tmp/pip-build-tracker-g9eq6m5o'
2024-03-08T03:12:57,190 Created temporary directory: /tmp/pip-unpack-nipm5vqz
2024-03-08T03:12:57,192 Created temporary directory: /tmp/pip-unpack-8c7mlf3q
2024-03-08T03:12:57,485 Building wheels for collected packages: deepspeed
2024-03-08T03:12:57,489   Created temporary directory: /tmp/pip-wheel-9j_eeom7
2024-03-08T03:12:57,489   Building wheel for deepspeed (setup.py): started
2024-03-08T03:12:57,491   Destination directory: /tmp/pip-wheel-9j_eeom7
2024-03-08T03:12:57,491   Running command python setup.py bdist_wheel
2024-03-08T03:12:57,940   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-03-08T03:12:57,948    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-03-08T03:12:58,034   DS_BUILD_OPS=0
2024-03-08T03:12:58,152    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-03-08T03:12:58,213    [WARNING]  async_io: please install the libaio-dev package with apt
2024-03-08T03:12:58,214    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-03-08T03:12:58,215    [WARNING]  Please install torch if trying to pre-compile kernels
2024-03-08T03:12:58,216    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:58,217    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:58,218    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:58,218    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:58,219    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:58,220    [WARNING]  unable to import torch, please install it first
2024-03-08T03:12:58,221    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-03-08T03:12:58,221   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-03-08T03:12:58,228   fatal: not a git repository (or any of the parent directories): .git
2024-03-08T03:12:58,230   version=0.14.0, git_hash=unknown, git_branch=unknown
2024-03-08T03:12:58,231   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-03-08T03:12:58,231   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False}
2024-03-08T03:12:58,232   ext_modules=[]
2024-03-08T03:13:00,278   running bdist_wheel
2024-03-08T03:13:00,383   running build
2024-03-08T03:13:00,383   running build_py
2024-03-08T03:13:00,413   creating build
2024-03-08T03:13:00,414   creating build/lib
2024-03-08T03:13:00,415   creating build/lib/deepspeed
2024-03-08T03:13:00,416   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2024-03-08T03:13:00,419   copying deepspeed/constants.py -> build/lib/deepspeed
2024-03-08T03:13:00,421   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-03-08T03:13:00,423   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-03-08T03:13:00,426   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-03-08T03:13:00,428   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-03-08T03:13:00,431   creating build/lib/deepspeed/ops
2024-03-08T03:13:00,432   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-03-08T03:13:00,435   creating build/lib/deepspeed/pipe
2024-03-08T03:13:00,436   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-03-08T03:13:00,439   creating build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,440   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,443   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,446   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,448   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,450   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,453   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,455   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,458   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,461   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,463   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-03-08T03:13:00,466   creating build/lib/deepspeed/monitor
2024-03-08T03:13:00,468   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-03-08T03:13:00,470   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-03-08T03:13:00,472   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-03-08T03:13:00,475   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-03-08T03:13:00,477   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-03-08T03:13:00,479   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-03-08T03:13:00,481   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-03-08T03:13:00,484   creating build/lib/deepspeed/compression
2024-03-08T03:13:00,485   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-03-08T03:13:00,487   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-03-08T03:13:00,490   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-03-08T03:13:00,493   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-03-08T03:13:00,495   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-03-08T03:13:00,498   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-03-08T03:13:00,500   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-03-08T03:13:00,503   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-03-08T03:13:00,506   creating build/lib/deepspeed/autotuning
2024-03-08T03:13:00,507   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-03-08T03:13:00,510   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-03-08T03:13:00,512   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-03-08T03:13:00,514   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-03-08T03:13:00,516   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-03-08T03:13:00,519   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-03-08T03:13:00,523   creating build/lib/deepspeed/sequence
2024-03-08T03:13:00,524   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-03-08T03:13:00,526   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-03-08T03:13:00,528   creating build/lib/deepspeed/accelerator
2024-03-08T03:13:00,529   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-03-08T03:13:00,532   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-03-08T03:13:00,534   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-03-08T03:13:00,536   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-03-08T03:13:00,538   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-03-08T03:13:00,540   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-03-08T03:13:00,542   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-03-08T03:13:00,545   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-03-08T03:13:00,547   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-03-08T03:13:00,550   creating build/lib/deepspeed/moe
2024-03-08T03:13:00,551   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-03-08T03:13:00,553   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-03-08T03:13:00,556   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-03-08T03:13:00,557   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-03-08T03:13:00,561   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-03-08T03:13:00,563   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-03-08T03:13:00,565   creating build/lib/deepspeed/profiling
2024-03-08T03:13:00,567   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-03-08T03:13:00,569   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-03-08T03:13:00,571   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-03-08T03:13:00,574   creating build/lib/deepspeed/utils
2024-03-08T03:13:00,576   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,578   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,580   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,582   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,585   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,588   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,591   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,593   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,595   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,598   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,601   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,604   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,606   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,608   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,610   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-03-08T03:13:00,614   creating build/lib/deepspeed/module_inject
2024-03-08T03:13:00,615   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,618   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,620   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,623   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,625   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,628   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,630   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,632   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,634   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,637   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,641   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,643   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,645   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-03-08T03:13:00,648   creating build/lib/deepspeed/nebula
2024-03-08T03:13:00,649   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-03-08T03:13:00,652   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-03-08T03:13:00,654   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-03-08T03:13:00,656   creating build/lib/deepspeed/model_implementations
2024-03-08T03:13:00,657   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-03-08T03:13:00,661   creating build/lib/deepspeed/runtime
2024-03-08T03:13:00,662   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,667   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,670   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,673   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,676   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,682   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,686   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,688   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,691   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,693   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,696   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,699   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,702   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,710   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,714   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,718   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,722   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-03-08T03:13:00,727   creating build/lib/deepspeed/launcher
2024-03-08T03:13:00,728   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-03-08T03:13:00,732   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-03-08T03:13:00,734   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-03-08T03:13:00,736   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-03-08T03:13:00,738   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-03-08T03:13:00,741   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-03-08T03:13:00,744   creating build/lib/deepspeed/inference
2024-03-08T03:13:00,746   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-03-08T03:13:00,749   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-03-08T03:13:00,751   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-03-08T03:13:00,755   creating build/lib/deepspeed/comm
2024-03-08T03:13:00,757   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-03-08T03:13:00,761   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-03-08T03:13:00,763   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-03-08T03:13:00,765   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-03-08T03:13:00,768   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-03-08T03:13:00,770   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-03-08T03:13:00,772   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-03-08T03:13:00,774   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-03-08T03:13:00,777   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-03-08T03:13:00,780   creating build/lib/deepspeed/elasticity
2024-03-08T03:13:00,781   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-03-08T03:13:00,784   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-03-08T03:13:00,786   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-03-08T03:13:00,789   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-03-08T03:13:00,791   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-03-08T03:13:00,794   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-03-08T03:13:00,797   creating build/lib/deepspeed/ops/deepspeed4science
2024-03-08T03:13:00,798   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-03-08T03:13:00,800   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-03-08T03:13:00,803   creating build/lib/deepspeed/ops/random_ltd
2024-03-08T03:13:00,804   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-03-08T03:13:00,807   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-03-08T03:13:00,810   creating build/lib/deepspeed/ops/quantizer
2024-03-08T03:13:00,811   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-03-08T03:13:00,813   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-03-08T03:13:00,816   creating build/lib/deepspeed/ops/lamb
2024-03-08T03:13:00,818   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-03-08T03:13:00,821   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-03-08T03:13:00,824   creating build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,825   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,830   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,832   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,836   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,839   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,842   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,845   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,848   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,851   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,854   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,857   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,860   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,863   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,866   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,869   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,871   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,874   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,877   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,880   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,883   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,886   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,889   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-03-08T03:13:00,892   creating build/lib/deepspeed/ops/adagrad
2024-03-08T03:13:00,894   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-03-08T03:13:00,898   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-03-08T03:13:00,902   creating build/lib/deepspeed/ops/lion
2024-03-08T03:13:00,904   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-03-08T03:13:00,908   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-03-08T03:13:00,911   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-03-08T03:13:00,914   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-03-08T03:13:00,918   creating build/lib/deepspeed/ops/adam
2024-03-08T03:13:00,920   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-03-08T03:13:00,924   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-03-08T03:13:00,927   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-03-08T03:13:00,930   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-03-08T03:13:00,934   creating build/lib/deepspeed/ops/aio
2024-03-08T03:13:00,936   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-03-08T03:13:00,939   creating build/lib/deepspeed/ops/transformer
2024-03-08T03:13:00,941   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-03-08T03:13:00,944   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-03-08T03:13:00,947   creating build/lib/deepspeed/ops/sparse_attention
2024-03-08T03:13:00,948   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-03-08T03:13:00,950   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-03-08T03:13:00,954   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-03-08T03:13:00,957   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-03-08T03:13:00,960   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-03-08T03:13:00,962   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-03-08T03:13:00,964   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-03-08T03:13:00,968   creating build/lib/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:00,969   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:00,972   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:00,974   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:00,976   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:00,978   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:00,982   creating build/lib/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:00,983   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:00,985   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:00,987   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:00,990   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:00,992   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:00,994   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:00,997   creating build/lib/deepspeed/ops/op_builder/npu
2024-03-08T03:13:00,998   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-03-08T03:13:01,000   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-03-08T03:13:01,002   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-03-08T03:13:01,004   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-03-08T03:13:01,007   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-03-08T03:13:01,009   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-03-08T03:13:01,011   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-03-08T03:13:01,013   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-03-08T03:13:01,016   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-03-08T03:13:01,019   creating build/lib/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:01,020   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:01,023   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:01,025   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:01,027   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:01,029   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:01,032   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:01,034   creating build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,036   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,039   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,041   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,044   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,047   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,049   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,051   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,053   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,056   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,058   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-03-08T03:13:01,060   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,061   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,064   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,066   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,069   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,071   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,073   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,076   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,078   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,080   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,083   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:01,085   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,087   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,089   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,091   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,093   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,095   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,097   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,099   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,101   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,103   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,105   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:01,107   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-03-08T03:13:01,108   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-03-08T03:13:01,111   creating build/lib/deepspeed/autotuning/tuner
2024-03-08T03:13:01,112   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-03-08T03:13:01,114   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-03-08T03:13:01,116   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-03-08T03:13:01,119   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-03-08T03:13:01,121   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-03-08T03:13:01,123   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-03-08T03:13:01,125   creating build/lib/deepspeed/profiling/flops_profiler
2024-03-08T03:13:01,126   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-03-08T03:13:01,129   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-03-08T03:13:01,132   creating build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,133   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,135   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,138   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,141   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,145   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,149   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,153   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,157   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,160   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,162   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,164   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,166   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,168   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,171   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,173   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,176   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,178   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,180   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,182   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-03-08T03:13:01,185   creating build/lib/deepspeed/module_inject/containers/features
2024-03-08T03:13:01,187   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-03-08T03:13:01,191   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-03-08T03:13:01,194   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-03-08T03:13:01,196   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-03-08T03:13:01,199   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-03-08T03:13:01,201   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-03-08T03:13:01,204   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-03-08T03:13:01,207   creating build/lib/deepspeed/model_implementations/features
2024-03-08T03:13:01,208   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-03-08T03:13:01,212   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-03-08T03:13:01,215   creating build/lib/deepspeed/model_implementations/diffusers
2024-03-08T03:13:01,216   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-03-08T03:13:01,217   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-03-08T03:13:01,220   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-03-08T03:13:01,222   creating build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,223   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,225   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,228   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,229   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,233   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,236   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,238   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,241   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,243   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,244   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-03-08T03:13:01,247   creating build/lib/deepspeed/runtime/pipe
2024-03-08T03:13:01,248   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-03-08T03:13:01,251   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-03-08T03:13:01,254   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-03-08T03:13:01,256   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-03-08T03:13:01,258   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-03-08T03:13:01,263   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-03-08T03:13:01,313   creating build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,314   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,318   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,321   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,324   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,326   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,329   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,333   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,335   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,337   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,339   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,346   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,351   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,354   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,357   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,359   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,361   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-03-08T03:13:01,364   creating build/lib/deepspeed/runtime/compression
2024-03-08T03:13:01,365   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-03-08T03:13:01,367   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-03-08T03:13:01,370   creating build/lib/deepspeed/runtime/fp16
2024-03-08T03:13:01,371   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-03-08T03:13:01,373   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-03-08T03:13:01,376   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-03-08T03:13:01,378   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-03-08T03:13:01,382   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-03-08T03:13:01,383   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-03-08T03:13:01,386   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-03-08T03:13:01,387   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-03-08T03:13:01,390   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-03-08T03:13:01,392   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-03-08T03:13:01,394   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-03-08T03:13:01,396   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-03-08T03:13:01,398   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-03-08T03:13:01,402   creating build/lib/deepspeed/runtime/swap_tensor
2024-03-08T03:13:01,403   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-03-08T03:13:01,405   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-03-08T03:13:01,407   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-03-08T03:13:01,409   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-03-08T03:13:01,412   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-03-08T03:13:01,414   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-03-08T03:13:01,416   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-03-08T03:13:01,418   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-03-08T03:13:01,421   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-03-08T03:13:01,424   creating build/lib/deepspeed/runtime/data_pipeline
2024-03-08T03:13:01,425   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-03-08T03:13:01,428   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-03-08T03:13:01,430   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-03-08T03:13:01,432   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-03-08T03:13:01,435   creating build/lib/deepspeed/runtime/comm
2024-03-08T03:13:01,436   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-03-08T03:13:01,439   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-03-08T03:13:01,442   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-03-08T03:13:01,443   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-03-08T03:13:01,446   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-03-08T03:13:01,449   creating build/lib/deepspeed/runtime/fp16/onebit
2024-03-08T03:13:01,450   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-03-08T03:13:01,452   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-03-08T03:13:01,454   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-03-08T03:13:01,457   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-03-08T03:13:01,461   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:01,462   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:01,467   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:01,470   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:01,472   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:01,475   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:01,478   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:01,480   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:01,482   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:01,484   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:01,487   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:01,490   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:01,492   creating build/lib/deepspeed/inference/v2
2024-03-08T03:13:01,494   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-03-08T03:13:01,496   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-03-08T03:13:01,498   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-03-08T03:13:01,500   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-03-08T03:13:01,502   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-03-08T03:13:01,720   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-03-08T03:13:01,723   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-03-08T03:13:01,725   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-03-08T03:13:01,728   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-03-08T03:13:01,731   creating build/lib/deepspeed/inference/quantization
2024-03-08T03:13:01,733   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-03-08T03:13:01,736   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-03-08T03:13:01,739   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-03-08T03:13:01,741   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-03-08T03:13:01,745   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-03-08T03:13:01,749   creating build/lib/deepspeed/inference/v2/checkpoint
2024-03-08T03:13:01,750   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-03-08T03:13:01,754   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-03-08T03:13:01,757   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-03-08T03:13:01,760   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-03-08T03:13:01,764   creating build/lib/deepspeed/inference/v2/ragged
2024-03-08T03:13:01,766   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-03-08T03:13:01,770   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-03-08T03:13:01,774   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-03-08T03:13:01,778   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-03-08T03:13:01,782   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-03-08T03:13:01,785   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-03-08T03:13:01,788   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-03-08T03:13:01,792   creating build/lib/deepspeed/inference/v2/modules
2024-03-08T03:13:01,794   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-03-08T03:13:01,797   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-03-08T03:13:01,800   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-03-08T03:13:01,803   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-03-08T03:13:01,807   creating build/lib/deepspeed/inference/v2/kernels
2024-03-08T03:13:01,808   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-03-08T03:13:01,811   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-03-08T03:13:01,814   creating build/lib/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:01,816   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:01,820   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:01,823   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:01,827   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:01,830   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:01,833   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:01,836   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:01,842   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:01,843   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:01,848   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:01,851   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:01,855   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:01,858   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:01,860   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:01,862   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:01,865   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:01,867   creating build/lib/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:01,868   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:01,870   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:01,872   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:01,874   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:01,876   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:01,878   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:01,880   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:01,883   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-03-08T03:13:01,883   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-03-08T03:13:01,886   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-03-08T03:13:01,886   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-03-08T03:13:01,888   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-03-08T03:13:01,890   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-03-08T03:13:01,891   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-03-08T03:13:01,893   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-03-08T03:13:01,896   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-03-08T03:13:01,897   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-03-08T03:13:01,899   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-03-08T03:13:01,900   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-03-08T03:13:01,903   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-03-08T03:13:01,904   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-03-08T03:13:01,906   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-03-08T03:13:01,908   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-03-08T03:13:01,908   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-03-08T03:13:01,911   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-03-08T03:13:01,914   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-03-08T03:13:01,915   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-03-08T03:13:01,917   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-03-08T03:13:01,920   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-03-08T03:13:01,922   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-03-08T03:13:01,924   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-03-08T03:13:01,926   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-03-08T03:13:01,928   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-03-08T03:13:01,929   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-03-08T03:13:01,932   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-03-08T03:13:01,932   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-03-08T03:13:01,935   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-03-08T03:13:01,936   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-03-08T03:13:01,938   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:01,939   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:01,941   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:01,943   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:01,944   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:01,946   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:01,948   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:01,951   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:01,954   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:01,955   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:01,958   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:01,960   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:01,962   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:01,965   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:01,967   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:01,968   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:01,970   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:01,972   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-03-08T03:13:01,973   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-03-08T03:13:01,976   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-03-08T03:13:01,979   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:01,980   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:01,982   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:01,985   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:01,987   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:01,989   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:01,991   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:01,994   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:01,995   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:01,997   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:02,000   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:02,001   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:02,003   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:02,005   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:02,007   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:02,010   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:02,011   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:02,013   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:02,016   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:02,017   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:02,020   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:02,023   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:02,025   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:02,028   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:02,031   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:02,032   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:02,034   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:02,036   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-03-08T03:13:02,037   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-03-08T03:13:02,039   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-03-08T03:13:02,042   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:02,043   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:02,045   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:02,048   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:02,049   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:02,052   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:02,055   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-03-08T03:13:02,056   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-03-08T03:13:02,058   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-03-08T03:13:02,060   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-03-08T03:13:02,062   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-03-08T03:13:02,064   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-03-08T03:13:02,065   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-03-08T03:13:02,067   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-03-08T03:13:02,069   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-03-08T03:13:02,071   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-03-08T03:13:02,075   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-03-08T03:13:02,076   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-03-08T03:13:02,078   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-03-08T03:13:02,081   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-03-08T03:13:02,083   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-03-08T03:13:02,087   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:02,088   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:02,090   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:02,093   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:02,095   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:02,097   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:02,100   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:02,102   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:02,105   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:02,108   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:02,111   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-03-08T03:13:02,113   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-03-08T03:13:02,116   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-03-08T03:13:02,118   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-03-08T03:13:02,121   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-03-08T03:13:02,125   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-03-08T03:13:02,126   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-03-08T03:13:02,129   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-03-08T03:13:02,132   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-03-08T03:13:02,134   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-03-08T03:13:02,138   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-03-08T03:13:02,139   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-03-08T03:13:02,143   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-03-08T03:13:02,146   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-03-08T03:13:02,148   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-03-08T03:13:02,151   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-03-08T03:13:02,152   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-03-08T03:13:02,155   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-03-08T03:13:02,157   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-03-08T03:13:02,159   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-03-08T03:13:02,163   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:02,164   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:02,167   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:02,172   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:02,175   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:02,178   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:02,181   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:02,183   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:02,184   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:02,186   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:02,188   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-03-08T03:13:02,190   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-03-08T03:13:02,191   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-03-08T03:13:02,193   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-03-08T03:13:02,195   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-03-08T03:13:02,198   running egg_info
2024-03-08T03:13:02,249   writing deepspeed.egg-info/PKG-INFO
2024-03-08T03:13:02,281   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-03-08T03:13:02,283   writing entry points to deepspeed.egg-info/entry_points.txt
2024-03-08T03:13:02,299   writing requirements to deepspeed.egg-info/requires.txt
2024-03-08T03:13:02,301   writing top-level names to deepspeed.egg-info/top_level.txt
2024-03-08T03:13:02,423   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-03-08T03:13:02,470   reading manifest template 'MANIFEST.in'
2024-03-08T03:13:02,472   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-03-08T03:13:02,472   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-03-08T03:13:03,799   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-03-08T03:13:05,190   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-03-08T03:13:05,866   warning: no files found matching '*.tr' under directory 'csrc'
2024-03-08T03:13:05,986   warning: no files found matching '*.cc' under directory 'csrc'
2024-03-08T03:13:06,022   warning: no files found matching '*.py' under directory 'benchmarks'
2024-03-08T03:13:06,070   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-03-08T03:13:06,079   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-03-08T03:13:06,079   !!

2024-03-08T03:13:06,081           ********************************************************************************
2024-03-08T03:13:06,081           ############################
2024-03-08T03:13:06,082           # Package would be ignored #
2024-03-08T03:13:06,082           ############################
2024-03-08T03:13:06,083           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-03-08T03:13:06,084           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,085           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,086           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-03-08T03:13:06,086           to the `packages` configuration field.

2024-03-08T03:13:06,087           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,088           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,088           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,089           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,090           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,092           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-03-08T03:13:06,092           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-03-08T03:13:06,093           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,093           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,094           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,095           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,096           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,097           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,097                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,098                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,098                 directory, all directories are treated like packages.
2024-03-08T03:13:06,099           ********************************************************************************

2024-03-08T03:13:06,100   !!
2024-03-08T03:13:06,100     check.warn(importable)
2024-03-08T03:13:06,101   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-03-08T03:13:06,102   !!

2024-03-08T03:13:06,103           ********************************************************************************
2024-03-08T03:13:06,104           ############################
2024-03-08T03:13:06,104           # Package would be ignored #
2024-03-08T03:13:06,105           ############################
2024-03-08T03:13:06,106           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-03-08T03:13:06,106           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,107           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,108           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-03-08T03:13:06,108           to the `packages` configuration field.

2024-03-08T03:13:06,110           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,110           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,111           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,112           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,113           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,114           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-03-08T03:13:06,114           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-03-08T03:13:06,115           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,116           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,117           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,118           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,119           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,121           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,121                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,122                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,122                 directory, all directories are treated like packages.
2024-03-08T03:13:06,122           ********************************************************************************

2024-03-08T03:13:06,123   !!
2024-03-08T03:13:06,124     check.warn(importable)
2024-03-08T03:13:06,124   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-03-08T03:13:06,124   !!

2024-03-08T03:13:06,125           ********************************************************************************
2024-03-08T03:13:06,125           ############################
2024-03-08T03:13:06,126           # Package would be ignored #
2024-03-08T03:13:06,126           ############################
2024-03-08T03:13:06,126           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-03-08T03:13:06,127           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,128           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,129           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-03-08T03:13:06,129           to the `packages` configuration field.

2024-03-08T03:13:06,130           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,131           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,131           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,132           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,133           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,134           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-03-08T03:13:06,135           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-03-08T03:13:06,135           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,136           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,136           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,137           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,138           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,140           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,141                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,141                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,142                 directory, all directories are treated like packages.
2024-03-08T03:13:06,142           ********************************************************************************

2024-03-08T03:13:06,144   !!
2024-03-08T03:13:06,144     check.warn(importable)
2024-03-08T03:13:06,145   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-03-08T03:13:06,145   !!

2024-03-08T03:13:06,146           ********************************************************************************
2024-03-08T03:13:06,146           ############################
2024-03-08T03:13:06,147           # Package would be ignored #
2024-03-08T03:13:06,147           ############################
2024-03-08T03:13:06,147           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-03-08T03:13:06,148           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,148           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,149           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-03-08T03:13:06,149           to the `packages` configuration field.

2024-03-08T03:13:06,150           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,150           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,151           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,151           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,152           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,153           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-03-08T03:13:06,154           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-03-08T03:13:06,154           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,155           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,155           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,156           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,157           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,159           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,159                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,160                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,160                 directory, all directories are treated like packages.
2024-03-08T03:13:06,161           ********************************************************************************

2024-03-08T03:13:06,162   !!
2024-03-08T03:13:06,162     check.warn(importable)
2024-03-08T03:13:06,163   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-03-08T03:13:06,163   !!

2024-03-08T03:13:06,164           ********************************************************************************
2024-03-08T03:13:06,164           ############################
2024-03-08T03:13:06,165           # Package would be ignored #
2024-03-08T03:13:06,166           ############################
2024-03-08T03:13:06,166           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-03-08T03:13:06,167           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,168           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,168           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-03-08T03:13:06,169           to the `packages` configuration field.

2024-03-08T03:13:06,170           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,171           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,171           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,173           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,173           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,174           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-03-08T03:13:06,175           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-03-08T03:13:06,175           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,175           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,176           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,177           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,178           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,180           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,180                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,181                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,181                 directory, all directories are treated like packages.
2024-03-08T03:13:06,182           ********************************************************************************

2024-03-08T03:13:06,183   !!
2024-03-08T03:13:06,183     check.warn(importable)
2024-03-08T03:13:06,184   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-03-08T03:13:06,184   !!

2024-03-08T03:13:06,185           ********************************************************************************
2024-03-08T03:13:06,185           ############################
2024-03-08T03:13:06,186           # Package would be ignored #
2024-03-08T03:13:06,186           ############################
2024-03-08T03:13:06,187           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-03-08T03:13:06,187           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,188           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,189           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-03-08T03:13:06,190           to the `packages` configuration field.

2024-03-08T03:13:06,191           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,191           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,192           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,193           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,194           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,194           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-03-08T03:13:06,195           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-03-08T03:13:06,195           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,196           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,196           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,198           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,199           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,200           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,200                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,201                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,201                 directory, all directories are treated like packages.
2024-03-08T03:13:06,201           ********************************************************************************

2024-03-08T03:13:06,202   !!
2024-03-08T03:13:06,203     check.warn(importable)
2024-03-08T03:13:06,203   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-03-08T03:13:06,203   !!

2024-03-08T03:13:06,204           ********************************************************************************
2024-03-08T03:13:06,204           ############################
2024-03-08T03:13:06,205           # Package would be ignored #
2024-03-08T03:13:06,205           ############################
2024-03-08T03:13:06,205           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-03-08T03:13:06,206           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,207           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,207           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-03-08T03:13:06,208           to the `packages` configuration field.

2024-03-08T03:13:06,209           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,209           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,210           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,210           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,212           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,213           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-03-08T03:13:06,213           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-03-08T03:13:06,214           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,214           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,215           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,216           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,217           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,218           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,219                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,219                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,220                 directory, all directories are treated like packages.
2024-03-08T03:13:06,220           ********************************************************************************

2024-03-08T03:13:06,221   !!
2024-03-08T03:13:06,222     check.warn(importable)
2024-03-08T03:13:06,222   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-03-08T03:13:06,223   !!

2024-03-08T03:13:06,224           ********************************************************************************
2024-03-08T03:13:06,225           ############################
2024-03-08T03:13:06,225           # Package would be ignored #
2024-03-08T03:13:06,226           ############################
2024-03-08T03:13:06,227           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-03-08T03:13:06,227           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,228           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,228           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-03-08T03:13:06,228           to the `packages` configuration field.

2024-03-08T03:13:06,229           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,230           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,230           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,231           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,232           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,232           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-03-08T03:13:06,233           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-03-08T03:13:06,233           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,233           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,234           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,235           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,236           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,238           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,238                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,239                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,239                 directory, all directories are treated like packages.
2024-03-08T03:13:06,240           ********************************************************************************

2024-03-08T03:13:06,241   !!
2024-03-08T03:13:06,241     check.warn(importable)
2024-03-08T03:13:06,242   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-03-08T03:13:06,242   !!

2024-03-08T03:13:06,244           ********************************************************************************
2024-03-08T03:13:06,244           ############################
2024-03-08T03:13:06,245           # Package would be ignored #
2024-03-08T03:13:06,245           ############################
2024-03-08T03:13:06,246           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-03-08T03:13:06,246           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,248           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,248           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-03-08T03:13:06,249           to the `packages` configuration field.

2024-03-08T03:13:06,250           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,250           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,251           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,252           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,253           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,254           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-03-08T03:13:06,255           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-03-08T03:13:06,256           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,257           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,257           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,258           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,259           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,260           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,260                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,261                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,261                 directory, all directories are treated like packages.
2024-03-08T03:13:06,261           ********************************************************************************

2024-03-08T03:13:06,262   !!
2024-03-08T03:13:06,263     check.warn(importable)
2024-03-08T03:13:06,263   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-03-08T03:13:06,264   !!

2024-03-08T03:13:06,265           ********************************************************************************
2024-03-08T03:13:06,265           ############################
2024-03-08T03:13:06,265           # Package would be ignored #
2024-03-08T03:13:06,266           ############################
2024-03-08T03:13:06,267           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-03-08T03:13:06,267           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,268           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,268           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-03-08T03:13:06,269           to the `packages` configuration field.

2024-03-08T03:13:06,270           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,271           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,271           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,272           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,274           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,275           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-03-08T03:13:06,275           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-03-08T03:13:06,276           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,276           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,277           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,278           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,279           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,280           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,281                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,281                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,282                 directory, all directories are treated like packages.
2024-03-08T03:13:06,282           ********************************************************************************

2024-03-08T03:13:06,284   !!
2024-03-08T03:13:06,284     check.warn(importable)
2024-03-08T03:13:06,285   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-03-08T03:13:06,286   !!

2024-03-08T03:13:06,286           ********************************************************************************
2024-03-08T03:13:06,287           ############################
2024-03-08T03:13:06,287           # Package would be ignored #
2024-03-08T03:13:06,287           ############################
2024-03-08T03:13:06,288           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-03-08T03:13:06,288           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,289           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,289           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-03-08T03:13:06,290           to the `packages` configuration field.

2024-03-08T03:13:06,290           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,291           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,291           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,292           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,293           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,293           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-03-08T03:13:06,294           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-03-08T03:13:06,294           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,295           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,295           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,296           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,297           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,299           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,300                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,300                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,301                 directory, all directories are treated like packages.
2024-03-08T03:13:06,301           ********************************************************************************

2024-03-08T03:13:06,302   !!
2024-03-08T03:13:06,303     check.warn(importable)
2024-03-08T03:13:06,303   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-03-08T03:13:06,304   !!

2024-03-08T03:13:06,305           ********************************************************************************
2024-03-08T03:13:06,305           ############################
2024-03-08T03:13:06,305           # Package would be ignored #
2024-03-08T03:13:06,306           ############################
2024-03-08T03:13:06,306           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-03-08T03:13:06,307           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,308           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,308           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-03-08T03:13:06,309           to the `packages` configuration field.

2024-03-08T03:13:06,310           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,310           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,311           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,312           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,313           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,314           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-03-08T03:13:06,315           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-03-08T03:13:06,315           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,316           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,316           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,317           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,318           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,320           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,320                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,321                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,321                 directory, all directories are treated like packages.
2024-03-08T03:13:06,322           ********************************************************************************

2024-03-08T03:13:06,323   !!
2024-03-08T03:13:06,324     check.warn(importable)
2024-03-08T03:13:06,325   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-03-08T03:13:06,325   !!

2024-03-08T03:13:06,326           ********************************************************************************
2024-03-08T03:13:06,327           ############################
2024-03-08T03:13:06,327           # Package would be ignored #
2024-03-08T03:13:06,328           ############################
2024-03-08T03:13:06,329           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-03-08T03:13:06,329           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,331           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,331           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-03-08T03:13:06,332           to the `packages` configuration field.

2024-03-08T03:13:06,333           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,338           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,339           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,340           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,342           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,343           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-03-08T03:13:06,344           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-03-08T03:13:06,345           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,345           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,346           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,347           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,348           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,350           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,351                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,353                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,353                 directory, all directories are treated like packages.
2024-03-08T03:13:06,354           ********************************************************************************

2024-03-08T03:13:06,355   !!
2024-03-08T03:13:06,355     check.warn(importable)
2024-03-08T03:13:06,356   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration.
2024-03-08T03:13:06,356   !!

2024-03-08T03:13:06,357           ********************************************************************************
2024-03-08T03:13:06,358           ############################
2024-03-08T03:13:06,358           # Package would be ignored #
2024-03-08T03:13:06,359           ############################
2024-03-08T03:13:06,359           Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1],
2024-03-08T03:13:06,360           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,361           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,361           package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added
2024-03-08T03:13:06,362           to the `packages` configuration field.

2024-03-08T03:13:06,363           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,363           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,364           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,365           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,366           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,368           If you don't want 'deepspeed.ops.csrc.common' to be distributed and are
2024-03-08T03:13:06,368           already explicitly excluding 'deepspeed.ops.csrc.common' via
2024-03-08T03:13:06,369           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,370           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,370           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,372           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,373           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,375           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,375                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,376                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,377                 directory, all directories are treated like packages.
2024-03-08T03:13:06,377           ********************************************************************************

2024-03-08T03:13:06,378   !!
2024-03-08T03:13:06,379     check.warn(importable)
2024-03-08T03:13:06,380   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-03-08T03:13:06,380   !!

2024-03-08T03:13:06,382           ********************************************************************************
2024-03-08T03:13:06,382           ############################
2024-03-08T03:13:06,383           # Package would be ignored #
2024-03-08T03:13:06,384           ############################
2024-03-08T03:13:06,384           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-03-08T03:13:06,385           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,387           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,387           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-03-08T03:13:06,388           to the `packages` configuration field.

2024-03-08T03:13:06,389           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,389           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,390           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,391           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,392           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,393           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-03-08T03:13:06,394           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-03-08T03:13:06,394           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,395           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,395           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,396           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,397           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,399           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,399                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,400                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,400                 directory, all directories are treated like packages.
2024-03-08T03:13:06,401           ********************************************************************************

2024-03-08T03:13:06,402   !!
2024-03-08T03:13:06,403     check.warn(importable)
2024-03-08T03:13:06,404   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-03-08T03:13:06,405   !!

2024-03-08T03:13:06,406           ********************************************************************************
2024-03-08T03:13:06,407           ############################
2024-03-08T03:13:06,407           # Package would be ignored #
2024-03-08T03:13:06,408           ############################
2024-03-08T03:13:06,409           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-03-08T03:13:06,409           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,411           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,411           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-03-08T03:13:06,412           to the `packages` configuration field.

2024-03-08T03:13:06,413           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,414           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,415           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,416           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,417           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,418           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-03-08T03:13:06,419           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-03-08T03:13:06,419           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,420           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,421           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,422           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,423           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,424           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,425                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,425                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,426                 directory, all directories are treated like packages.
2024-03-08T03:13:06,426           ********************************************************************************

2024-03-08T03:13:06,428   !!
2024-03-08T03:13:06,428     check.warn(importable)
2024-03-08T03:13:06,429   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-03-08T03:13:06,429   !!

2024-03-08T03:13:06,430           ********************************************************************************
2024-03-08T03:13:06,431           ############################
2024-03-08T03:13:06,432           # Package would be ignored #
2024-03-08T03:13:06,432           ############################
2024-03-08T03:13:06,433           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-03-08T03:13:06,433           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,435           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,435           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-03-08T03:13:06,436           to the `packages` configuration field.

2024-03-08T03:13:06,437           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,438           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,438           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,440           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,441           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,442           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-03-08T03:13:06,442           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-03-08T03:13:06,443           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,444           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,444           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,445           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,447           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,448           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,449                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,450                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,450                 directory, all directories are treated like packages.
2024-03-08T03:13:06,451           ********************************************************************************

2024-03-08T03:13:06,452   !!
2024-03-08T03:13:06,453     check.warn(importable)
2024-03-08T03:13:06,454   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-03-08T03:13:06,454   !!

2024-03-08T03:13:06,456           ********************************************************************************
2024-03-08T03:13:06,456           ############################
2024-03-08T03:13:06,457           # Package would be ignored #
2024-03-08T03:13:06,458           ############################
2024-03-08T03:13:06,458           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-03-08T03:13:06,459           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,460           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,460           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-03-08T03:13:06,461           to the `packages` configuration field.

2024-03-08T03:13:06,462           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,463           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,463           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,464           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,465           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,466           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-03-08T03:13:06,467           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-03-08T03:13:06,467           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,468           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,468           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,470           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,471           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,472           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,473                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,474                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,474                 directory, all directories are treated like packages.
2024-03-08T03:13:06,475           ********************************************************************************

2024-03-08T03:13:06,477   !!
2024-03-08T03:13:06,477     check.warn(importable)
2024-03-08T03:13:06,478   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-03-08T03:13:06,479   !!

2024-03-08T03:13:06,481           ********************************************************************************
2024-03-08T03:13:06,481           ############################
2024-03-08T03:13:06,482           # Package would be ignored #
2024-03-08T03:13:06,483           ############################
2024-03-08T03:13:06,483           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-03-08T03:13:06,484           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,485           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,486           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-03-08T03:13:06,486           to the `packages` configuration field.

2024-03-08T03:13:06,488           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,489           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,489           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,491           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,492           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,493           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-03-08T03:13:06,494           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-03-08T03:13:06,494           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,495           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,495           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,496           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,498           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,499           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,500                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,500                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,501                 directory, all directories are treated like packages.
2024-03-08T03:13:06,501           ********************************************************************************

2024-03-08T03:13:06,502   !!
2024-03-08T03:13:06,503     check.warn(importable)
2024-03-08T03:13:06,503   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-03-08T03:13:06,504   !!

2024-03-08T03:13:06,505           ********************************************************************************
2024-03-08T03:13:06,506           ############################
2024-03-08T03:13:06,507           # Package would be ignored #
2024-03-08T03:13:06,507           ############################
2024-03-08T03:13:06,508           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-03-08T03:13:06,509           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,510           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,511           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-03-08T03:13:06,511           to the `packages` configuration field.

2024-03-08T03:13:06,513           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,513           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,514           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,515           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,516           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,517           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-03-08T03:13:06,518           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-03-08T03:13:06,518           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,519           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,519           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,520           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,522           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,523           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,524                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,525                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,525                 directory, all directories are treated like packages.
2024-03-08T03:13:06,526           ********************************************************************************

2024-03-08T03:13:06,527   !!
2024-03-08T03:13:06,527     check.warn(importable)
2024-03-08T03:13:06,528   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-03-08T03:13:06,528   !!

2024-03-08T03:13:06,529           ********************************************************************************
2024-03-08T03:13:06,530           ############################
2024-03-08T03:13:06,530           # Package would be ignored #
2024-03-08T03:13:06,531           ############################
2024-03-08T03:13:06,531           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-03-08T03:13:06,531           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,532           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,533           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-03-08T03:13:06,533           to the `packages` configuration field.

2024-03-08T03:13:06,534           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,535           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,536           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,537           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,538           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,539           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-03-08T03:13:06,540           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-03-08T03:13:06,540           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,541           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,541           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,543           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,544           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,546           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,547                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,548                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,548                 directory, all directories are treated like packages.
2024-03-08T03:13:06,549           ********************************************************************************

2024-03-08T03:13:06,550   !!
2024-03-08T03:13:06,551     check.warn(importable)
2024-03-08T03:13:06,551   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-03-08T03:13:06,552   !!

2024-03-08T03:13:06,553           ********************************************************************************
2024-03-08T03:13:06,554           ############################
2024-03-08T03:13:06,554           # Package would be ignored #
2024-03-08T03:13:06,555           ############################
2024-03-08T03:13:06,555           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-03-08T03:13:06,556           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,557           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,558           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-03-08T03:13:06,558           to the `packages` configuration field.

2024-03-08T03:13:06,559           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,560           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,560           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,561           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,563           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,564           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-03-08T03:13:06,564           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-03-08T03:13:06,565           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,565           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,566           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,567           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,568           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,569           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,570                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,571                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,571                 directory, all directories are treated like packages.
2024-03-08T03:13:06,572           ********************************************************************************

2024-03-08T03:13:06,574   !!
2024-03-08T03:13:06,574     check.warn(importable)
2024-03-08T03:13:06,575   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-03-08T03:13:06,576   !!

2024-03-08T03:13:06,578           ********************************************************************************
2024-03-08T03:13:06,578           ############################
2024-03-08T03:13:06,579           # Package would be ignored #
2024-03-08T03:13:06,580           ############################
2024-03-08T03:13:06,581           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-03-08T03:13:06,581           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,583           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,583           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-03-08T03:13:06,584           to the `packages` configuration field.

2024-03-08T03:13:06,585           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,586           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,586           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,587           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,589           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,590           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-03-08T03:13:06,590           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-03-08T03:13:06,591           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,592           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,592           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,593           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,594           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,596           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,596                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,597                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,597                 directory, all directories are treated like packages.
2024-03-08T03:13:06,598           ********************************************************************************

2024-03-08T03:13:06,599   !!
2024-03-08T03:13:06,599     check.warn(importable)
2024-03-08T03:13:06,600   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-03-08T03:13:06,600   !!

2024-03-08T03:13:06,601           ********************************************************************************
2024-03-08T03:13:06,602           ############################
2024-03-08T03:13:06,602           # Package would be ignored #
2024-03-08T03:13:06,603           ############################
2024-03-08T03:13:06,603           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-03-08T03:13:06,604           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,605           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,605           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-03-08T03:13:06,606           to the `packages` configuration field.

2024-03-08T03:13:06,607           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,607           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,608           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,609           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,610           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,611           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-03-08T03:13:06,611           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-03-08T03:13:06,612           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,612           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,613           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,614           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,615           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,617           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,617                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,618                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,619                 directory, all directories are treated like packages.
2024-03-08T03:13:06,619           ********************************************************************************

2024-03-08T03:13:06,620   !!
2024-03-08T03:13:06,621     check.warn(importable)
2024-03-08T03:13:06,622   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-03-08T03:13:06,623   !!

2024-03-08T03:13:06,624           ********************************************************************************
2024-03-08T03:13:06,624           ############################
2024-03-08T03:13:06,625           # Package would be ignored #
2024-03-08T03:13:06,625           ############################
2024-03-08T03:13:06,626           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-03-08T03:13:06,626           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,627           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,628           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-03-08T03:13:06,628           to the `packages` configuration field.

2024-03-08T03:13:06,629           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,630           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,630           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,631           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,632           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,633           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-03-08T03:13:06,634           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-03-08T03:13:06,634           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,635           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,635           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,636           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,637           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,639           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,639                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,640                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,640                 directory, all directories are treated like packages.
2024-03-08T03:13:06,641           ********************************************************************************

2024-03-08T03:13:06,642   !!
2024-03-08T03:13:06,642     check.warn(importable)
2024-03-08T03:13:06,643   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-03-08T03:13:06,643   !!

2024-03-08T03:13:06,644           ********************************************************************************
2024-03-08T03:13:06,645           ############################
2024-03-08T03:13:06,645           # Package would be ignored #
2024-03-08T03:13:06,646           ############################
2024-03-08T03:13:06,646           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-03-08T03:13:06,647           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,648           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,648           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-03-08T03:13:06,649           to the `packages` configuration field.

2024-03-08T03:13:06,650           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,651           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,651           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,652           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,653           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,654           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-03-08T03:13:06,654           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-03-08T03:13:06,655           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,655           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,656           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,657           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,658           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,659           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,660                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,660                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,661                 directory, all directories are treated like packages.
2024-03-08T03:13:06,661           ********************************************************************************

2024-03-08T03:13:06,662   !!
2024-03-08T03:13:06,663     check.warn(importable)
2024-03-08T03:13:06,664   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-03-08T03:13:06,664   !!

2024-03-08T03:13:06,665           ********************************************************************************
2024-03-08T03:13:06,666           ############################
2024-03-08T03:13:06,666           # Package would be ignored #
2024-03-08T03:13:06,667           ############################
2024-03-08T03:13:06,668           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-03-08T03:13:06,669           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,670           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,670           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-03-08T03:13:06,671           to the `packages` configuration field.

2024-03-08T03:13:06,672           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,672           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,673           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,674           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,675           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,676           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-03-08T03:13:06,676           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-03-08T03:13:06,677           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,677           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,678           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,679           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,680           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,682           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,682                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,683                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,684                 directory, all directories are treated like packages.
2024-03-08T03:13:06,684           ********************************************************************************

2024-03-08T03:13:06,685   !!
2024-03-08T03:13:06,685     check.warn(importable)
2024-03-08T03:13:06,686   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-03-08T03:13:06,686   !!

2024-03-08T03:13:06,687           ********************************************************************************
2024-03-08T03:13:06,688           ############################
2024-03-08T03:13:06,688           # Package would be ignored #
2024-03-08T03:13:06,689           ############################
2024-03-08T03:13:06,690           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-03-08T03:13:06,690           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,691           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,692           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-03-08T03:13:06,692           to the `packages` configuration field.

2024-03-08T03:13:06,693           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,693           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,694           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,695           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,696           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,697           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-03-08T03:13:06,698           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-03-08T03:13:06,698           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,699           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,699           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,700           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,701           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,703           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,703                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,704                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,704                 directory, all directories are treated like packages.
2024-03-08T03:13:06,705           ********************************************************************************

2024-03-08T03:13:06,706   !!
2024-03-08T03:13:06,707     check.warn(importable)
2024-03-08T03:13:06,708   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-03-08T03:13:06,708   !!

2024-03-08T03:13:06,709           ********************************************************************************
2024-03-08T03:13:06,710           ############################
2024-03-08T03:13:06,710           # Package would be ignored #
2024-03-08T03:13:06,711           ############################
2024-03-08T03:13:06,712           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-03-08T03:13:06,712           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,714           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,714           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-03-08T03:13:06,715           to the `packages` configuration field.

2024-03-08T03:13:06,716           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,717           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,717           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,719           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,721           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,722           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-03-08T03:13:06,723           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-03-08T03:13:06,723           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,724           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,726           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,727           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,728           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,730           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,730                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,731                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,731                 directory, all directories are treated like packages.
2024-03-08T03:13:06,732           ********************************************************************************

2024-03-08T03:13:06,733   !!
2024-03-08T03:13:06,733     check.warn(importable)
2024-03-08T03:13:06,734   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-03-08T03:13:06,734   !!

2024-03-08T03:13:06,735           ********************************************************************************
2024-03-08T03:13:06,736           ############################
2024-03-08T03:13:06,737           # Package would be ignored #
2024-03-08T03:13:06,737           ############################
2024-03-08T03:13:06,738           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-03-08T03:13:06,739           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,740           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,741           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-03-08T03:13:06,741           to the `packages` configuration field.

2024-03-08T03:13:06,742           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,743           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,743           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,744           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,745           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,746           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-03-08T03:13:06,747           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-03-08T03:13:06,747           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,748           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,749           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,750           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,750           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,752           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,753                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,753                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,754                 directory, all directories are treated like packages.
2024-03-08T03:13:06,754           ********************************************************************************

2024-03-08T03:13:06,756   !!
2024-03-08T03:13:06,756     check.warn(importable)
2024-03-08T03:13:06,757   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-03-08T03:13:06,757   !!

2024-03-08T03:13:06,758           ********************************************************************************
2024-03-08T03:13:06,759           ############################
2024-03-08T03:13:06,760           # Package would be ignored #
2024-03-08T03:13:06,760           ############################
2024-03-08T03:13:06,761           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-03-08T03:13:06,761           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,763           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,763           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-03-08T03:13:06,764           to the `packages` configuration field.

2024-03-08T03:13:06,765           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,765           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,766           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,767           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,769           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,770           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-03-08T03:13:06,771           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-03-08T03:13:06,772           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,774           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,820           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,821           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,823           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,824           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,825                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,826                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,826                 directory, all directories are treated like packages.
2024-03-08T03:13:06,827           ********************************************************************************

2024-03-08T03:13:06,828   !!
2024-03-08T03:13:06,829     check.warn(importable)
2024-03-08T03:13:06,829   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-03-08T03:13:06,830   !!

2024-03-08T03:13:06,831           ********************************************************************************
2024-03-08T03:13:06,831           ############################
2024-03-08T03:13:06,832           # Package would be ignored #
2024-03-08T03:13:06,833           ############################
2024-03-08T03:13:06,833           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-03-08T03:13:06,834           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,835           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,835           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-03-08T03:13:06,835           to the `packages` configuration field.

2024-03-08T03:13:06,836           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,837           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,837           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,838           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,839           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,840           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-03-08T03:13:06,841           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-03-08T03:13:06,842           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,842           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,843           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,845           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,846           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,847           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,848                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,848                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,849                 directory, all directories are treated like packages.
2024-03-08T03:13:06,849           ********************************************************************************

2024-03-08T03:13:06,851   !!
2024-03-08T03:13:06,851     check.warn(importable)
2024-03-08T03:13:06,852   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-03-08T03:13:06,852   !!

2024-03-08T03:13:06,854           ********************************************************************************
2024-03-08T03:13:06,854           ############################
2024-03-08T03:13:06,854           # Package would be ignored #
2024-03-08T03:13:06,855           ############################
2024-03-08T03:13:06,856           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-03-08T03:13:06,856           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,858           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,858           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-03-08T03:13:06,859           to the `packages` configuration field.

2024-03-08T03:13:06,860           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,861           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,861           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,863           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,864           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,865           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-03-08T03:13:06,865           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-03-08T03:13:06,865           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,866           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,866           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,867           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,868           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,869           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,870                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,870                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,871                 directory, all directories are treated like packages.
2024-03-08T03:13:06,872           ********************************************************************************

2024-03-08T03:13:06,872   !!
2024-03-08T03:13:06,873     check.warn(importable)
2024-03-08T03:13:06,873   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-03-08T03:13:06,874   !!

2024-03-08T03:13:06,875           ********************************************************************************
2024-03-08T03:13:06,876           ############################
2024-03-08T03:13:06,876           # Package would be ignored #
2024-03-08T03:13:06,877           ############################
2024-03-08T03:13:06,877           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-03-08T03:13:06,878           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,879           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,879           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-03-08T03:13:06,880           to the `packages` configuration field.

2024-03-08T03:13:06,881           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,881           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,882           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,883           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,884           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,885           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-03-08T03:13:06,885           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-03-08T03:13:06,886           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,887           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,887           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,889           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,890           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,893           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,893                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,894                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,895                 directory, all directories are treated like packages.
2024-03-08T03:13:06,896           ********************************************************************************

2024-03-08T03:13:06,897   !!
2024-03-08T03:13:06,898     check.warn(importable)
2024-03-08T03:13:06,899   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-03-08T03:13:06,900   !!

2024-03-08T03:13:06,900           ********************************************************************************
2024-03-08T03:13:06,901           ############################
2024-03-08T03:13:06,901           # Package would be ignored #
2024-03-08T03:13:06,902           ############################
2024-03-08T03:13:06,903           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-03-08T03:13:06,903           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,904           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,905           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-03-08T03:13:06,905           to the `packages` configuration field.

2024-03-08T03:13:06,907           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,907           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,908           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,909           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,910           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,911           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-03-08T03:13:06,911           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-03-08T03:13:06,912           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,912           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,913           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,913           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,914           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,916           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,917                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,917                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,918                 directory, all directories are treated like packages.
2024-03-08T03:13:06,918           ********************************************************************************

2024-03-08T03:13:06,919   !!
2024-03-08T03:13:06,920     check.warn(importable)
2024-03-08T03:13:06,920   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-03-08T03:13:06,921   !!

2024-03-08T03:13:06,922           ********************************************************************************
2024-03-08T03:13:06,922           ############################
2024-03-08T03:13:06,923           # Package would be ignored #
2024-03-08T03:13:06,923           ############################
2024-03-08T03:13:06,924           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-03-08T03:13:06,925           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,926           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,926           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-03-08T03:13:06,927           to the `packages` configuration field.

2024-03-08T03:13:06,928           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,928           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,929           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,930           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,931           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,932           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-03-08T03:13:06,932           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-03-08T03:13:06,933           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,933           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,934           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,935           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,936           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,938           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,938                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,939                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,940                 directory, all directories are treated like packages.
2024-03-08T03:13:06,940           ********************************************************************************

2024-03-08T03:13:06,942   !!
2024-03-08T03:13:06,943     check.warn(importable)
2024-03-08T03:13:06,943   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-03-08T03:13:06,944   !!

2024-03-08T03:13:06,946           ********************************************************************************
2024-03-08T03:13:06,947           ############################
2024-03-08T03:13:06,947           # Package would be ignored #
2024-03-08T03:13:06,949           ############################
2024-03-08T03:13:06,949           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-03-08T03:13:06,950           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,951           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,953           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-03-08T03:13:06,953           to the `packages` configuration field.

2024-03-08T03:13:06,955           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,956           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,957           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,959           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,961           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,962           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-03-08T03:13:06,963           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-03-08T03:13:06,964           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,965           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,965           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:06,968           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:06,969           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:06,972           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:06,973                 even if it does not contain any `.py` files.
2024-03-08T03:13:06,973                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:06,974                 directory, all directories are treated like packages.
2024-03-08T03:13:06,975           ********************************************************************************

2024-03-08T03:13:06,976   !!
2024-03-08T03:13:06,977     check.warn(importable)
2024-03-08T03:13:06,977   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-03-08T03:13:06,978   !!

2024-03-08T03:13:06,980           ********************************************************************************
2024-03-08T03:13:06,981           ############################
2024-03-08T03:13:06,982           # Package would be ignored #
2024-03-08T03:13:06,983           ############################
2024-03-08T03:13:06,983           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-03-08T03:13:06,984           but it is absent from setuptools' `packages` configuration.

2024-03-08T03:13:06,986           This leads to an ambiguous overall configuration. If you want to distribute this
2024-03-08T03:13:06,987           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-03-08T03:13:06,987           to the `packages` configuration field.

2024-03-08T03:13:06,989           Alternatively, you can also rely on setuptools' discovery methods
2024-03-08T03:13:06,989           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-03-08T03:13:06,991           instead of `find_packages(...)`/`find:`).

2024-03-08T03:13:06,992           You can read more about "package discovery" on setuptools documentation page:

2024-03-08T03:13:06,994           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-03-08T03:13:06,995           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-03-08T03:13:06,996           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-03-08T03:13:06,997           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-03-08T03:13:06,998           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-03-08T03:13:06,998           combination with a more fine grained `package-data` configuration.

2024-03-08T03:13:07,000           You can read more about "package data files" on setuptools documentation page:

2024-03-08T03:13:07,002           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-03-08T03:13:07,005           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-03-08T03:13:07,006                 even if it does not contain any `.py` files.
2024-03-08T03:13:07,008                 On the other hand, currently there is no concept of package data
2024-03-08T03:13:07,009                 directory, all directories are treated like packages.
2024-03-08T03:13:07,010           ********************************************************************************

2024-03-08T03:13:07,013   !!
2024-03-08T03:13:07,014     check.warn(importable)
2024-03-08T03:13:07,015   creating build/lib/deepspeed/ops/csrc
2024-03-08T03:13:07,015   creating build/lib/deepspeed/ops/csrc/adagrad
2024-03-08T03:13:07,016   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-03-08T03:13:07,017   creating build/lib/deepspeed/ops/csrc/adam
2024-03-08T03:13:07,018   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-03-08T03:13:07,019   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-03-08T03:13:07,020   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-03-08T03:13:07,021   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-03-08T03:13:07,022   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-03-08T03:13:07,022   creating build/lib/deepspeed/ops/csrc/aio
2024-03-08T03:13:07,023   creating build/lib/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:07,023   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:07,024   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:07,024   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:07,025   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:07,025   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:07,026   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:07,026   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,027   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,028   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,028   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,029   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,030   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,031   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,031   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,032   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,033   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,034   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,034   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:07,035   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-03-08T03:13:07,035   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-03-08T03:13:07,036   creating build/lib/deepspeed/ops/csrc/common
2024-03-08T03:13:07,037   copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common
2024-03-08T03:13:07,037   creating build/lib/deepspeed/ops/csrc/cpu
2024-03-08T03:13:07,038   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-03-08T03:13:07,039   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-03-08T03:13:07,040   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-03-08T03:13:07,040   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-03-08T03:13:07,041   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-03-08T03:13:07,042   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-03-08T03:13:07,042   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-03-08T03:13:07,043   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,043   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,044   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,045   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,046   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,046   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,047   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,047   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-03-08T03:13:07,048   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-03-08T03:13:07,048   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-03-08T03:13:07,049   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-03-08T03:13:07,049   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-03-08T03:13:07,050   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,050   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,051   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,052   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,052   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,053   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,053   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,054   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,054   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,055   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,056   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,057   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,057   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,058   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,058   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,059   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,060   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-03-08T03:13:07,061   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-03-08T03:13:07,061   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-03-08T03:13:07,062   creating build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,062   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,062   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,063   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,064   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,064   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,065   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,065   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,066   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,067   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,067   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,068   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,068   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,069   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,069   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,070   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,071   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,072   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,072   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,073   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,073   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,074   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,075   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,075   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,076   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,076   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,077   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,077   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,078   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,078   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,080   creating build/lib/deepspeed/ops/csrc/lamb
2024-03-08T03:13:07,080   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-03-08T03:13:07,081   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-03-08T03:13:07,081   creating build/lib/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,082   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,082   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,083   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,083   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,084   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,084   creating build/lib/deepspeed/ops/csrc/quantization
2024-03-08T03:13:07,085   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-03-08T03:13:07,085   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-03-08T03:13:07,086   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-03-08T03:13:07,086   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-03-08T03:13:07,087   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-03-08T03:13:07,087   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-03-08T03:13:07,088   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-03-08T03:13:07,088   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-03-08T03:13:07,089   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-03-08T03:13:07,089   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-03-08T03:13:07,090   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-03-08T03:13:07,090   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-03-08T03:13:07,091   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-03-08T03:13:07,092   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-03-08T03:13:07,092   creating build/lib/deepspeed/ops/csrc/spatial
2024-03-08T03:13:07,093   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-03-08T03:13:07,093   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-03-08T03:13:07,094   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-03-08T03:13:07,095   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-03-08T03:13:07,095   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-03-08T03:13:07,096   creating build/lib/deepspeed/ops/csrc/transformer
2024-03-08T03:13:07,097   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-03-08T03:13:07,098   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-03-08T03:13:07,099   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-03-08T03:13:07,100   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-03-08T03:13:07,101   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-03-08T03:13:07,101   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-03-08T03:13:07,102   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-03-08T03:13:07,102   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-03-08T03:13:07,103   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-03-08T03:13:07,103   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,105   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,106   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,106   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,107   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,107   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,108   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,108   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,109   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,112   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,115   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:07,118   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-03-08T03:13:07,119   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-03-08T03:13:07,121   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-03-08T03:13:07,124   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-03-08T03:13:07,127   creating build/lib/deepspeed/ops/csrc/utils
2024-03-08T03:13:07,128   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-03-08T03:13:07,130   creating build/lib/deepspeed/ops/csrc/xpu
2024-03-08T03:13:07,131   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-03-08T03:13:07,132   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-03-08T03:13:07,135   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-03-08T03:13:07,136   copying deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-03-08T03:13:07,138   copying deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-03-08T03:13:07,140   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-03-08T03:13:07,142   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-03-08T03:13:07,145   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-03-08T03:13:07,146   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-03-08T03:13:07,148   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:07,149   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:07,151   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:07,153   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:07,156   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:07,160   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:07,163   creating build/lib/deepspeed/autotuning/config_templates
2024-03-08T03:13:07,165   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-03-08T03:13:07,167   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-03-08T03:13:07,170   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-03-08T03:13:07,173   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-03-08T03:13:07,176   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-03-08T03:13:07,179   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-03-08T03:13:07,182   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-03-08T03:13:07,185   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-03-08T03:13:07,186   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-03-08T03:13:07,189   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-03-08T03:13:07,192   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-03-08T03:13:07,193   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-03-08T03:13:07,195   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:07,196   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:07,199   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:07,203   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:07,205   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:07,210   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:07,218   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-03-08T03:13:07,226   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-03-08T03:13:07,234   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-03-08T03:13:07,238   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-03-08T03:13:07,282   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-03-08T03:13:07,286   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-03-08T03:13:07,287   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-03-08T03:13:07,290   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-03-08T03:13:07,291   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-03-08T03:13:07,294   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-03-08T03:13:07,297   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-03-08T03:13:07,300   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:07,304   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:07,307   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:07,310   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:07,313   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:07,315   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:07,319   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:07,323   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:07,328   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:07,335   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:07,340   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:07,343   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:07,347   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-03-08T03:13:07,350   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-03-08T03:13:07,354   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:07,357   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:07,360   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/fp6_linear.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:07,364   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/fp6_linear.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:07,367   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:07,369   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:07,373   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:07,376   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:07,380   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:07,382   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:07,386   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:07,390   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:07,394   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:07,398   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:07,401   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:07,405   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:07,409   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:07,413   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:07,417   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:07,420   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:07,423   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:07,427   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:07,430   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:07,434   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:07,439   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:07,442   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:07,446   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:07,450   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:07,453   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:07,456   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:07,460   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:07,463   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:07,466   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:07,469   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:07,472   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:07,475   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:07,478   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:07,481   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:07,485   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:07,489   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:07,493   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-03-08T03:13:07,496   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-03-08T03:13:07,499   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:07,503   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:07,506   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:07,510   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:07,515   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:07,520   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:07,524   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:07,529   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:07,591   running build_scripts
2024-03-08T03:13:07,592   creating build/scripts-3.11
2024-03-08T03:13:07,594   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-03-08T03:13:07,596   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-03-08T03:13:07,598   copying and adjusting bin/ds -> build/scripts-3.11
2024-03-08T03:13:07,600   copying bin/ds_ssh -> build/scripts-3.11
2024-03-08T03:13:07,602   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-03-08T03:13:07,604   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-03-08T03:13:07,605   copying and adjusting bin/dsr -> build/scripts-3.11
2024-03-08T03:13:07,607   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-03-08T03:13:07,609   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-03-08T03:13:07,610   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-03-08T03:13:07,611   changing mode of build/scripts-3.11/ds from 644 to 755
2024-03-08T03:13:07,611   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-03-08T03:13:07,612   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-03-08T03:13:07,613   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-03-08T03:13:07,614   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-03-08T03:13:07,641   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-03-08T03:13:07,641   !!

2024-03-08T03:13:07,642           ********************************************************************************
2024-03-08T03:13:07,643           Please avoid running ``setup.py`` directly.
2024-03-08T03:13:07,643           Instead, use pypa/build, pypa/installer or other
2024-03-08T03:13:07,644           standards-based tools.

2024-03-08T03:13:07,645           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-03-08T03:13:07,645           ********************************************************************************

2024-03-08T03:13:07,647   !!
2024-03-08T03:13:07,647     self.initialize_options()
2024-03-08T03:13:07,671   installing to build/bdist.linux-armv7l/wheel
2024-03-08T03:13:07,672   running install
2024-03-08T03:13:07,696   running install_lib
2024-03-08T03:13:07,724   creating build/bdist.linux-armv7l
2024-03-08T03:13:07,725   creating build/bdist.linux-armv7l/wheel
2024-03-08T03:13:07,728   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-03-08T03:13:07,731   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-03-08T03:13:07,734   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-03-08T03:13:07,736   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-03-08T03:13:07,739   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,740   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,744   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,745   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,751   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,753   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,757   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,759   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,763   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,766   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-03-08T03:13:07,769   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,772   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,776   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-03-08T03:13:07,777   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-03-08T03:13:07,782   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-03-08T03:13:07,786   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-03-08T03:13:07,789   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-03-08T03:13:07,792   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,795   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,802   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-03-08T03:13:07,806   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-03-08T03:13:07,807   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-03-08T03:13:07,810   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-03-08T03:13:07,813   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,814   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,818   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,822   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,825   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,828   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,832   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,838   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-03-08T03:13:07,842   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-03-08T03:13:07,843   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-03-08T03:13:07,847   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-03-08T03:13:07,850   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-03-08T03:13:07,853   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-03-08T03:13:07,857   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-03-08T03:13:07,859   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-03-08T03:13:07,862   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,864   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,867   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,870   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,872   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,875   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,878   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,881   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,887   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,890   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,895   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,899   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,904   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,908   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,910   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,912   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,915   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,917   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,919   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,921   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,922   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,924   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,926   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,928   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,930   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,932   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,934   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,936   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,938   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,940   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-03-08T03:13:07,943   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-03-08T03:13:07,944   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-03-08T03:13:07,945   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-03-08T03:13:07,948   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-03-08T03:13:07,949   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-03-08T03:13:07,952   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-03-08T03:13:07,953   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-03-08T03:13:07,956   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-03-08T03:13:07,957   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-03-08T03:13:07,960   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-03-08T03:13:07,962   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-03-08T03:13:07,963   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-03-08T03:13:07,964   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-03-08T03:13:07,966   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-03-08T03:13:07,969   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-03-08T03:13:07,970   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-03-08T03:13:07,973   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-03-08T03:13:07,974   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-03-08T03:13:07,977   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-03-08T03:13:07,978   copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-03-08T03:13:07,980   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,981   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,983   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,985   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,987   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,989   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-03-08T03:13:07,991   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-03-08T03:13:07,992   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-03-08T03:13:07,994   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-03-08T03:13:07,997   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-03-08T03:13:07,999   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-03-08T03:13:08,001   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-03-08T03:13:08,003   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-03-08T03:13:08,005   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,006   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,008   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,010   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,012   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,014   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,017   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,019   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,022   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,025   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,028   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,029   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-03-08T03:13:08,032   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-03-08T03:13:08,033   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-03-08T03:13:08,036   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:08,037   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:08,040   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:08,043   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:08,046   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:08,048   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:08,051   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-03-08T03:13:08,056   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-03-08T03:13:08,057   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-03-08T03:13:08,064   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-03-08T03:13:08,068   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-03-08T03:13:08,071   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-03-08T03:13:08,075   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-03-08T03:13:08,082   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-03-08T03:13:08,090   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-03-08T03:13:08,100   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-03-08T03:13:08,105   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,108   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,113   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,121   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,130   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,138   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,143   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,147   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,151   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,154   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,156   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-03-08T03:13:08,165   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-03-08T03:13:08,167   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-03-08T03:13:08,170   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-03-08T03:13:08,173   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-03-08T03:13:08,176   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-03-08T03:13:08,180   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-03-08T03:13:08,181   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-03-08T03:13:08,183   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-03-08T03:13:08,185   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-03-08T03:13:08,189   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-03-08T03:13:08,191   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-03-08T03:13:08,194   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-03-08T03:13:08,197   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-03-08T03:13:08,200   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-03-08T03:13:08,202   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:08,203   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:08,206   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:08,208   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:08,210   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:08,213   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-03-08T03:13:08,216   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-03-08T03:13:08,217   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-03-08T03:13:08,221   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-03-08T03:13:08,222   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-03-08T03:13:08,225   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-03-08T03:13:08,226   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-03-08T03:13:08,230   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-03-08T03:13:08,232   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-03-08T03:13:08,235   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-03-08T03:13:08,237   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-03-08T03:13:08,238   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-03-08T03:13:08,244   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-03-08T03:13:08,245   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-03-08T03:13:08,247   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-03-08T03:13:08,250   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-03-08T03:13:08,251   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-03-08T03:13:08,253   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-03-08T03:13:08,256   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-03-08T03:13:08,257   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-03-08T03:13:08,260   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-03-08T03:13:08,262   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-03-08T03:13:08,264   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-03-08T03:13:08,265   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-03-08T03:13:08,268   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-03-08T03:13:08,271   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,272   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,278   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:08,279   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:08,283   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:08,287   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:08,290   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:08,293   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-03-08T03:13:08,296   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,298   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,301   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,303   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,305   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,308   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,311   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,314   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,316   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,320   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,323   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:08,324   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:08,327   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:08,328   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:08,330   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:08,332   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:08,333   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-03-08T03:13:08,336   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-03-08T03:13:08,337   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-03-08T03:13:08,339   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-03-08T03:13:08,342   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-03-08T03:13:08,344   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-03-08T03:13:08,347   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-03-08T03:13:08,351   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-03-08T03:13:08,355   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-03-08T03:13:08,357   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-03-08T03:13:08,359   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-03-08T03:13:08,361   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,364   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,366   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,368   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,370   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,372   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,374   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,376   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:08,377   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:08,380   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:08,382   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:08,384   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:08,386   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:08,387   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-03-08T03:13:08,389   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,391   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,393   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,395   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-03-08T03:13:08,397   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-03-08T03:13:08,398   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-03-08T03:13:08,400   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-03-08T03:13:08,403   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-03-08T03:13:08,404   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-03-08T03:13:08,406   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-03-08T03:13:08,408   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-03-08T03:13:08,410   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-03-08T03:13:08,413   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-03-08T03:13:08,415   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-03-08T03:13:08,417   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-03-08T03:13:08,419   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-03-08T03:13:08,421   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-03-08T03:13:08,424   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-03-08T03:13:08,425   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-03-08T03:13:08,427   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-03-08T03:13:08,428   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-03-08T03:13:08,432   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-03-08T03:13:08,434   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,435   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,439   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,441   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,444   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,447   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,449   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,451   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,452   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,454   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,456   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,458   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,460   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,462   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,465   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,468   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,470   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,473   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-03-08T03:13:08,476   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,479   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,481   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,485   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,486   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,489   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,491   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,494   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,496   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,498   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,500   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,502   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,505   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,507   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-03-08T03:13:08,510   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-03-08T03:13:08,513   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-03-08T03:13:08,514   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-03-08T03:13:08,516   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-03-08T03:13:08,519   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-03-08T03:13:08,522   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-03-08T03:13:08,525   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-03-08T03:13:08,527   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-03-08T03:13:08,530   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-03-08T03:13:08,530   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-03-08T03:13:08,532   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-03-08T03:13:08,534   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-03-08T03:13:08,536   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-03-08T03:13:08,539   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-03-08T03:13:08,543   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-03-08T03:13:08,544   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-03-08T03:13:08,546   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-03-08T03:13:08,549   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,550   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,553   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,556   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,558   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,561   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,563   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,566   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,569   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,572   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,573   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-03-08T03:13:08,576   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-03-08T03:13:08,577   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-03-08T03:13:08,579   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-03-08T03:13:08,581   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-03-08T03:13:08,583   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-03-08T03:13:08,585   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-03-08T03:13:08,588   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-03-08T03:13:08,591   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-03-08T03:13:08,593   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-03-08T03:13:08,594   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-03-08T03:13:08,596   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-03-08T03:13:08,598   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-03-08T03:13:08,601   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-03-08T03:13:08,603   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-03-08T03:13:08,606   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-03-08T03:13:08,609   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-03-08T03:13:08,612   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-03-08T03:13:08,615   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-03-08T03:13:08,616   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-03-08T03:13:08,618   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-03-08T03:13:08,621   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-03-08T03:13:08,622   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-03-08T03:13:08,629   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-03-08T03:13:08,631   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-03-08T03:13:08,634   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-03-08T03:13:08,637   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-03-08T03:13:08,639   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-03-08T03:13:08,641   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-03-08T03:13:08,643   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-03-08T03:13:08,646   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-03-08T03:13:08,648   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-03-08T03:13:08,650   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-03-08T03:13:08,652   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-03-08T03:13:08,655   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-03-08T03:13:08,657   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-03-08T03:13:08,660   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-03-08T03:13:08,664   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-03-08T03:13:08,665   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-03-08T03:13:08,668   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-03-08T03:13:08,670   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-03-08T03:13:08,672   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-03-08T03:13:08,675   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-03-08T03:13:08,678   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-03-08T03:13:08,681   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-03-08T03:13:08,684   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-03-08T03:13:08,686   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-03-08T03:13:08,689   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-03-08T03:13:08,692   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-03-08T03:13:08,696   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-03-08T03:13:08,699   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-03-08T03:13:08,704   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-03-08T03:13:08,706   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-03-08T03:13:08,711   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-03-08T03:13:08,717   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-03-08T03:13:08,723   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-03-08T03:13:08,726   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-03-08T03:13:08,728   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-03-08T03:13:08,731   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-03-08T03:13:08,732   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-03-08T03:13:08,734   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-03-08T03:13:08,737   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-03-08T03:13:08,737   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-03-08T03:13:08,741   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-03-08T03:13:08,742   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-03-08T03:13:08,745   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,746   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,748   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,750   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,752   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,757   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,761   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,764   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,767   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,769   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,773   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,779   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,786   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,788   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,790   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,792   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-03-08T03:13:08,794   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-03-08T03:13:08,796   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-03-08T03:13:08,800   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-03-08T03:13:08,804   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,805   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,808   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,812   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,818   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,821   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,825   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,828   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,831   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,833   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,837   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,838   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,840   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,843   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,846   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-03-08T03:13:08,847   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-03-08T03:13:08,852   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-03-08T03:13:08,858   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-03-08T03:13:08,860   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-03-08T03:13:08,862   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-03-08T03:13:08,865   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-03-08T03:13:08,869   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-03-08T03:13:08,873   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,876   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,879   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,883   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,886   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,891   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,894   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,896   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,898   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,900   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,902   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,904   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,906   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,909   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,911   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,912   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-03-08T03:13:08,915   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,918   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,920   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,922   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-03-08T03:13:08,924   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-03-08T03:13:08,925   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-03-08T03:13:08,928   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-03-08T03:13:08,930   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-03-08T03:13:08,934   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-03-08T03:13:08,936   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-03-08T03:13:08,938   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-03-08T03:13:08,940   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-03-08T03:13:08,942   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-03-08T03:13:08,945   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-03-08T03:13:08,947   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-03-08T03:13:08,952   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-03-08T03:13:08,955   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-03-08T03:13:08,958   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,959   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,962   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,965   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,967   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,971   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,973   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,976   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,978   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,980   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,983   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-03-08T03:13:08,986   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:08,987   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:08,991   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-03-08T03:13:08,992   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-03-08T03:13:08,996   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-03-08T03:13:09,001   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-03-08T03:13:09,008   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-03-08T03:13:09,014   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-03-08T03:13:09,022   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-03-08T03:13:09,029   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,030   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,034   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,039   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,043   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,045   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,048   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,054   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,056   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,059   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,061   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,067   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,074   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,077   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,081   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,084   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,086   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-03-08T03:13:09,089   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-03-08T03:13:09,090   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-03-08T03:13:09,093   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-03-08T03:13:09,096   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,099   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,103   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-03-08T03:13:09,104   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-03-08T03:13:09,106   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-03-08T03:13:09,110   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-03-08T03:13:09,112   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-03-08T03:13:09,115   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-03-08T03:13:09,117   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-03-08T03:13:09,120   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-03-08T03:13:09,124   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-03-08T03:13:09,127   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-03-08T03:13:09,131   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,134   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,137   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,140   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,142   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,144   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,146   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,149   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,152   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,155   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-03-08T03:13:09,156   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-03-08T03:13:09,158   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-03-08T03:13:09,160   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-03-08T03:13:09,163   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-03-08T03:13:09,165   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-03-08T03:13:09,166   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-03-08T03:13:09,168   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-03-08T03:13:09,170   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-03-08T03:13:09,174   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,213   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-03-08T03:13:09,215   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-03-08T03:13:09,217   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-03-08T03:13:09,220   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-03-08T03:13:09,223   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-03-08T03:13:09,225   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-03-08T03:13:09,228   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-03-08T03:13:09,230   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-03-08T03:13:09,233   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-03-08T03:13:09,236   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-03-08T03:13:09,239   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,243   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-03-08T03:13:09,245   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-03-08T03:13:09,248   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-03-08T03:13:09,251   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-03-08T03:13:09,254   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:09,256   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:09,261   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:09,263   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:09,266   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:09,270   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-03-08T03:13:09,275   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-03-08T03:13:09,280   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:09,281   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:09,284   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:09,286   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:09,290   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:09,293   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-03-08T03:13:09,296   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,300   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,303   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-03-08T03:13:09,304   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-03-08T03:13:09,307   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-03-08T03:13:09,311   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-03-08T03:13:09,314   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-03-08T03:13:09,318   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-03-08T03:13:09,322   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-03-08T03:13:09,327   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-03-08T03:13:09,334   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-03-08T03:13:09,335   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-03-08T03:13:09,340   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-03-08T03:13:09,345   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-03-08T03:13:09,349   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-03-08T03:13:09,355   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-03-08T03:13:09,362   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-03-08T03:13:09,370   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-03-08T03:13:09,372   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-03-08T03:13:09,373   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-03-08T03:13:09,376   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-03-08T03:13:09,379   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-03-08T03:13:09,384   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-03-08T03:13:09,388   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-03-08T03:13:09,392   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-03-08T03:13:09,396   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-03-08T03:13:09,398   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-03-08T03:13:09,399   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-03-08T03:13:09,402   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-03-08T03:13:09,405   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-03-08T03:13:09,408   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-03-08T03:13:09,411   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-03-08T03:13:09,414   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-03-08T03:13:09,417   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-03-08T03:13:09,419   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-03-08T03:13:09,421   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-03-08T03:13:09,423   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-03-08T03:13:09,426   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-03-08T03:13:09,428   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-03-08T03:13:09,431   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-03-08T03:13:09,432   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-03-08T03:13:09,437   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:09,438   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:09,441   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:09,444   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:09,446   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:09,449   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:09,453   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:09,457   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:09,460   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-03-08T03:13:09,462   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:09,464   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:09,466   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:09,468   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:09,471   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:09,473   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:09,475   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:09,477   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-03-08T03:13:09,479   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-03-08T03:13:09,482   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-03-08T03:13:09,485   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-03-08T03:13:09,486   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-03-08T03:13:09,488   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-03-08T03:13:09,490   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-03-08T03:13:09,493   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-03-08T03:13:09,494   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-03-08T03:13:09,496   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-03-08T03:13:09,500   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-03-08T03:13:09,501   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-03-08T03:13:09,503   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-03-08T03:13:09,506   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-03-08T03:13:09,508   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-03-08T03:13:09,510   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-03-08T03:13:09,512   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-03-08T03:13:09,515   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-03-08T03:13:09,516   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-03-08T03:13:09,519   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-03-08T03:13:09,522   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-03-08T03:13:09,525   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-03-08T03:13:09,527   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-03-08T03:13:09,530   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-03-08T03:13:09,533   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-03-08T03:13:09,534   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-03-08T03:13:09,537   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-03-08T03:13:09,539   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-03-08T03:13:09,541   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-03-08T03:13:09,544   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-03-08T03:13:09,546   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-03-08T03:13:09,549   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-03-08T03:13:09,551   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-03-08T03:13:09,553   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:09,554   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:09,557   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:09,559   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:09,562   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:09,564   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-03-08T03:13:09,569   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:09,571   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:09,574   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:09,576   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:09,578   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:09,581   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:09,583   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:09,586   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-03-08T03:13:09,590   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:09,592   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:09,594   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:09,597   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:09,600   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:09,602   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:09,605   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:09,607   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:09,610   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-03-08T03:13:09,613   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-03-08T03:13:09,615   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-03-08T03:13:09,621   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:09,622   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:09,624   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:09,627   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:09,630   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:09,632   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-03-08T03:13:09,635   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-03-08T03:13:09,635   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-03-08T03:13:09,638   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-03-08T03:13:09,640   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-03-08T03:13:09,642   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-03-08T03:13:09,644   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:09,645   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/fp6_linear.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:09,648   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:09,650   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:09,653   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/fp6_linear.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:09,655   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:09,658   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:09,659   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:09,662   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:09,664   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:09,666   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:09,669   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:09,673   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:09,676   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:09,679   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:09,681   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-03-08T03:13:09,683   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-03-08T03:13:09,686   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:09,687   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:09,690   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:09,693   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:09,695   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:09,697   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-03-08T03:13:09,699   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-03-08T03:13:09,701   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-03-08T03:13:09,702   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:09,703   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:09,705   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:09,707   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:09,709   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:09,711   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:09,713   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-03-08T03:13:09,715   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-03-08T03:13:09,717   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-03-08T03:13:09,719   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-03-08T03:13:09,720   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-03-08T03:13:09,723   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:09,724   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:09,727   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:09,729   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:09,731   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:09,734   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-03-08T03:13:09,737   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-03-08T03:13:09,738   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:09,740   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:09,742   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:09,744   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:09,747   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:09,749   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:09,751   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:09,753   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:09,755   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-03-08T03:13:09,757   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-03-08T03:13:09,759   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-03-08T03:13:09,760   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-03-08T03:13:09,762   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-03-08T03:13:09,765   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-03-08T03:13:09,768   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-03-08T03:13:09,769   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-03-08T03:13:09,772   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:09,773   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:09,776   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:09,778   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:09,780   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:09,782   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:09,785   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-03-08T03:13:09,787   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:09,788   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:09,790   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:09,792   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:09,794   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:09,796   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:09,798   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-03-08T03:13:09,800   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-03-08T03:13:09,802   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:09,803   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:09,805   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:09,807   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:09,810   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:09,812   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:09,814   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-03-08T03:13:09,817   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:09,817   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:09,819   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:09,821   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:09,823   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:09,825   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:09,827   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-03-08T03:13:09,830   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-03-08T03:13:09,831   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-03-08T03:13:09,833   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-03-08T03:13:09,835   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-03-08T03:13:09,837   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-03-08T03:13:09,840   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:09,841   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:09,843   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:09,845   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:09,847   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:09,850   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:09,852   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-03-08T03:13:09,856   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:09,857   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:09,859   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:09,861   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:09,864   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:09,866   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:09,868   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-03-08T03:13:09,870   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-03-08T03:13:09,872   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:09,874   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-03-08T03:13:09,875   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-03-08T03:13:09,877   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-03-08T03:13:09,879   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-03-08T03:13:09,881   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-03-08T03:13:09,885   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:09,888   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-03-08T03:13:09,889   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-03-08T03:13:09,891   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-03-08T03:13:09,893   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-03-08T03:13:09,894   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-03-08T03:13:09,897   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-03-08T03:13:09,898   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-03-08T03:13:09,900   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-03-08T03:13:09,902   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-03-08T03:13:09,904   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-03-08T03:13:09,907   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:09,908   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:09,911   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:09,914   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:09,917   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:09,922   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:09,927   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:09,930   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:09,931   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:09,934   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-03-08T03:13:09,935   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:09,938   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-03-08T03:13:09,939   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-03-08T03:13:09,941   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-03-08T03:13:09,943   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-03-08T03:13:09,944   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-03-08T03:13:09,947   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:09,952   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-03-08T03:13:09,954   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-03-08T03:13:09,957   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-03-08T03:13:09,959   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-03-08T03:13:09,962   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-03-08T03:13:09,966   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:09,970   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:09,975   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-03-08T03:13:09,977   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-03-08T03:13:09,979   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-03-08T03:13:09,981   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-03-08T03:13:09,983   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-03-08T03:13:09,987   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-03-08T03:13:09,989   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-03-08T03:13:09,993   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-03-08T03:13:09,996   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-03-08T03:13:09,998   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-03-08T03:13:10,000   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:10,002   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-03-08T03:13:10,004   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:10,005   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:10,008   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:10,010   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:10,012   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:10,014   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:10,016   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:10,019   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:10,021   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:10,024   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-03-08T03:13:10,027   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-03-08T03:13:10,028   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-03-08T03:13:10,031   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-03-08T03:13:10,033   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-03-08T03:13:10,035   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-03-08T03:13:10,037   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-03-08T03:13:10,039   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-03-08T03:13:10,041   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-03-08T03:13:10,043   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-03-08T03:13:10,045   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-03-08T03:13:10,047   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-03-08T03:13:10,050   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-03-08T03:13:10,052   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-03-08T03:13:10,058   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-03-08T03:13:10,059   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-03-08T03:13:10,064   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-03-08T03:13:10,069   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-03-08T03:13:10,074   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-03-08T03:13:10,081   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-03-08T03:13:10,085   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-03-08T03:13:10,087   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-03-08T03:13:10,090   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-03-08T03:13:10,092   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-03-08T03:13:10,094   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-03-08T03:13:10,098   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-03-08T03:13:10,101   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-03-08T03:13:10,103   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-03-08T03:13:10,105   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-03-08T03:13:10,108   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-03-08T03:13:10,111   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-03-08T03:13:10,112   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-03-08T03:13:10,114   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-03-08T03:13:10,117   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-03-08T03:13:10,119   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-03-08T03:13:10,121   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-03-08T03:13:10,124   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-03-08T03:13:10,126   running install_egg_info
2024-03-08T03:13:10,161   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.14.0-py3.11.egg-info
2024-03-08T03:13:10,181   running install_scripts
2024-03-08T03:13:10,182   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data
2024-03-08T03:13:10,183   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts
2024-03-08T03:13:10,185   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts
2024-03-08T03:13:10,187   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts
2024-03-08T03:13:10,189   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts
2024-03-08T03:13:10,192   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts
2024-03-08T03:13:10,194   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts
2024-03-08T03:13:10,196   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts
2024-03-08T03:13:10,198   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts
2024-03-08T03:13:10,200   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts
2024-03-08T03:13:10,202   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts/ds_elastic to 755
2024-03-08T03:13:10,203   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts/deepspeed to 755
2024-03-08T03:13:10,204   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts/ds to 755
2024-03-08T03:13:10,205   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts/ds_report to 755
2024-03-08T03:13:10,205   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts/dsr to 755
2024-03-08T03:13:10,206   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts/deepspeed.pt to 755
2024-03-08T03:13:10,207   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts/ds_ssh to 755
2024-03-08T03:13:10,208   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.data/scripts/ds_bench to 755
2024-03-08T03:13:10,256   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.0.dist-info/WHEEL
2024-03-08T03:13:10,259   creating '/tmp/pip-wheel-9j_eeom7/deepspeed-0.14.0-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-03-08T03:13:10,263   adding 'deepspeed/__init__.py'
2024-03-08T03:13:10,265   adding 'deepspeed/constants.py'
2024-03-08T03:13:10,267   adding 'deepspeed/env_report.py'
2024-03-08T03:13:10,269   adding 'deepspeed/git_version_info.py'
2024-03-08T03:13:10,271   adding 'deepspeed/git_version_info_installed.py'
2024-03-08T03:13:10,273   adding 'deepspeed/pydantic_v1.py'
2024-03-08T03:13:10,276   adding 'deepspeed/accelerator/__init__.py'
2024-03-08T03:13:10,277   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-03-08T03:13:10,279   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-03-08T03:13:10,282   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-03-08T03:13:10,284   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-03-08T03:13:10,286   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-03-08T03:13:10,288   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-03-08T03:13:10,291   adding 'deepspeed/accelerator/real_accelerator.py'
2024-03-08T03:13:10,293   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-03-08T03:13:10,295   adding 'deepspeed/autotuning/__init__.py'
2024-03-08T03:13:10,301   adding 'deepspeed/autotuning/autotuner.py'
2024-03-08T03:13:10,303   adding 'deepspeed/autotuning/config.py'
2024-03-08T03:13:10,305   adding 'deepspeed/autotuning/constants.py'
2024-03-08T03:13:10,308   adding 'deepspeed/autotuning/scheduler.py'
2024-03-08T03:13:10,310   adding 'deepspeed/autotuning/utils.py'
2024-03-08T03:13:10,313   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-03-08T03:13:10,314   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-03-08T03:13:10,316   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-03-08T03:13:10,317   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-03-08T03:13:10,320   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-03-08T03:13:10,322   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-03-08T03:13:10,324   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-03-08T03:13:10,325   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-03-08T03:13:10,327   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-03-08T03:13:10,329   adding 'deepspeed/autotuning/tuner/utils.py'
2024-03-08T03:13:10,332   adding 'deepspeed/checkpoint/__init__.py'
2024-03-08T03:13:10,334   adding 'deepspeed/checkpoint/constants.py'
2024-03-08T03:13:10,336   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-03-08T03:13:10,339   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-03-08T03:13:10,341   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-03-08T03:13:10,342   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-03-08T03:13:10,344   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-03-08T03:13:10,346   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-03-08T03:13:10,347   adding 'deepspeed/checkpoint/utils.py'
2024-03-08T03:13:10,349   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-03-08T03:13:10,351   adding 'deepspeed/comm/__init__.py'
2024-03-08T03:13:10,353   adding 'deepspeed/comm/backend.py'
2024-03-08T03:13:10,354   adding 'deepspeed/comm/ccl.py'
2024-03-08T03:13:10,358   adding 'deepspeed/comm/comm.py'
2024-03-08T03:13:10,359   adding 'deepspeed/comm/config.py'
2024-03-08T03:13:10,361   adding 'deepspeed/comm/constants.py'
2024-03-08T03:13:10,362   adding 'deepspeed/comm/reduce_op.py'
2024-03-08T03:13:10,365   adding 'deepspeed/comm/torch.py'
2024-03-08T03:13:10,367   adding 'deepspeed/comm/utils.py'
2024-03-08T03:13:10,369   adding 'deepspeed/compression/__init__.py'
2024-03-08T03:13:10,372   adding 'deepspeed/compression/basic_layer.py'
2024-03-08T03:13:10,374   adding 'deepspeed/compression/compress.py'
2024-03-08T03:13:10,377   adding 'deepspeed/compression/config.py'
2024-03-08T03:13:10,378   adding 'deepspeed/compression/constants.py'
2024-03-08T03:13:10,380   adding 'deepspeed/compression/helper.py'
2024-03-08T03:13:10,382   adding 'deepspeed/compression/scheduler.py'
2024-03-08T03:13:10,384   adding 'deepspeed/compression/utils.py'
2024-03-08T03:13:10,386   adding 'deepspeed/elasticity/__init__.py'
2024-03-08T03:13:10,387   adding 'deepspeed/elasticity/config.py'
2024-03-08T03:13:10,389   adding 'deepspeed/elasticity/constants.py'
2024-03-08T03:13:10,391   adding 'deepspeed/elasticity/elastic_agent.py'
2024-03-08T03:13:10,393   adding 'deepspeed/elasticity/elasticity.py'
2024-03-08T03:13:10,395   adding 'deepspeed/elasticity/utils.py'
2024-03-08T03:13:10,397   adding 'deepspeed/inference/__init__.py'
2024-03-08T03:13:10,399   adding 'deepspeed/inference/config.py'
2024-03-08T03:13:10,402   adding 'deepspeed/inference/engine.py'
2024-03-08T03:13:10,404   adding 'deepspeed/inference/quantization/__init__.py'
2024-03-08T03:13:10,406   adding 'deepspeed/inference/quantization/layers.py'
2024-03-08T03:13:10,407   adding 'deepspeed/inference/quantization/quantization.py'
2024-03-08T03:13:10,408   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-03-08T03:13:10,410   adding 'deepspeed/inference/quantization/utils.py'
2024-03-08T03:13:10,412   adding 'deepspeed/inference/v2/__init__.py'
2024-03-08T03:13:10,413   adding 'deepspeed/inference/v2/allocator.py'
2024-03-08T03:13:10,414   adding 'deepspeed/inference/v2/config_v2.py'
2024-03-08T03:13:10,416   adding 'deepspeed/inference/v2/engine_factory.py'
2024-03-08T03:13:10,418   adding 'deepspeed/inference/v2/engine_v2.py'
2024-03-08T03:13:10,419   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-03-08T03:13:10,421   adding 'deepspeed/inference/v2/inference_utils.py'
2024-03-08T03:13:10,422   adding 'deepspeed/inference/v2/logging.py'
2024-03-08T03:13:10,423   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-03-08T03:13:10,425   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-03-08T03:13:10,426   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-03-08T03:13:10,428   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-03-08T03:13:10,429   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-03-08T03:13:10,431   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-03-08T03:13:10,432   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-03-08T03:13:10,434   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-03-08T03:13:10,436   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-03-08T03:13:10,438   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-03-08T03:13:10,439   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-03-08T03:13:10,440   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-03-08T03:13:10,441   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-03-08T03:13:10,443   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-03-08T03:13:10,445   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-03-08T03:13:10,446   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-03-08T03:13:10,448   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-03-08T03:13:10,450   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-03-08T03:13:10,452   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-03-08T03:13:10,453   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-03-08T03:13:10,455   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-03-08T03:13:10,456   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-03-08T03:13:10,457   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-03-08T03:13:10,459   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-03-08T03:13:10,460   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-03-08T03:13:10,462   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-03-08T03:13:10,464   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-03-08T03:13:10,465   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-03-08T03:13:10,467   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear_kernels.cpp'
2024-03-08T03:13:10,468   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear_kernels.h'
2024-03-08T03:13:10,470   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/fp6_linear.cu'
2024-03-08T03:13:10,471   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/fp6_linear.cuh'
2024-03-08T03:13:10,473   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-03-08T03:13:10,475   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-03-08T03:13:10,476   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-03-08T03:13:10,478   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-03-08T03:13:10,479   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-03-08T03:13:10,481   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-03-08T03:13:10,482   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-03-08T03:13:10,484   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-03-08T03:13:10,486   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-03-08T03:13:10,488   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-03-08T03:13:10,489   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-03-08T03:13:10,491   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-03-08T03:13:10,492   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-03-08T03:13:10,493   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-03-08T03:13:10,495   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-03-08T03:13:10,496   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-03-08T03:13:10,498   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-03-08T03:13:10,499   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-03-08T03:13:10,501   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-03-08T03:13:10,502   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-03-08T03:13:10,504   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-03-08T03:13:10,506   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-03-08T03:13:10,507   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-03-08T03:13:10,509   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-03-08T03:13:10,511   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-03-08T03:13:10,512   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-03-08T03:13:10,513   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-03-08T03:13:10,515   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-03-08T03:13:10,517   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-03-08T03:13:10,519   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-03-08T03:13:10,521   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-03-08T03:13:10,523   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-03-08T03:13:10,524   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-03-08T03:13:10,526   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-03-08T03:13:10,528   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-03-08T03:13:10,530   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-03-08T03:13:10,533   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-03-08T03:13:10,534   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-03-08T03:13:10,537   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-03-08T03:13:10,540   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-03-08T03:13:10,542   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-03-08T03:13:10,544   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-03-08T03:13:10,546   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-03-08T03:13:10,547   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-03-08T03:13:10,548   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-03-08T03:13:10,550   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-03-08T03:13:10,552   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-03-08T03:13:10,553   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-03-08T03:13:10,554   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-03-08T03:13:10,556   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-03-08T03:13:10,557   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-03-08T03:13:10,559   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-03-08T03:13:10,561   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-03-08T03:13:10,562   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-03-08T03:13:10,563   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-03-08T03:13:10,565   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-03-08T03:13:10,566   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-03-08T03:13:10,568   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-03-08T03:13:10,571   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-03-08T03:13:10,790   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-03-08T03:13:10,792   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-03-08T03:13:10,794   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-03-08T03:13:10,795   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-03-08T03:13:10,797   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-03-08T03:13:10,801   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-03-08T03:13:10,803   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-03-08T03:13:10,805   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-03-08T03:13:10,809   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-03-08T03:13:10,812   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-03-08T03:13:10,814   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-03-08T03:13:10,817   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-03-08T03:13:10,819   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-03-08T03:13:10,822   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-03-08T03:13:10,827   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-03-08T03:13:10,829   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-03-08T03:13:10,832   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-03-08T03:13:10,834   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-03-08T03:13:10,837   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-03-08T03:13:10,840   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-03-08T03:13:10,844   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-03-08T03:13:10,847   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-03-08T03:13:10,849   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-03-08T03:13:10,852   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-03-08T03:13:10,854   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-03-08T03:13:10,857   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-03-08T03:13:10,862   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-03-08T03:13:10,864   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-03-08T03:13:10,866   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-03-08T03:13:10,870   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-03-08T03:13:10,873   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-03-08T03:13:10,876   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-03-08T03:13:10,878   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-03-08T03:13:10,881   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-03-08T03:13:10,884   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-03-08T03:13:10,889   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-03-08T03:13:10,892   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-03-08T03:13:10,895   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-03-08T03:13:10,898   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-03-08T03:13:10,902   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-03-08T03:13:10,905   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-03-08T03:13:10,907   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-03-08T03:13:10,910   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-03-08T03:13:10,911   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-03-08T03:13:10,913   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-03-08T03:13:10,914   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-03-08T03:13:10,916   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-03-08T03:13:10,919   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-03-08T03:13:10,920   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-03-08T03:13:10,921   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-03-08T03:13:10,923   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-03-08T03:13:10,925   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-03-08T03:13:10,926   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-03-08T03:13:10,928   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-03-08T03:13:10,929   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-03-08T03:13:10,931   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-03-08T03:13:10,932   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-03-08T03:13:10,934   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-03-08T03:13:10,935   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-03-08T03:13:10,937   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-03-08T03:13:10,938   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-03-08T03:13:10,940   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-03-08T03:13:10,941   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-03-08T03:13:10,943   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-03-08T03:13:10,944   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-03-08T03:13:10,946   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-03-08T03:13:10,948   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-03-08T03:13:10,950   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-03-08T03:13:10,951   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-03-08T03:13:10,953   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-03-08T03:13:10,955   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-03-08T03:13:10,957   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-03-08T03:13:10,958   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-03-08T03:13:10,960   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-03-08T03:13:10,962   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-03-08T03:13:10,964   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-03-08T03:13:10,966   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-03-08T03:13:10,968   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-03-08T03:13:10,970   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-03-08T03:13:10,972   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-03-08T03:13:10,973   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-03-08T03:13:10,975   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-03-08T03:13:10,977   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-03-08T03:13:10,980   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-03-08T03:13:10,982   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-03-08T03:13:10,984   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-03-08T03:13:10,986   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-03-08T03:13:10,988   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-03-08T03:13:10,991   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-03-08T03:13:10,993   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-03-08T03:13:10,995   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-03-08T03:13:10,997   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-03-08T03:13:11,000   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-03-08T03:13:11,002   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-03-08T03:13:11,005   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-03-08T03:13:11,007   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-03-08T03:13:11,010   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-03-08T03:13:11,012   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-03-08T03:13:11,013   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-03-08T03:13:11,015   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-03-08T03:13:11,017   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-03-08T03:13:11,019   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-03-08T03:13:11,021   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-03-08T03:13:11,023   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-03-08T03:13:11,025   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-03-08T03:13:11,027   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-03-08T03:13:11,029   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-03-08T03:13:11,030   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-03-08T03:13:11,032   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-03-08T03:13:11,034   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-03-08T03:13:11,036   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-03-08T03:13:11,039   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-03-08T03:13:11,041   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-03-08T03:13:11,043   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-03-08T03:13:11,045   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-03-08T03:13:11,047   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-03-08T03:13:11,049   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-03-08T03:13:11,050   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-03-08T03:13:11,052   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-03-08T03:13:11,053   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-03-08T03:13:11,055   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-03-08T03:13:11,057   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-03-08T03:13:11,058   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-03-08T03:13:11,059   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-03-08T03:13:11,061   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-03-08T03:13:11,062   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-03-08T03:13:11,064   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-03-08T03:13:11,065   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-03-08T03:13:11,067   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-03-08T03:13:11,068   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-03-08T03:13:11,070   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-03-08T03:13:11,072   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-03-08T03:13:11,074   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-03-08T03:13:11,076   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-03-08T03:13:11,078   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-03-08T03:13:11,081   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-03-08T03:13:11,082   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-03-08T03:13:11,084   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-03-08T03:13:11,086   adding 'deepspeed/launcher/__init__.py'
2024-03-08T03:13:11,087   adding 'deepspeed/launcher/constants.py'
2024-03-08T03:13:11,089   adding 'deepspeed/launcher/launch.py'
2024-03-08T03:13:11,091   adding 'deepspeed/launcher/launcher_helper.py'
2024-03-08T03:13:11,093   adding 'deepspeed/launcher/multinode_runner.py'
2024-03-08T03:13:11,096   adding 'deepspeed/launcher/runner.py'
2024-03-08T03:13:11,098   adding 'deepspeed/model_implementations/__init__.py'
2024-03-08T03:13:11,100   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-03-08T03:13:11,101   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-03-08T03:13:11,102   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-03-08T03:13:11,104   adding 'deepspeed/model_implementations/features/__init__.py'
2024-03-08T03:13:11,105   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-03-08T03:13:11,107   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-03-08T03:13:11,109   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-03-08T03:13:11,110   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-03-08T03:13:11,111   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-03-08T03:13:11,112   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-03-08T03:13:11,113   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-03-08T03:13:11,115   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-03-08T03:13:11,116   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-03-08T03:13:11,117   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-03-08T03:13:11,119   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-03-08T03:13:11,121   adding 'deepspeed/module_inject/__init__.py'
2024-03-08T03:13:11,124   adding 'deepspeed/module_inject/auto_tp.py'
2024-03-08T03:13:11,125   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-03-08T03:13:11,127   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-03-08T03:13:11,128   adding 'deepspeed/module_inject/inject.py'
2024-03-08T03:13:11,130   adding 'deepspeed/module_inject/layers.py'
2024-03-08T03:13:11,132   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-03-08T03:13:11,133   adding 'deepspeed/module_inject/module_quantize.py'
2024-03-08T03:13:11,135   adding 'deepspeed/module_inject/policy.py'
2024-03-08T03:13:11,138   adding 'deepspeed/module_inject/replace_module.py'
2024-03-08T03:13:11,140   adding 'deepspeed/module_inject/replace_policy.py'
2024-03-08T03:13:11,141   adding 'deepspeed/module_inject/tp_shard.py'
2024-03-08T03:13:11,143   adding 'deepspeed/module_inject/utils.py'
2024-03-08T03:13:11,145   adding 'deepspeed/module_inject/containers/__init__.py'
2024-03-08T03:13:11,147   adding 'deepspeed/module_inject/containers/base.py'
2024-03-08T03:13:11,148   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-03-08T03:13:11,150   adding 'deepspeed/module_inject/containers/bert.py'
2024-03-08T03:13:11,151   adding 'deepspeed/module_inject/containers/bloom.py'
2024-03-08T03:13:11,152   adding 'deepspeed/module_inject/containers/clip.py'
2024-03-08T03:13:11,154   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-03-08T03:13:11,155   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-03-08T03:13:11,157   adding 'deepspeed/module_inject/containers/gptj.py'
2024-03-08T03:13:11,158   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-03-08T03:13:11,160   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-03-08T03:13:11,161   adding 'deepspeed/module_inject/containers/internlm.py'
2024-03-08T03:13:11,163   adding 'deepspeed/module_inject/containers/llama.py'
2024-03-08T03:13:11,164   adding 'deepspeed/module_inject/containers/llama2.py'
2024-03-08T03:13:11,166   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-03-08T03:13:11,167   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-03-08T03:13:11,169   adding 'deepspeed/module_inject/containers/opt.py'
2024-03-08T03:13:11,170   adding 'deepspeed/module_inject/containers/unet.py'
2024-03-08T03:13:11,172   adding 'deepspeed/module_inject/containers/vae.py'
2024-03-08T03:13:11,173   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-03-08T03:13:11,175   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-03-08T03:13:11,176   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-03-08T03:13:11,178   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-03-08T03:13:11,179   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-03-08T03:13:11,181   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-03-08T03:13:11,182   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-03-08T03:13:11,185   adding 'deepspeed/moe/__init__.py'
2024-03-08T03:13:11,186   adding 'deepspeed/moe/experts.py'
2024-03-08T03:13:11,188   adding 'deepspeed/moe/layer.py'
2024-03-08T03:13:11,189   adding 'deepspeed/moe/mappings.py'
2024-03-08T03:13:11,192   adding 'deepspeed/moe/sharded_moe.py'
2024-03-08T03:13:11,194   adding 'deepspeed/moe/utils.py'
2024-03-08T03:13:11,196   adding 'deepspeed/monitor/__init__.py'
2024-03-08T03:13:11,198   adding 'deepspeed/monitor/config.py'
2024-03-08T03:13:11,199   adding 'deepspeed/monitor/csv_monitor.py'
2024-03-08T03:13:11,200   adding 'deepspeed/monitor/monitor.py'
2024-03-08T03:13:11,202   adding 'deepspeed/monitor/tensorboard.py'
2024-03-08T03:13:11,203   adding 'deepspeed/monitor/utils.py'
2024-03-08T03:13:11,204   adding 'deepspeed/monitor/wandb.py'
2024-03-08T03:13:11,206   adding 'deepspeed/nebula/__init__.py'
2024-03-08T03:13:11,207   adding 'deepspeed/nebula/config.py'
2024-03-08T03:13:11,209   adding 'deepspeed/nebula/constants.py'
2024-03-08T03:13:11,211   adding 'deepspeed/ops/__init__.py'
2024-03-08T03:13:11,212   adding 'deepspeed/ops/adagrad/__init__.py'
2024-03-08T03:13:11,214   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-03-08T03:13:11,216   adding 'deepspeed/ops/adam/__init__.py'
2024-03-08T03:13:11,217   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-03-08T03:13:11,219   adding 'deepspeed/ops/adam/fused_adam.py'
2024-03-08T03:13:11,221   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-03-08T03:13:11,222   adding 'deepspeed/ops/aio/__init__.py'
2024-03-08T03:13:11,225   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-03-08T03:13:11,227   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-03-08T03:13:11,229   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-03-08T03:13:11,230   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-03-08T03:13:11,232   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-03-08T03:13:11,233   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-03-08T03:13:11,237   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-03-08T03:13:11,238   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-03-08T03:13:11,239   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-03-08T03:13:11,241   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-03-08T03:13:11,242   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-03-08T03:13:11,244   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-03-08T03:13:11,246   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-03-08T03:13:11,247   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-03-08T03:13:11,249   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-03-08T03:13:11,251   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-03-08T03:13:11,253   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-03-08T03:13:11,255   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-03-08T03:13:11,257   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-03-08T03:13:11,260   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-03-08T03:13:11,262   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-03-08T03:13:11,264   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-03-08T03:13:11,266   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-03-08T03:13:11,268   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-03-08T03:13:11,271   adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu'
2024-03-08T03:13:11,274   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-03-08T03:13:11,279   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-03-08T03:13:11,282   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-03-08T03:13:11,285   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-03-08T03:13:11,288   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-03-08T03:13:11,290   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-03-08T03:13:11,293   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-03-08T03:13:11,308   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-03-08T03:13:11,316   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-03-08T03:13:11,320   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-03-08T03:13:11,325   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-03-08T03:13:11,328   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-03-08T03:13:11,331   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-03-08T03:13:11,334   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-03-08T03:13:11,337   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-03-08T03:13:11,342   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-03-08T03:13:11,346   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-03-08T03:13:11,349   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-03-08T03:13:11,351   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-03-08T03:13:11,359   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-03-08T03:13:11,363   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-03-08T03:13:11,365   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-03-08T03:13:11,370   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-03-08T03:13:11,373   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-03-08T03:13:11,378   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-03-08T03:13:11,380   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-03-08T03:13:11,382   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-03-08T03:13:11,384   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-03-08T03:13:11,386   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-03-08T03:13:11,388   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-03-08T03:13:11,389   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-03-08T03:13:11,390   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-03-08T03:13:11,392   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-03-08T03:13:11,393   adding 'deepspeed/ops/csrc/includes/context.h'
2024-03-08T03:13:11,395   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-03-08T03:13:11,397   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-03-08T03:13:11,399   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-03-08T03:13:11,401   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-03-08T03:13:11,402   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-03-08T03:13:11,404   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-03-08T03:13:11,406   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-03-08T03:13:11,407   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-03-08T03:13:11,409   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-03-08T03:13:11,410   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-03-08T03:13:11,412   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-03-08T03:13:11,413   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-03-08T03:13:11,414   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-03-08T03:13:11,416   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-03-08T03:13:11,418   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-03-08T03:13:11,420   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-03-08T03:13:11,422   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-03-08T03:13:11,424   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-03-08T03:13:11,425   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-03-08T03:13:11,427   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-03-08T03:13:11,429   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-03-08T03:13:11,430   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-03-08T03:13:11,432   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-03-08T03:13:11,434   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-03-08T03:13:11,436   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-03-08T03:13:11,438   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-03-08T03:13:11,440   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-03-08T03:13:11,442   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-03-08T03:13:11,443   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-03-08T03:13:11,444   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-03-08T03:13:11,446   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-03-08T03:13:11,448   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-03-08T03:13:11,451   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-03-08T03:13:11,453   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-03-08T03:13:11,455   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-03-08T03:13:11,457   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-03-08T03:13:11,458   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-03-08T03:13:11,460   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-03-08T03:13:11,462   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-03-08T03:13:11,464   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-03-08T03:13:11,466   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-03-08T03:13:11,468   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-03-08T03:13:11,470   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-03-08T03:13:11,472   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-03-08T03:13:11,473   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-03-08T03:13:11,476   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-03-08T03:13:11,478   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-03-08T03:13:11,481   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-03-08T03:13:11,485   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-03-08T03:13:11,487   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-03-08T03:13:11,489   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-03-08T03:13:11,493   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-03-08T03:13:11,496   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-03-08T03:13:11,498   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-03-08T03:13:11,502   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-03-08T03:13:11,503   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-03-08T03:13:11,506   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-03-08T03:13:11,509   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-03-08T03:13:11,510   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-03-08T03:13:11,516   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-03-08T03:13:11,518   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-03-08T03:13:11,520   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-03-08T03:13:11,522   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-03-08T03:13:11,525   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-03-08T03:13:11,528   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-03-08T03:13:11,530   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-03-08T03:13:11,531   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-03-08T03:13:11,534   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-03-08T03:13:11,536   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-03-08T03:13:11,539   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp'
2024-03-08T03:13:11,540   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp'
2024-03-08T03:13:11,542   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-03-08T03:13:11,543   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-03-08T03:13:11,545   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-03-08T03:13:11,547   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-03-08T03:13:11,548   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-03-08T03:13:11,550   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-03-08T03:13:11,551   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-03-08T03:13:11,553   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-03-08T03:13:11,555   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-03-08T03:13:11,556   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-03-08T03:13:11,558   adding 'deepspeed/ops/lamb/__init__.py'
2024-03-08T03:13:11,560   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-03-08T03:13:11,562   adding 'deepspeed/ops/lion/__init__.py'
2024-03-08T03:13:11,563   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-03-08T03:13:11,565   adding 'deepspeed/ops/lion/fused_lion.py'
2024-03-08T03:13:11,566   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-03-08T03:13:11,569   adding 'deepspeed/ops/op_builder/__init__.py'
2024-03-08T03:13:11,570   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-03-08T03:13:11,572   adding 'deepspeed/ops/op_builder/async_io.py'
2024-03-08T03:13:11,576   adding 'deepspeed/ops/op_builder/builder.py'
2024-03-08T03:13:11,577   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-03-08T03:13:11,578   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-03-08T03:13:11,580   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-03-08T03:13:11,581   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-03-08T03:13:11,583   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-03-08T03:13:11,584   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-03-08T03:13:11,585   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-03-08T03:13:11,586   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-03-08T03:13:11,587   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-03-08T03:13:11,589   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-03-08T03:13:11,590   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-03-08T03:13:11,591   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-03-08T03:13:11,592   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-03-08T03:13:11,594   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-03-08T03:13:11,595   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-03-08T03:13:11,596   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-03-08T03:13:11,597   adding 'deepspeed/ops/op_builder/transformer.py'
2024-03-08T03:13:11,599   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-03-08T03:13:11,601   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-03-08T03:13:11,602   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-03-08T03:13:11,603   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-03-08T03:13:11,604   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-03-08T03:13:11,605   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-03-08T03:13:11,607   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-03-08T03:13:11,609   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-03-08T03:13:11,610   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-03-08T03:13:11,611   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-03-08T03:13:11,613   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-03-08T03:13:11,614   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-03-08T03:13:11,616   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-03-08T03:13:11,617   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-03-08T03:13:11,619   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-03-08T03:13:11,620   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-03-08T03:13:11,622   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-03-08T03:13:11,623   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-03-08T03:13:11,624   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-03-08T03:13:11,626   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-03-08T03:13:11,627   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-03-08T03:13:11,629   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-03-08T03:13:11,631   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-03-08T03:13:11,633   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-03-08T03:13:11,634   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-03-08T03:13:11,635   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-03-08T03:13:11,637   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-03-08T03:13:11,639   adding 'deepspeed/ops/quantizer/__init__.py'
2024-03-08T03:13:11,640   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-03-08T03:13:11,642   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-03-08T03:13:11,643   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-03-08T03:13:11,645   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-03-08T03:13:11,647   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-03-08T03:13:11,651   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-03-08T03:13:11,653   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-03-08T03:13:11,655   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-03-08T03:13:11,657   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-03-08T03:13:11,661   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-03-08T03:13:11,663   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-03-08T03:13:11,665   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-03-08T03:13:11,666   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-03-08T03:13:11,667   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-03-08T03:13:11,669   adding 'deepspeed/ops/transformer/__init__.py'
2024-03-08T03:13:11,671   adding 'deepspeed/ops/transformer/transformer.py'
2024-03-08T03:13:11,673   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-03-08T03:13:11,674   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-03-08T03:13:11,676   adding 'deepspeed/ops/transformer/inference/config.py'
2024-03-08T03:13:11,677   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-03-08T03:13:11,678   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-03-08T03:13:11,680   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-03-08T03:13:11,682   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-03-08T03:13:11,684   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-03-08T03:13:11,686   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-03-08T03:13:11,688   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-03-08T03:13:11,690   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-03-08T03:13:11,691   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-03-08T03:13:11,692   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-03-08T03:13:11,694   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-03-08T03:13:11,695   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-03-08T03:13:11,697   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-03-08T03:13:11,699   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-03-08T03:13:11,700   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-03-08T03:13:11,703   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-03-08T03:13:11,705   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-03-08T03:13:11,707   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-03-08T03:13:11,709   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-03-08T03:13:11,711   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-03-08T03:13:11,712   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-03-08T03:13:11,714   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-03-08T03:13:11,715   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-03-08T03:13:11,717   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-03-08T03:13:11,718   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-03-08T03:13:11,720   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-03-08T03:13:11,722   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-03-08T03:13:11,724   adding 'deepspeed/pipe/__init__.py'
2024-03-08T03:13:11,725   adding 'deepspeed/profiling/__init__.py'
2024-03-08T03:13:11,727   adding 'deepspeed/profiling/config.py'
2024-03-08T03:13:11,728   adding 'deepspeed/profiling/constants.py'
2024-03-08T03:13:11,730   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-03-08T03:13:11,735   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-03-08T03:13:11,738   adding 'deepspeed/runtime/__init__.py'
2024-03-08T03:13:11,741   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-03-08T03:13:11,743   adding 'deepspeed/runtime/compiler.py'
2024-03-08T03:13:11,747   adding 'deepspeed/runtime/config.py'
2024-03-08T03:13:11,749   adding 'deepspeed/runtime/config_utils.py'
2024-03-08T03:13:11,751   adding 'deepspeed/runtime/constants.py'
2024-03-08T03:13:11,753   adding 'deepspeed/runtime/dataloader.py'
2024-03-08T03:13:11,755   adding 'deepspeed/runtime/eigenvalue.py'
2024-03-08T03:13:11,773   adding 'deepspeed/runtime/engine.py'
2024-03-08T03:13:11,776   adding 'deepspeed/runtime/hybrid_engine.py'
2024-03-08T03:13:11,780   adding 'deepspeed/runtime/lr_schedules.py'
2024-03-08T03:13:11,781   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-03-08T03:13:11,783   adding 'deepspeed/runtime/quantize.py'
2024-03-08T03:13:11,784   adding 'deepspeed/runtime/sparse_tensor.py'
2024-03-08T03:13:11,786   adding 'deepspeed/runtime/state_dict_factory.py'
2024-03-08T03:13:11,791   adding 'deepspeed/runtime/utils.py'
2024-03-08T03:13:11,792   adding 'deepspeed/runtime/weight_quantizer.py'
2024-03-08T03:13:11,794   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-03-08T03:13:11,799   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-03-08T03:13:11,800   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-03-08T03:13:11,802   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-03-08T03:13:11,803   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-03-08T03:13:11,805   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-03-08T03:13:11,806   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-03-08T03:13:11,808   adding 'deepspeed/runtime/comm/__init__.py'
2024-03-08T03:13:11,809   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-03-08T03:13:11,811   adding 'deepspeed/runtime/comm/hccl.py'
2024-03-08T03:13:11,812   adding 'deepspeed/runtime/comm/mpi.py'
2024-03-08T03:13:11,814   adding 'deepspeed/runtime/comm/nccl.py'
2024-03-08T03:13:11,816   adding 'deepspeed/runtime/compression/__init__.py'
2024-03-08T03:13:11,817   adding 'deepspeed/runtime/compression/cupy.py'
2024-03-08T03:13:11,819   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-03-08T03:13:11,820   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-03-08T03:13:11,822   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-03-08T03:13:11,824   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-03-08T03:13:11,825   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-03-08T03:13:11,827   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-03-08T03:13:11,828   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-03-08T03:13:11,830   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-03-08T03:13:11,831   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-03-08T03:13:11,832   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-03-08T03:13:11,837   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-03-08T03:13:11,840   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-03-08T03:13:11,843   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-03-08T03:13:11,844   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-03-08T03:13:11,846   adding 'deepspeed/runtime/fp16/__init__.py'
2024-03-08T03:13:11,849   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-03-08T03:13:11,851   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-03-08T03:13:11,853   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-03-08T03:13:11,855   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-03-08T03:13:11,857   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-03-08T03:13:11,860   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-03-08T03:13:11,863   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-03-08T03:13:11,865   adding 'deepspeed/runtime/pipe/__init__.py'
2024-03-08T03:13:11,871   adding 'deepspeed/runtime/pipe/engine.py'
2024-03-08T03:13:11,875   adding 'deepspeed/runtime/pipe/module.py'
2024-03-08T03:13:11,877   adding 'deepspeed/runtime/pipe/p2p.py'
2024-03-08T03:13:11,879   adding 'deepspeed/runtime/pipe/schedule.py'
2024-03-08T03:13:11,882   adding 'deepspeed/runtime/pipe/topology.py'
2024-03-08T03:13:11,884   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-03-08T03:13:11,885   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-03-08T03:13:11,887   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-03-08T03:13:11,888   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-03-08T03:13:11,891   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-03-08T03:13:11,892   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-03-08T03:13:11,895   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-03-08T03:13:11,897   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-03-08T03:13:11,899   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-03-08T03:13:11,901   adding 'deepspeed/runtime/zero/__init__.py'
2024-03-08T03:13:11,903   adding 'deepspeed/runtime/zero/config.py'
2024-03-08T03:13:11,905   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-03-08T03:13:11,907   adding 'deepspeed/runtime/zero/linear.py'
2024-03-08T03:13:11,910   adding 'deepspeed/runtime/zero/mics.py'
2024-03-08T03:13:11,912   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-03-08T03:13:11,913   adding 'deepspeed/runtime/zero/offload_config.py'
2024-03-08T03:13:11,916   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-03-08T03:13:11,927   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-03-08T03:13:11,931   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-03-08T03:13:11,933   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-03-08T03:13:11,947   adding 'deepspeed/runtime/zero/stage3.py'
2024-03-08T03:13:11,961   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-03-08T03:13:11,964   adding 'deepspeed/runtime/zero/test.py'
2024-03-08T03:13:11,966   adding 'deepspeed/runtime/zero/tiling.py'
2024-03-08T03:13:11,967   adding 'deepspeed/runtime/zero/utils.py'
2024-03-08T03:13:11,969   adding 'deepspeed/sequence/__init__.py'
2024-03-08T03:13:11,970   adding 'deepspeed/sequence/layer.py'
2024-03-08T03:13:11,972   adding 'deepspeed/utils/__init__.py'
2024-03-08T03:13:11,974   adding 'deepspeed/utils/comms_logging.py'
2024-03-08T03:13:11,976   adding 'deepspeed/utils/debug.py'
2024-03-08T03:13:11,977   adding 'deepspeed/utils/exceptions.py'
2024-03-08T03:13:11,980   adding 'deepspeed/utils/groups.py'
2024-03-08T03:13:11,981   adding 'deepspeed/utils/init_on_device.py'
2024-03-08T03:13:11,983   adding 'deepspeed/utils/logging.py'
2024-03-08T03:13:11,984   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-03-08T03:13:11,986   adding 'deepspeed/utils/numa.py'
2024-03-08T03:13:11,987   adding 'deepspeed/utils/nvtx.py'
2024-03-08T03:13:11,989   adding 'deepspeed/utils/tensor_fragment.py'
2024-03-08T03:13:11,990   adding 'deepspeed/utils/timer.py'
2024-03-08T03:13:11,992   adding 'deepspeed/utils/types.py'
2024-03-08T03:13:11,993   adding 'deepspeed/utils/z3_leaf_module.py'
2024-03-08T03:13:11,996   adding 'deepspeed/utils/zero_to_fp32.py'
2024-03-08T03:13:11,998   adding 'deepspeed-0.14.0.data/scripts/deepspeed'
2024-03-08T03:13:12,000   adding 'deepspeed-0.14.0.data/scripts/deepspeed.pt'
2024-03-08T03:13:12,001   adding 'deepspeed-0.14.0.data/scripts/ds'
2024-03-08T03:13:12,002   adding 'deepspeed-0.14.0.data/scripts/ds_bench'
2024-03-08T03:13:12,004   adding 'deepspeed-0.14.0.data/scripts/ds_elastic'
2024-03-08T03:13:12,005   adding 'deepspeed-0.14.0.data/scripts/ds_report'
2024-03-08T03:13:12,006   adding 'deepspeed-0.14.0.data/scripts/ds_ssh'
2024-03-08T03:13:12,008   adding 'deepspeed-0.14.0.data/scripts/dsr'
2024-03-08T03:13:12,014   adding 'deepspeed-0.14.0.dist-info/METADATA'
2024-03-08T03:13:12,015   adding 'deepspeed-0.14.0.dist-info/WHEEL'
2024-03-08T03:13:12,016   adding 'deepspeed-0.14.0.dist-info/entry_points.txt'
2024-03-08T03:13:12,017   adding 'deepspeed-0.14.0.dist-info/top_level.txt'
2024-03-08T03:13:12,031   adding 'deepspeed-0.14.0.dist-info/RECORD'
2024-03-08T03:13:12,107   removing build/bdist.linux-armv7l/wheel
2024-03-08T03:13:12,365   deepspeed build time = 14.132833003997803 secs
2024-03-08T03:13:12,485   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-03-08T03:13:12,502   Created wheel for deepspeed: filename=deepspeed-0.14.0-py3-none-any.whl size=1400358 sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c
2024-03-08T03:13:12,503   Stored in directory: /tmp/pip-ephem-wheel-cache-5hdkyxpg/wheels/21/93/10/aca4f9f9390297a80a58fb8db0fcdcf1f41499d1afe922a513
2024-03-08T03:13:12,543 Successfully built deepspeed
2024-03-08T03:13:12,596 Removed build tracker: '/tmp/pip-build-tracker-g9eq6m5o'