2024-02-27T01:00:39,656 Created temporary directory: /tmp/pip-build-tracker-rlkrbsn8
2024-02-27T01:00:39,657 Initialized build tracking at /tmp/pip-build-tracker-rlkrbsn8
2024-02-27T01:00:39,657 Created build tracker: /tmp/pip-build-tracker-rlkrbsn8
2024-02-27T01:00:39,658 Entered build tracker: /tmp/pip-build-tracker-rlkrbsn8
2024-02-27T01:00:39,659 Created temporary directory: /tmp/pip-wheel-xpklnikz
2024-02-27T01:00:39,662 Created temporary directory: /tmp/pip-ephem-wheel-cache-o1vyhtk_
2024-02-27T01:00:39,683 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-02-27T01:00:39,687 2 location(s) to search for versions of deepspeed:
2024-02-27T01:00:39,687 * https://pypi.org/simple/deepspeed/
2024-02-27T01:00:39,687 * https://www.piwheels.org/simple/deepspeed/
2024-02-27T01:00:39,687 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-02-27T01:00:39,688 Getting page https://pypi.org/simple/deepspeed/
2024-02-27T01:00:39,690 Found index url https://pypi.org/simple/
2024-02-27T01:00:39,829 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-02-27T01:00:39,845   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-27T01:00:39,846   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-02-27T01:00:39,846   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-27T01:00:39,847   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-02-27T01:00:39,847   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-27T01:00:39,848   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-02-27T01:00:39,849   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-27T01:00:39,849   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-02-27T01:00:39,850   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-27T01:00:39,851   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-02-27T01:00:39,851   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-02-27T01:00:39,852   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-02-27T01:00:39,853   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-02-27T01:00:39,854   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-02-27T01:00:39,855   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-02-27T01:00:39,855   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-02-27T01:00:39,856   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-02-27T01:00:39,856   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-02-27T01:00:39,857   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-02-27T01:00:39,857   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-02-27T01:00:39,858   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-02-27T01:00:39,859   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-02-27T01:00:39,859   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-02-27T01:00:39,860   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-02-27T01:00:39,861   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-02-27T01:00:39,861   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-02-27T01:00:39,862   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-02-27T01:00:39,863   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-02-27T01:00:39,863   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-02-27T01:00:39,864   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-02-27T01:00:39,865   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-02-27T01:00:39,866   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-02-27T01:00:39,866   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-02-27T01:00:39,867   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-02-27T01:00:39,867   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-02-27T01:00:39,868   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-02-27T01:00:39,869   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-02-27T01:00:39,869   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-02-27T01:00:39,870   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-02-27T01:00:39,870   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-02-27T01:00:39,871   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-02-27T01:00:39,872   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-02-27T01:00:39,873   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-02-27T01:00:39,873   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-02-27T01:00:39,874   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-02-27T01:00:39,875   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-02-27T01:00:39,875   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-02-27T01:00:39,876   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-02-27T01:00:39,877   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-02-27T01:00:39,878   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-02-27T01:00:39,878   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-02-27T01:00:39,879   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-02-27T01:00:39,880   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-02-27T01:00:39,880   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-02-27T01:00:39,881   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-02-27T01:00:39,881   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-02-27T01:00:39,882   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-02-27T01:00:39,883   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-02-27T01:00:39,883   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-02-27T01:00:39,884   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-02-27T01:00:39,885   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-02-27T01:00:39,886   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-02-27T01:00:39,886   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-02-27T01:00:39,887   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-02-27T01:00:39,888   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-02-27T01:00:39,888   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-02-27T01:00:39,889   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-02-27T01:00:39,890   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-02-27T01:00:39,891   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-02-27T01:00:39,891   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-02-27T01:00:39,892   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-02-27T01:00:39,892   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-02-27T01:00:39,893   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-02-27T01:00:39,893   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-02-27T01:00:39,894   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-02-27T01:00:39,895   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-02-27T01:00:39,895   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-02-27T01:00:39,896   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-02-27T01:00:39,897   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-02-27T01:00:39,897   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-02-27T01:00:39,898   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-02-27T01:00:39,899   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-02-27T01:00:39,899   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-02-27T01:00:39,900   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-02-27T01:00:39,900   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-02-27T01:00:39,901   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-02-27T01:00:39,902   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-02-27T01:00:39,902   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-02-27T01:00:39,903   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-02-27T01:00:39,903   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-02-27T01:00:39,904 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-02-27T01:00:39,905 Getting page https://www.piwheels.org/simple/deepspeed/
2024-02-27T01:00:39,906 Found index url https://www.piwheels.org/simple/
2024-02-27T01:00:43,103 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-02-27T01:00:43,135   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,136   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,137   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,138   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,138   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,139   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,140   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,141   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,142   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,142   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,143   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,144   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,145   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,146   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,146   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,147   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,148   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,148   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,149   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,150   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,151   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,152   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,152   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,153   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,154   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,155   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,156   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,156   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,157   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,157   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,158   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,158   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,159   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,160   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,161   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,162   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,162   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,163   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,163   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,164   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,165   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,166   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,166   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,167   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,167   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,168   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,169   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,169   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,170   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,171   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,171   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,172   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,173   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,174   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,174   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,175   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,176   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,176   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,177   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-02-27T01:00:43,178 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-02-27T01:00:43,178 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-02-27T01:00:43,226 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-02-27T01:00:43,249 Collecting deepspeed==0.13.4
2024-02-27T01:00:43,252   Created temporary directory: /tmp/pip-unpack-8jg7mwi7
2024-02-27T01:00:43,474   Downloading deepspeed-0.13.4.tar.gz (1.3 MB)
2024-02-27T01:00:45,687   Added deepspeed==0.13.4 from https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz to build tracker '/tmp/pip-build-tracker-rlkrbsn8'
2024-02-27T01:00:45,689   Running setup.py (path:/tmp/pip-wheel-xpklnikz/deepspeed_c29b33c1900f41cd97ba99330e08a25f/setup.py) egg_info for package deepspeed
2024-02-27T01:00:45,690   Created temporary directory: /tmp/pip-pip-egg-info-zg4eh01s
2024-02-27T01:00:45,690   Preparing metadata (setup.py): started
2024-02-27T01:00:45,692   Running command python setup.py egg_info
2024-02-27T01:00:46,558   fatal: not a git repository (or any of the parent directories): .git
2024-02-27T01:00:47,276   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-02-27T01:00:47,277    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-02-27T01:00:47,277   DS_BUILD_OPS=0
2024-02-27T01:00:47,278    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-02-27T01:00:47,278    [WARNING]  async_io: please install the libaio-dev package with apt
2024-02-27T01:00:47,279    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-02-27T01:00:47,279    [WARNING]  Please install torch if trying to pre-compile kernels
2024-02-27T01:00:47,280    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:47,281    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:47,281    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:47,282    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:47,282    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:47,283    [WARNING]  unable to import torch, please install it first
2024-02-27T01:00:47,284    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:47,284   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-02-27T01:00:47,285   version=0.13.4, git_hash=unknown, git_branch=unknown
2024-02-27T01:00:47,285   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-02-27T01:00:47,286   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False}
2024-02-27T01:00:47,286   ext_modules=[]
2024-02-27T01:00:47,286   running egg_info
2024-02-27T01:00:47,287   creating /tmp/pip-pip-egg-info-zg4eh01s/deepspeed.egg-info
2024-02-27T01:00:47,313   writing /tmp/pip-pip-egg-info-zg4eh01s/deepspeed.egg-info/PKG-INFO
2024-02-27T01:00:47,345   writing dependency_links to /tmp/pip-pip-egg-info-zg4eh01s/deepspeed.egg-info/dependency_links.txt
2024-02-27T01:00:47,347   writing entry points to /tmp/pip-pip-egg-info-zg4eh01s/deepspeed.egg-info/entry_points.txt
2024-02-27T01:00:47,363   writing requirements to /tmp/pip-pip-egg-info-zg4eh01s/deepspeed.egg-info/requires.txt
2024-02-27T01:00:47,364   writing top-level names to /tmp/pip-pip-egg-info-zg4eh01s/deepspeed.egg-info/top_level.txt
2024-02-27T01:00:47,365   writing manifest file '/tmp/pip-pip-egg-info-zg4eh01s/deepspeed.egg-info/SOURCES.txt'
2024-02-27T01:00:47,603   reading manifest file '/tmp/pip-pip-egg-info-zg4eh01s/deepspeed.egg-info/SOURCES.txt'
2024-02-27T01:00:47,605   reading manifest template 'MANIFEST.in'
2024-02-27T01:00:47,607   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-02-27T01:00:47,607   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-02-27T01:00:48,697   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-02-27T01:00:49,470   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-02-27T01:00:49,948   warning: no files found matching '*.tr' under directory 'csrc'
2024-02-27T01:00:50,049   warning: no files found matching '*.cc' under directory 'csrc'
2024-02-27T01:00:50,083   warning: no files found matching '*.py' under directory 'benchmarks'
2024-02-27T01:00:50,118   writing manifest file '/tmp/pip-pip-egg-info-zg4eh01s/deepspeed.egg-info/SOURCES.txt'
2024-02-27T01:00:50,121   deepspeed build time = 3.559980869293213 secs
2024-02-27T01:00:50,235   Preparing metadata (setup.py): finished with status 'done'
2024-02-27T01:00:50,242   Source in /tmp/pip-wheel-xpklnikz/deepspeed_c29b33c1900f41cd97ba99330e08a25f has version 0.13.4, which satisfies requirement deepspeed==0.13.4 from https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz
2024-02-27T01:00:50,243   Removed deepspeed==0.13.4 from https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz from build tracker '/tmp/pip-build-tracker-rlkrbsn8'
2024-02-27T01:00:50,251 Created temporary directory: /tmp/pip-unpack-zm5y2zjm
2024-02-27T01:00:50,252 Created temporary directory: /tmp/pip-unpack-si5ivye0
2024-02-27T01:00:50,498 Building wheels for collected packages: deepspeed
2024-02-27T01:00:50,503   Created temporary directory: /tmp/pip-wheel-5pqd6hzz
2024-02-27T01:00:50,503   Building wheel for deepspeed (setup.py): started
2024-02-27T01:00:50,505   Destination directory: /tmp/pip-wheel-5pqd6hzz
2024-02-27T01:00:50,506   Running command python setup.py bdist_wheel
2024-02-27T01:00:50,952   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-02-27T01:00:50,961    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-02-27T01:00:51,037   DS_BUILD_OPS=0
2024-02-27T01:00:51,148    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-02-27T01:00:51,206    [WARNING]  async_io: please install the libaio-dev package with apt
2024-02-27T01:00:51,207    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-02-27T01:00:51,208    [WARNING]  Please install torch if trying to pre-compile kernels
2024-02-27T01:00:51,208    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:51,209    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:51,209    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:51,210    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:51,211    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:51,211    [WARNING]  unable to import torch, please install it first
2024-02-27T01:00:51,212    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-27T01:00:51,213   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-02-27T01:00:51,221   fatal: not a git repository (or any of the parent directories): .git
2024-02-27T01:00:51,223   version=0.13.4, git_hash=unknown, git_branch=unknown
2024-02-27T01:00:51,224   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-02-27T01:00:51,225   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False}
2024-02-27T01:00:51,225   ext_modules=[]
2024-02-27T01:00:51,919   running bdist_wheel
2024-02-27T01:00:52,052   running build
2024-02-27T01:00:52,053   running build_py
2024-02-27T01:00:52,089   creating build
2024-02-27T01:00:52,089   creating build/lib
2024-02-27T01:00:52,090   creating build/lib/deepspeed
2024-02-27T01:00:52,091   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2024-02-27T01:00:52,093   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-02-27T01:00:52,095   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-02-27T01:00:52,097   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-02-27T01:00:52,099   copying deepspeed/constants.py -> build/lib/deepspeed
2024-02-27T01:00:52,101   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-02-27T01:00:52,103   creating build/lib/deepspeed/elasticity
2024-02-27T01:00:52,104   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-02-27T01:00:52,106   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-02-27T01:00:52,108   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-02-27T01:00:52,109   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-02-27T01:00:52,112   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-02-27T01:00:52,113   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-02-27T01:00:52,115   creating build/lib/deepspeed/moe
2024-02-27T01:00:52,116   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-02-27T01:00:52,118   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-02-27T01:00:52,119   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-02-27T01:00:52,121   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-02-27T01:00:52,123   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-02-27T01:00:52,125   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-02-27T01:00:52,128   creating build/lib/deepspeed/inference
2024-02-27T01:00:52,129   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-02-27T01:00:52,131   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-02-27T01:00:52,133   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-02-27T01:00:52,135   creating build/lib/deepspeed/autotuning
2024-02-27T01:00:52,136   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-02-27T01:00:52,138   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-02-27T01:00:52,140   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-02-27T01:00:52,142   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-02-27T01:00:52,144   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-02-27T01:00:52,146   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-02-27T01:00:52,150   creating build/lib/deepspeed/pipe
2024-02-27T01:00:52,151   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-02-27T01:00:52,153   creating build/lib/deepspeed/monitor
2024-02-27T01:00:52,154   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-02-27T01:00:52,155   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-02-27T01:00:52,157   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-02-27T01:00:52,159   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-02-27T01:00:52,160   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-02-27T01:00:52,162   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-02-27T01:00:52,163   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-02-27T01:00:52,166   creating build/lib/deepspeed/comm
2024-02-27T01:00:52,167   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-02-27T01:00:52,168   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-02-27T01:00:52,170   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-02-27T01:00:52,172   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-02-27T01:00:52,174   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-02-27T01:00:52,176   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-02-27T01:00:52,178   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-02-27T01:00:52,179   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-02-27T01:00:52,182   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-02-27T01:00:52,184   creating build/lib/deepspeed/ops
2024-02-27T01:00:52,185   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-02-27T01:00:52,187   creating build/lib/deepspeed/model_implementations
2024-02-27T01:00:52,188   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-02-27T01:00:52,190   creating build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,191   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,193   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,195   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,197   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,199   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,201   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,202   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,204   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,206   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,207   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-02-27T01:00:52,210   creating build/lib/deepspeed/profiling
2024-02-27T01:00:52,211   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-02-27T01:00:52,212   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-02-27T01:00:52,214   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-02-27T01:00:52,216   creating build/lib/deepspeed/compression
2024-02-27T01:00:52,217   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-02-27T01:00:52,220   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-02-27T01:00:52,222   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-02-27T01:00:52,224   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-02-27T01:00:52,226   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-02-27T01:00:52,228   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-02-27T01:00:52,230   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-02-27T01:00:52,232   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-02-27T01:00:52,235   creating build/lib/deepspeed/module_inject
2024-02-27T01:00:52,236   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,238   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,241   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,242   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,245   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,247   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,249   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,250   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,252   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,254   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,256   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,258   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,260   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-02-27T01:00:52,262   creating build/lib/deepspeed/nebula
2024-02-27T01:00:52,263   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-02-27T01:00:52,265   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-02-27T01:00:52,266   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-02-27T01:00:52,268   creating build/lib/deepspeed/utils
2024-02-27T01:00:52,269   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,271   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,273   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,275   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,278   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,279   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,281   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,283   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,285   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,287   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,289   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,291   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,293   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,294   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,297   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-02-27T01:00:52,299   creating build/lib/deepspeed/launcher
2024-02-27T01:00:52,300   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-02-27T01:00:52,302   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-02-27T01:00:52,304   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-02-27T01:00:52,306   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-02-27T01:00:52,308   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-02-27T01:00:52,309   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-02-27T01:00:52,312   creating build/lib/deepspeed/accelerator
2024-02-27T01:00:52,313   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-27T01:00:52,315   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-27T01:00:52,318   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-27T01:00:52,320   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-27T01:00:52,322   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-27T01:00:52,324   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-02-27T01:00:52,326   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-27T01:00:52,328   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-27T01:00:52,330   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-27T01:00:52,333   creating build/lib/deepspeed/runtime
2024-02-27T01:00:52,334   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,337   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,339   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,341   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,343   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,345   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,347   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,352   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,354   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,356   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,360   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,362   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,365   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,367   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,368   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,371   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,373   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-02-27T01:00:52,376   creating build/lib/deepspeed/sequence
2024-02-27T01:00:52,377   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-02-27T01:00:52,378   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-02-27T01:00:52,380   creating build/lib/deepspeed/inference/v2
2024-02-27T01:00:52,381   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-02-27T01:00:52,383   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-02-27T01:00:52,385   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-02-27T01:00:52,386   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-02-27T01:00:52,389   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-02-27T01:00:52,390   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-02-27T01:00:52,392   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-02-27T01:00:52,394   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-02-27T01:00:52,395   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-02-27T01:00:52,398   creating build/lib/deepspeed/inference/quantization
2024-02-27T01:00:52,399   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-02-27T01:00:52,401   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-02-27T01:00:52,403   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-02-27T01:00:52,405   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-02-27T01:00:52,406   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-02-27T01:00:52,409   creating build/lib/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:52,410   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:52,413   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:52,415   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:52,417   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:52,419   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:52,422   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:52,423   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:52,426   creating build/lib/deepspeed/inference/v2/checkpoint
2024-02-27T01:00:52,427   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-27T01:00:52,428   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-27T01:00:52,430   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-27T01:00:52,432   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-27T01:00:52,434   creating build/lib/deepspeed/inference/v2/kernels
2024-02-27T01:00:52,435   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-02-27T01:00:52,437   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-02-27T01:00:52,439   creating build/lib/deepspeed/inference/v2/ragged
2024-02-27T01:00:52,439   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-27T01:00:52,441   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-27T01:00:52,444   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-27T01:00:52,446   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-27T01:00:52,447   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-27T01:00:52,449   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-27T01:00:52,451   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-27T01:00:52,453   creating build/lib/deepspeed/inference/v2/modules
2024-02-27T01:00:52,454   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-02-27T01:00:52,456   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-02-27T01:00:52,458   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-02-27T01:00:52,459   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-02-27T01:00:52,462   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-27T01:00:52,462   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-27T01:00:52,464   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-27T01:00:52,466   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-27T01:00:52,468   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-27T01:00:52,470   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-27T01:00:52,471   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-27T01:00:52,473   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-27T01:00:52,475   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-27T01:00:52,477   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-27T01:00:52,479   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-27T01:00:52,480   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-27T01:00:52,482   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-27T01:00:52,484   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-27T01:00:52,485   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-27T01:00:52,488   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:52,489   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:52,491   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:52,493   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:52,494   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:52,496   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:52,498   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:52,500   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:52,502   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:52,505   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:52,507   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-27T01:00:52,508   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-27T01:00:52,510   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-27T01:00:52,512   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-27T01:00:52,514   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-27T01:00:52,516   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:52,517   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:52,519   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:52,521   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:52,523   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:52,525   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:52,527   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:52,529   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:52,531   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:52,532   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:52,535   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-27T01:00:52,536   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-27T01:00:52,538   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-27T01:00:52,540   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-27T01:00:52,542   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-27T01:00:52,544   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-27T01:00:52,545   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-27T01:00:52,547   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-27T01:00:52,549   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-27T01:00:52,551   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-27T01:00:52,553   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-27T01:00:52,555   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-27T01:00:52,557   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-27T01:00:52,559   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-27T01:00:52,561   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-27T01:00:52,563   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-02-27T01:00:52,564   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-02-27T01:00:52,566   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-02-27T01:00:52,567   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-02-27T01:00:52,570   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-27T01:00:52,571   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-27T01:00:52,573   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:52,574   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:52,576   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:52,578   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:52,580   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:52,582   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-27T01:00:52,583   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-27T01:00:52,585   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-27T01:00:52,587   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:52,588   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:52,590   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:52,592   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:52,593   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:52,595   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:52,598   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:52,599   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:52,600   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:52,603   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:52,603   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:52,605   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:52,607   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:52,608   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:52,610   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:52,612   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:52,613   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:52,615   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:52,618   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:52,619   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:52,621   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:52,623   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:52,624   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:52,626   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:52,628   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:52,630   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:52,632   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:52,633   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:52,635   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:52,637   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:52,638   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:52,640   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:52,642   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-27T01:00:52,643   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-27T01:00:52,645   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-27T01:00:52,647   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:52,648   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:52,650   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:52,652   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:52,653   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:52,655   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:52,657   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:52,659   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:52,660   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:52,662   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:52,665   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:52,666   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:52,668   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:52,670   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:52,672   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:52,674   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:52,675   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:52,677   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:52,679   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:52,681   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-02-27T01:00:52,682   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-02-27T01:00:52,684   creating build/lib/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:52,685   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:52,687   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:52,689   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:52,691   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:52,692   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:52,694   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:52,696   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:52,698   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-02-27T01:00:52,699   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-02-27T01:00:52,701   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-02-27T01:00:52,704   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-02-27T01:00:52,705   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-02-27T01:00:52,706   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-02-27T01:00:52,709   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-02-27T01:00:52,710   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-02-27T01:00:52,712   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-02-27T01:00:52,714   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-27T01:00:52,715   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-27T01:00:52,717   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-27T01:00:52,720   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-27T01:00:52,721   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-27T01:00:52,723   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-27T01:00:52,724   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-27T01:00:52,727   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-02-27T01:00:52,727   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-02-27T01:00:52,729   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-02-27T01:00:52,731   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-02-27T01:00:52,732   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-02-27T01:00:52,734   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-02-27T01:00:52,737   creating build/lib/deepspeed/autotuning/tuner
2024-02-27T01:00:52,738   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-02-27T01:00:52,740   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-02-27T01:00:52,742   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-02-27T01:00:52,744   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-02-27T01:00:52,746   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-02-27T01:00:52,747   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-02-27T01:00:52,750   creating build/lib/deepspeed/ops/lion
2024-02-27T01:00:52,751   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-02-27T01:00:52,753   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-02-27T01:00:52,755   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-02-27T01:00:52,757   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-02-27T01:00:52,759   creating build/lib/deepspeed/ops/sparse_attention
2024-02-27T01:00:52,760   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-27T01:00:52,763   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-27T01:00:52,765   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-27T01:00:52,767   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-27T01:00:52,769   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-27T01:00:52,771   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-27T01:00:52,774   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-27T01:00:52,777   creating build/lib/deepspeed/ops/aio
2024-02-27T01:00:52,778   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-02-27T01:00:52,781   creating build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,782   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,785   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,787   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,789   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,790   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,792   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,794   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,796   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,798   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,799   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,801   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,803   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,805   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,806   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,808   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,810   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,811   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,813   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,815   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,817   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,819   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,821   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-02-27T01:00:52,822   creating build/lib/deepspeed/ops/deepspeed4science
2024-02-27T01:00:52,823   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-02-27T01:00:52,826   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-02-27T01:00:52,828   creating build/lib/deepspeed/ops/quantizer
2024-02-27T01:00:52,829   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-02-27T01:00:52,830   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-02-27T01:00:52,832   creating build/lib/deepspeed/ops/adagrad
2024-02-27T01:00:52,833   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-02-27T01:00:52,835   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-02-27T01:00:52,838   creating build/lib/deepspeed/ops/adam
2024-02-27T01:00:52,839   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-02-27T01:00:52,841   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-02-27T01:00:52,843   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-02-27T01:00:52,845   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-02-27T01:00:52,848   creating build/lib/deepspeed/ops/random_ltd
2024-02-27T01:00:52,849   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-02-27T01:00:52,851   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-02-27T01:00:52,853   creating build/lib/deepspeed/ops/transformer
2024-02-27T01:00:52,854   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-02-27T01:00:52,857   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-02-27T01:00:52,859   creating build/lib/deepspeed/ops/lamb
2024-02-27T01:00:52,860   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-02-27T01:00:52,862   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-02-27T01:00:52,864   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-27T01:00:52,865   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-27T01:00:52,867   creating build/lib/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:52,868   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:52,870   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:52,872   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:52,873   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:52,875   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:52,877   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:52,879   creating build/lib/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:52,880   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:52,882   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:52,884   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:52,885   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:52,887   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:52,890   creating build/lib/deepspeed/ops/op_builder/npu
2024-02-27T01:00:52,891   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-27T01:00:52,893   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-27T01:00:52,895   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-27T01:00:52,896   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-27T01:00:52,898   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-27T01:00:52,900   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-27T01:00:52,902   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-27T01:00:52,904   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-27T01:00:52,906   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-27T01:00:52,908   creating build/lib/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:52,909   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:52,912   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:52,913   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:52,915   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:52,917   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:52,919   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:52,921   creating build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,923   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,925   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,927   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,929   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,931   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,934   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,935   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,937   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,939   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,942   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-27T01:00:52,944   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,945   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,947   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,949   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,952   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,954   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,956   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,958   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,961   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,962   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,964   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:52,967   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,968   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,971   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,973   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,975   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,977   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,979   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,981   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,983   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,985   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,987   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:52,990   creating build/lib/deepspeed/model_implementations/diffusers
2024-02-27T01:00:52,991   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-02-27T01:00:52,993   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-02-27T01:00:52,995   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-02-27T01:00:52,997   creating build/lib/deepspeed/model_implementations/features
2024-02-27T01:00:52,998   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-02-27T01:00:53,000   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-02-27T01:00:53,002   creating build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,003   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,005   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,007   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,008   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,010   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,012   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,015   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,016   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,018   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,020   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-27T01:00:53,022   creating build/lib/deepspeed/profiling/flops_profiler
2024-02-27T01:00:53,023   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-02-27T01:00:53,026   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-02-27T01:00:53,029   creating build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,030   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,032   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,034   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,037   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,039   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,041   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,043   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,045   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,047   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,049   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,051   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,053   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,055   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,058   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,060   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,061   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,064   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,066   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,068   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-02-27T01:00:53,070   creating build/lib/deepspeed/module_inject/containers/features
2024-02-27T01:00:53,071   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-27T01:00:53,073   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-27T01:00:53,076   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-27T01:00:53,078   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-27T01:00:53,080   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-27T01:00:53,081   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-27T01:00:53,084   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-27T01:00:53,086   creating build/lib/deepspeed/runtime/fp16
2024-02-27T01:00:53,088   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-02-27T01:00:53,090   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-02-27T01:00:53,093   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-02-27T01:00:53,095   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-02-27T01:00:53,097   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-02-27T01:00:53,098   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-02-27T01:00:53,101   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-02-27T01:00:53,103   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-02-27T01:00:53,106   creating build/lib/deepspeed/runtime/swap_tensor
2024-02-27T01:00:53,107   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-27T01:00:53,109   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-27T01:00:53,112   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-27T01:00:53,114   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-27T01:00:53,116   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-27T01:00:53,118   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-27T01:00:53,120   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-27T01:00:53,122   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-27T01:00:53,124   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-27T01:00:53,126   creating build/lib/deepspeed/runtime/pipe
2024-02-27T01:00:53,127   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-02-27T01:00:53,130   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-02-27T01:00:53,133   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-02-27T01:00:53,135   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-02-27T01:00:53,137   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-02-27T01:00:53,140   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-02-27T01:00:53,143   creating build/lib/deepspeed/runtime/comm
2024-02-27T01:00:53,144   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-02-27T01:00:53,146   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-02-27T01:00:53,149   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-02-27T01:00:53,151   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-02-27T01:00:53,153   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-02-27T01:00:53,155   creating build/lib/deepspeed/runtime/data_pipeline
2024-02-27T01:00:53,156   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-27T01:00:53,159   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-27T01:00:53,161   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-27T01:00:53,163   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-27T01:00:53,166   creating build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,167   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,170   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,173   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,175   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,178   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,180   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,182   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,185   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,189   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,191   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,193   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,197   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,201   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,203   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,205   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,207   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-02-27T01:00:53,210   creating build/lib/deepspeed/runtime/compression
2024-02-27T01:00:53,210   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-02-27T01:00:53,212   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-02-27T01:00:53,214   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-02-27T01:00:53,215   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-27T01:00:53,217   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-27T01:00:53,219   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-27T01:00:53,221   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-27T01:00:53,223   creating build/lib/deepspeed/runtime/fp16/onebit
2024-02-27T01:00:53,224   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-27T01:00:53,227   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-27T01:00:53,229   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-27T01:00:53,232   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-27T01:00:53,234   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:53,235   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:53,237   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:53,239   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:53,241   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:53,243   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:53,245   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:53,246   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:53,250   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:53,252   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:53,254   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:53,256   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:53,259   running egg_info
2024-02-27T01:00:53,327   writing deepspeed.egg-info/PKG-INFO
2024-02-27T01:00:53,358   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-02-27T01:00:53,360   writing entry points to deepspeed.egg-info/entry_points.txt
2024-02-27T01:00:53,376   writing requirements to deepspeed.egg-info/requires.txt
2024-02-27T01:00:53,377   writing top-level names to deepspeed.egg-info/top_level.txt
2024-02-27T01:00:53,493   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-02-27T01:00:53,536   reading manifest template 'MANIFEST.in'
2024-02-27T01:00:53,538   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-02-27T01:00:53,538   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-02-27T01:00:54,599   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-02-27T01:00:55,395   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-02-27T01:00:55,891   warning: no files found matching '*.tr' under directory 'csrc'
2024-02-27T01:00:55,995   warning: no files found matching '*.cc' under directory 'csrc'
2024-02-27T01:00:56,028   warning: no files found matching '*.py' under directory 'benchmarks'
2024-02-27T01:00:56,075   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-02-27T01:00:56,082   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-02-27T01:00:56,083   !!

2024-02-27T01:00:56,084           ********************************************************************************
2024-02-27T01:00:56,084           ############################
2024-02-27T01:00:56,085           # Package would be ignored #
2024-02-27T01:00:56,085           ############################
2024-02-27T01:00:56,086           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-02-27T01:00:56,086           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,087           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,088           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-02-27T01:00:56,088           to the `packages` configuration field.

2024-02-27T01:00:56,090           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,091           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,091           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,093           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,094           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,095           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-02-27T01:00:56,096           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-02-27T01:00:56,096           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,097           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,098           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,099           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,099           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,101           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,101                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,102                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,102                 directory, all directories are treated like packages.
2024-02-27T01:00:56,103           ********************************************************************************

2024-02-27T01:00:56,104   !!
2024-02-27T01:00:56,105     check.warn(importable)
2024-02-27T01:00:56,105   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-02-27T01:00:56,106   !!

2024-02-27T01:00:56,107           ********************************************************************************
2024-02-27T01:00:56,108           ############################
2024-02-27T01:00:56,108           # Package would be ignored #
2024-02-27T01:00:56,108           ############################
2024-02-27T01:00:56,109           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-02-27T01:00:56,109           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,110           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,110           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-02-27T01:00:56,110           to the `packages` configuration field.

2024-02-27T01:00:56,111           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,111           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,112           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,112           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,113           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,114           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-02-27T01:00:56,114           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-02-27T01:00:56,115           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,115           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,116           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,116           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,117           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,119           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,120                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,120                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,121                 directory, all directories are treated like packages.
2024-02-27T01:00:56,121           ********************************************************************************

2024-02-27T01:00:56,123   !!
2024-02-27T01:00:56,123     check.warn(importable)
2024-02-27T01:00:56,124   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-02-27T01:00:56,124   !!

2024-02-27T01:00:56,125           ********************************************************************************
2024-02-27T01:00:56,126           ############################
2024-02-27T01:00:56,126           # Package would be ignored #
2024-02-27T01:00:56,127           ############################
2024-02-27T01:00:56,127           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-02-27T01:00:56,128           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,129           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,129           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-02-27T01:00:56,130           to the `packages` configuration field.

2024-02-27T01:00:56,131           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,132           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,132           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,133           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,134           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,135           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-02-27T01:00:56,135           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-02-27T01:00:56,136           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,136           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,136           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,137           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,138           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,139           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,139                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,140                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,140                 directory, all directories are treated like packages.
2024-02-27T01:00:56,141           ********************************************************************************

2024-02-27T01:00:56,141   !!
2024-02-27T01:00:56,142     check.warn(importable)
2024-02-27T01:00:56,142   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-02-27T01:00:56,142   !!

2024-02-27T01:00:56,144           ********************************************************************************
2024-02-27T01:00:56,144           ############################
2024-02-27T01:00:56,145           # Package would be ignored #
2024-02-27T01:00:56,145           ############################
2024-02-27T01:00:56,146           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-02-27T01:00:56,147           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,148           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,148           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-02-27T01:00:56,149           to the `packages` configuration field.

2024-02-27T01:00:56,150           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,151           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,151           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,152           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,153           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,154           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-02-27T01:00:56,155           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-02-27T01:00:56,155           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,156           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,156           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,157           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,159           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,161           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,162                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,164                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,164                 directory, all directories are treated like packages.
2024-02-27T01:00:56,165           ********************************************************************************

2024-02-27T01:00:56,166   !!
2024-02-27T01:00:56,167     check.warn(importable)
2024-02-27T01:00:56,168   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-02-27T01:00:56,168   !!

2024-02-27T01:00:56,170           ********************************************************************************
2024-02-27T01:00:56,171           ############################
2024-02-27T01:00:56,171           # Package would be ignored #
2024-02-27T01:00:56,172           ############################
2024-02-27T01:00:56,173           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-02-27T01:00:56,174           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,175           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,176           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-02-27T01:00:56,177           to the `packages` configuration field.

2024-02-27T01:00:56,179           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,179           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,179           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,181           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,181           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,183           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-02-27T01:00:56,183           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-02-27T01:00:56,184           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,184           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,185           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,187           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,188           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,190           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,191                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,192                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,192                 directory, all directories are treated like packages.
2024-02-27T01:00:56,193           ********************************************************************************

2024-02-27T01:00:56,195   !!
2024-02-27T01:00:56,195     check.warn(importable)
2024-02-27T01:00:56,196   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-02-27T01:00:56,197   !!

2024-02-27T01:00:56,199           ********************************************************************************
2024-02-27T01:00:56,200           ############################
2024-02-27T01:00:56,201           # Package would be ignored #
2024-02-27T01:00:56,202           ############################
2024-02-27T01:00:56,203           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-02-27T01:00:56,205           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,207           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,208           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-02-27T01:00:56,209           to the `packages` configuration field.

2024-02-27T01:00:56,211           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,212           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,213           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,215           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,217           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,219           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-02-27T01:00:56,220           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-02-27T01:00:56,222           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,223           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,224           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,226           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,228           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,232           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,233                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,234                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,235                 directory, all directories are treated like packages.
2024-02-27T01:00:56,236           ********************************************************************************

2024-02-27T01:00:56,237   !!
2024-02-27T01:00:56,238     check.warn(importable)
2024-02-27T01:00:56,239   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-02-27T01:00:56,240   !!

2024-02-27T01:00:56,242           ********************************************************************************
2024-02-27T01:00:56,243           ############################
2024-02-27T01:00:56,244           # Package would be ignored #
2024-02-27T01:00:56,245           ############################
2024-02-27T01:00:56,246           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-02-27T01:00:56,247           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,249           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,250           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-02-27T01:00:56,251           to the `packages` configuration field.

2024-02-27T01:00:56,253           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,254           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,255           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,258           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,260           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,263           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-02-27T01:00:56,265           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-02-27T01:00:56,267           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,268           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,269           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,271           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,273           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,276           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,277                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,278                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,278                 directory, all directories are treated like packages.
2024-02-27T01:00:56,279           ********************************************************************************

2024-02-27T01:00:56,280   !!
2024-02-27T01:00:56,280     check.warn(importable)
2024-02-27T01:00:56,281   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-02-27T01:00:56,281   !!

2024-02-27T01:00:56,282           ********************************************************************************
2024-02-27T01:00:56,283           ############################
2024-02-27T01:00:56,284           # Package would be ignored #
2024-02-27T01:00:56,284           ############################
2024-02-27T01:00:56,285           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-02-27T01:00:56,286           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,288           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,289           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-02-27T01:00:56,290           to the `packages` configuration field.

2024-02-27T01:00:56,292           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,293           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,294           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,296           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,298           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,300           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-02-27T01:00:56,301           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-02-27T01:00:56,302           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,303           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,304           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,307           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,309           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,313           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,314                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,316                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,317                 directory, all directories are treated like packages.
2024-02-27T01:00:56,318           ********************************************************************************

2024-02-27T01:00:56,320   !!
2024-02-27T01:00:56,320     check.warn(importable)
2024-02-27T01:00:56,321   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-02-27T01:00:56,321   !!

2024-02-27T01:00:56,322           ********************************************************************************
2024-02-27T01:00:56,322           ############################
2024-02-27T01:00:56,323           # Package would be ignored #
2024-02-27T01:00:56,323           ############################
2024-02-27T01:00:56,323           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-02-27T01:00:56,324           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,325           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,325           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-02-27T01:00:56,325           to the `packages` configuration field.

2024-02-27T01:00:56,326           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,326           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,327           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,327           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,328           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,329           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-02-27T01:00:56,329           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-02-27T01:00:56,330           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,330           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,331           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,332           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,333           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,335           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,335                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,336                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,336                 directory, all directories are treated like packages.
2024-02-27T01:00:56,337           ********************************************************************************

2024-02-27T01:00:56,338   !!
2024-02-27T01:00:56,338     check.warn(importable)
2024-02-27T01:00:56,339   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-02-27T01:00:56,339   !!

2024-02-27T01:00:56,340           ********************************************************************************
2024-02-27T01:00:56,341           ############################
2024-02-27T01:00:56,341           # Package would be ignored #
2024-02-27T01:00:56,341           ############################
2024-02-27T01:00:56,342           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-02-27T01:00:56,342           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,343           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,344           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-02-27T01:00:56,344           to the `packages` configuration field.

2024-02-27T01:00:56,345           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,345           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,346           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,347           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,347           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,348           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-02-27T01:00:56,348           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-02-27T01:00:56,349           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,349           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,349           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,350           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,351           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,352           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,352                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,352                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,353                 directory, all directories are treated like packages.
2024-02-27T01:00:56,353           ********************************************************************************

2024-02-27T01:00:56,354   !!
2024-02-27T01:00:56,354     check.warn(importable)
2024-02-27T01:00:56,354   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-02-27T01:00:56,355   !!

2024-02-27T01:00:56,356           ********************************************************************************
2024-02-27T01:00:56,356           ############################
2024-02-27T01:00:56,357           # Package would be ignored #
2024-02-27T01:00:56,357           ############################
2024-02-27T01:00:56,358           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-02-27T01:00:56,358           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,360           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,360           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-02-27T01:00:56,361           to the `packages` configuration field.

2024-02-27T01:00:56,362           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,362           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,363           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,364           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,365           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,366           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-02-27T01:00:56,366           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-02-27T01:00:56,367           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,367           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,368           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,369           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,370           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,371           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,372                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,372                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,373                 directory, all directories are treated like packages.
2024-02-27T01:00:56,373           ********************************************************************************

2024-02-27T01:00:56,374   !!
2024-02-27T01:00:56,375     check.warn(importable)
2024-02-27T01:00:56,375   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-02-27T01:00:56,375   !!

2024-02-27T01:00:56,376           ********************************************************************************
2024-02-27T01:00:56,376           ############################
2024-02-27T01:00:56,377           # Package would be ignored #
2024-02-27T01:00:56,377           ############################
2024-02-27T01:00:56,377           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-02-27T01:00:56,378           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,378           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,379           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-02-27T01:00:56,379           to the `packages` configuration field.

2024-02-27T01:00:56,380           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,380           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,381           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,381           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,382           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,384           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-02-27T01:00:56,384           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-02-27T01:00:56,385           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,385           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,386           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,387           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,388           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,390           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,390                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,391                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,391                 directory, all directories are treated like packages.
2024-02-27T01:00:56,392           ********************************************************************************

2024-02-27T01:00:56,393   !!
2024-02-27T01:00:56,393     check.warn(importable)
2024-02-27T01:00:56,394   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration.
2024-02-27T01:00:56,394   !!

2024-02-27T01:00:56,395           ********************************************************************************
2024-02-27T01:00:56,396           ############################
2024-02-27T01:00:56,396           # Package would be ignored #
2024-02-27T01:00:56,397           ############################
2024-02-27T01:00:56,397           Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1],
2024-02-27T01:00:56,398           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,399           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,399           package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added
2024-02-27T01:00:56,400           to the `packages` configuration field.

2024-02-27T01:00:56,401           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,401           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,402           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,402           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,403           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,404           If you don't want 'deepspeed.ops.csrc.common' to be distributed and are
2024-02-27T01:00:56,405           already explicitly excluding 'deepspeed.ops.csrc.common' via
2024-02-27T01:00:56,405           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,405           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,406           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,407           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,407           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,408           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,409                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,409                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,410                 directory, all directories are treated like packages.
2024-02-27T01:00:56,410           ********************************************************************************

2024-02-27T01:00:56,411   !!
2024-02-27T01:00:56,412     check.warn(importable)
2024-02-27T01:00:56,412   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-02-27T01:00:56,413   !!

2024-02-27T01:00:56,414           ********************************************************************************
2024-02-27T01:00:56,414           ############################
2024-02-27T01:00:56,415           # Package would be ignored #
2024-02-27T01:00:56,415           ############################
2024-02-27T01:00:56,416           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-02-27T01:00:56,416           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,417           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,418           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-02-27T01:00:56,418           to the `packages` configuration field.

2024-02-27T01:00:56,419           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,419           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,420           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,421           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,422           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,423           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-02-27T01:00:56,423           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-02-27T01:00:56,424           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,424           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,425           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,426           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,427           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,428           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,428                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,429                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,429                 directory, all directories are treated like packages.
2024-02-27T01:00:56,429           ********************************************************************************

2024-02-27T01:00:56,430   !!
2024-02-27T01:00:56,430     check.warn(importable)
2024-02-27T01:00:56,431   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-02-27T01:00:56,431   !!

2024-02-27T01:00:56,432           ********************************************************************************
2024-02-27T01:00:56,432           ############################
2024-02-27T01:00:56,433           # Package would be ignored #
2024-02-27T01:00:56,433           ############################
2024-02-27T01:00:56,433           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-02-27T01:00:56,434           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,435           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,435           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-02-27T01:00:56,436           to the `packages` configuration field.

2024-02-27T01:00:56,437           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,437           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,438           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,439           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,440           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,441           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-02-27T01:00:56,442           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-02-27T01:00:56,442           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,443           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,443           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,445           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,445           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,447           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,448                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,448                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,449                 directory, all directories are treated like packages.
2024-02-27T01:00:56,449           ********************************************************************************

2024-02-27T01:00:56,451   !!
2024-02-27T01:00:56,451     check.warn(importable)
2024-02-27T01:00:56,452   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-02-27T01:00:56,453   !!

2024-02-27T01:00:56,454           ********************************************************************************
2024-02-27T01:00:56,455           ############################
2024-02-27T01:00:56,456           # Package would be ignored #
2024-02-27T01:00:56,457           ############################
2024-02-27T01:00:56,457           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-02-27T01:00:56,458           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,459           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,459           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-02-27T01:00:56,459           to the `packages` configuration field.

2024-02-27T01:00:56,460           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,461           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,461           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,462           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,463           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,464           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-02-27T01:00:56,465           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-02-27T01:00:56,465           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,466           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,466           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,467           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,469           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,471           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,472                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,472                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,473                 directory, all directories are treated like packages.
2024-02-27T01:00:56,473           ********************************************************************************

2024-02-27T01:00:56,475   !!
2024-02-27T01:00:56,475     check.warn(importable)
2024-02-27T01:00:56,476   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-02-27T01:00:56,477   !!

2024-02-27T01:00:56,478           ********************************************************************************
2024-02-27T01:00:56,479           ############################
2024-02-27T01:00:56,480           # Package would be ignored #
2024-02-27T01:00:56,480           ############################
2024-02-27T01:00:56,481           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-02-27T01:00:56,481           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,483           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,483           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-02-27T01:00:56,484           to the `packages` configuration field.

2024-02-27T01:00:56,485           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,486           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,487           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,488           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,490           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,491           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-02-27T01:00:56,492           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-02-27T01:00:56,492           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,493           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,493           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,494           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,495           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,497           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,497                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,498                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,498                 directory, all directories are treated like packages.
2024-02-27T01:00:56,499           ********************************************************************************

2024-02-27T01:00:56,500   !!
2024-02-27T01:00:56,500     check.warn(importable)
2024-02-27T01:00:56,501   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-02-27T01:00:56,501   !!

2024-02-27T01:00:56,502           ********************************************************************************
2024-02-27T01:00:56,503           ############################
2024-02-27T01:00:56,503           # Package would be ignored #
2024-02-27T01:00:56,504           ############################
2024-02-27T01:00:56,505           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-02-27T01:00:56,505           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,507           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,508           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-02-27T01:00:56,508           to the `packages` configuration field.

2024-02-27T01:00:56,510           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,510           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,511           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,512           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,514           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,515           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-02-27T01:00:56,515           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-02-27T01:00:56,516           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,517           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,517           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,518           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,520           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,522           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,522                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,523                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,524                 directory, all directories are treated like packages.
2024-02-27T01:00:56,525           ********************************************************************************

2024-02-27T01:00:56,526   !!
2024-02-27T01:00:56,526     check.warn(importable)
2024-02-27T01:00:56,527   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-02-27T01:00:56,527   !!

2024-02-27T01:00:56,528           ********************************************************************************
2024-02-27T01:00:56,529           ############################
2024-02-27T01:00:56,529           # Package would be ignored #
2024-02-27T01:00:56,529           ############################
2024-02-27T01:00:56,530           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-02-27T01:00:56,530           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,531           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,532           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-02-27T01:00:56,532           to the `packages` configuration field.

2024-02-27T01:00:56,533           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,534           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,534           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,536           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,537           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,538           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-02-27T01:00:56,539           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-02-27T01:00:56,539           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,540           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,541           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,542           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,543           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,546           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,546                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,547                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,548                 directory, all directories are treated like packages.
2024-02-27T01:00:56,548           ********************************************************************************

2024-02-27T01:00:56,549   !!
2024-02-27T01:00:56,549     check.warn(importable)
2024-02-27T01:00:56,550   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-02-27T01:00:56,550   !!

2024-02-27T01:00:56,551           ********************************************************************************
2024-02-27T01:00:56,552           ############################
2024-02-27T01:00:56,552           # Package would be ignored #
2024-02-27T01:00:56,553           ############################
2024-02-27T01:00:56,553           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-02-27T01:00:56,554           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,555           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,555           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-02-27T01:00:56,556           to the `packages` configuration field.

2024-02-27T01:00:56,556           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,556           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,557           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,557           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,558           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,559           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-02-27T01:00:56,559           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-02-27T01:00:56,559           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,560           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,560           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,561           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,561           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,563           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,564                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,564                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,565                 directory, all directories are treated like packages.
2024-02-27T01:00:56,565           ********************************************************************************

2024-02-27T01:00:56,566   !!
2024-02-27T01:00:56,567     check.warn(importable)
2024-02-27T01:00:56,567   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-02-27T01:00:56,568   !!

2024-02-27T01:00:56,569           ********************************************************************************
2024-02-27T01:00:56,570           ############################
2024-02-27T01:00:56,570           # Package would be ignored #
2024-02-27T01:00:56,571           ############################
2024-02-27T01:00:56,572           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-02-27T01:00:56,572           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,573           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,574           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-02-27T01:00:56,574           to the `packages` configuration field.

2024-02-27T01:00:56,575           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,576           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,576           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,577           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,578           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,580           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-02-27T01:00:56,580           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-02-27T01:00:56,581           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,582           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,582           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,583           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,584           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,585           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,585                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,586                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,586                 directory, all directories are treated like packages.
2024-02-27T01:00:56,587           ********************************************************************************

2024-02-27T01:00:56,587   !!
2024-02-27T01:00:56,588     check.warn(importable)
2024-02-27T01:00:56,588   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-02-27T01:00:56,589   !!

2024-02-27T01:00:56,590           ********************************************************************************
2024-02-27T01:00:56,590           ############################
2024-02-27T01:00:56,591           # Package would be ignored #
2024-02-27T01:00:56,591           ############################
2024-02-27T01:00:56,592           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-02-27T01:00:56,592           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,593           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,594           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-02-27T01:00:56,594           to the `packages` configuration field.

2024-02-27T01:00:56,595           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,596           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,596           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,597           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,599           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,600           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-02-27T01:00:56,600           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-02-27T01:00:56,601           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,601           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,602           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,603           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,604           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,605           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,606                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,606                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,607                 directory, all directories are treated like packages.
2024-02-27T01:00:56,608           ********************************************************************************

2024-02-27T01:00:56,609   !!
2024-02-27T01:00:56,609     check.warn(importable)
2024-02-27T01:00:56,610   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-02-27T01:00:56,611   !!

2024-02-27T01:00:56,612           ********************************************************************************
2024-02-27T01:00:56,612           ############################
2024-02-27T01:00:56,612           # Package would be ignored #
2024-02-27T01:00:56,613           ############################
2024-02-27T01:00:56,613           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-02-27T01:00:56,613           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,614           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,615           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-02-27T01:00:56,615           to the `packages` configuration field.

2024-02-27T01:00:56,616           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,616           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,617           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,617           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,618           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,619           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-02-27T01:00:56,619           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-02-27T01:00:56,620           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,620           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,621           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,622           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,623           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,624           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,625                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,625                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,626                 directory, all directories are treated like packages.
2024-02-27T01:00:56,626           ********************************************************************************

2024-02-27T01:00:56,627   !!
2024-02-27T01:00:56,628     check.warn(importable)
2024-02-27T01:00:56,628   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-02-27T01:00:56,629   !!

2024-02-27T01:00:56,630           ********************************************************************************
2024-02-27T01:00:56,630           ############################
2024-02-27T01:00:56,631           # Package would be ignored #
2024-02-27T01:00:56,631           ############################
2024-02-27T01:00:56,632           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-02-27T01:00:56,632           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,633           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,634           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-02-27T01:00:56,635           to the `packages` configuration field.

2024-02-27T01:00:56,636           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,636           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,637           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,638           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,638           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,639           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-02-27T01:00:56,640           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-02-27T01:00:56,640           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,641           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,641           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,642           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,643           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,644           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,645                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,645                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,646                 directory, all directories are treated like packages.
2024-02-27T01:00:56,646           ********************************************************************************

2024-02-27T01:00:56,647   !!
2024-02-27T01:00:56,647     check.warn(importable)
2024-02-27T01:00:56,648   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-02-27T01:00:56,648   !!

2024-02-27T01:00:56,649           ********************************************************************************
2024-02-27T01:00:56,650           ############################
2024-02-27T01:00:56,650           # Package would be ignored #
2024-02-27T01:00:56,651           ############################
2024-02-27T01:00:56,651           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-02-27T01:00:56,652           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,653           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,653           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-02-27T01:00:56,654           to the `packages` configuration field.

2024-02-27T01:00:56,655           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,655           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,656           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,657           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,658           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,659           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-02-27T01:00:56,659           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-02-27T01:00:56,660           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,660           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,661           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,662           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,663           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,664           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,665                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,665                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,666                 directory, all directories are treated like packages.
2024-02-27T01:00:56,667           ********************************************************************************

2024-02-27T01:00:56,667   !!
2024-02-27T01:00:56,668     check.warn(importable)
2024-02-27T01:00:56,668   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-02-27T01:00:56,669   !!

2024-02-27T01:00:56,669           ********************************************************************************
2024-02-27T01:00:56,670           ############################
2024-02-27T01:00:56,670           # Package would be ignored #
2024-02-27T01:00:56,670           ############################
2024-02-27T01:00:56,671           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-02-27T01:00:56,671           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,672           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,673           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-02-27T01:00:56,673           to the `packages` configuration field.

2024-02-27T01:00:56,674           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,674           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,675           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,676           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,677           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,678           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-02-27T01:00:56,678           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-02-27T01:00:56,678           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,679           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,679           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,680           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,681           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,683           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,683                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,684                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,684                 directory, all directories are treated like packages.
2024-02-27T01:00:56,685           ********************************************************************************

2024-02-27T01:00:56,686   !!
2024-02-27T01:00:56,686     check.warn(importable)
2024-02-27T01:00:56,687   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-02-27T01:00:56,687   !!

2024-02-27T01:00:56,688           ********************************************************************************
2024-02-27T01:00:56,689           ############################
2024-02-27T01:00:56,689           # Package would be ignored #
2024-02-27T01:00:56,690           ############################
2024-02-27T01:00:56,690           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-02-27T01:00:56,691           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,692           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,692           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-02-27T01:00:56,693           to the `packages` configuration field.

2024-02-27T01:00:56,694           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,694           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,695           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,696           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,696           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,697           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-02-27T01:00:56,698           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-02-27T01:00:56,698           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,698           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,699           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,700           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,701           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,702           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,702                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,702                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,703                 directory, all directories are treated like packages.
2024-02-27T01:00:56,704           ********************************************************************************

2024-02-27T01:00:56,705   !!
2024-02-27T01:00:56,705     check.warn(importable)
2024-02-27T01:00:56,705   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-02-27T01:00:56,706   !!

2024-02-27T01:00:56,707           ********************************************************************************
2024-02-27T01:00:56,707           ############################
2024-02-27T01:00:56,708           # Package would be ignored #
2024-02-27T01:00:56,708           ############################
2024-02-27T01:00:56,709           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-02-27T01:00:56,709           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,710           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,711           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-02-27T01:00:56,711           to the `packages` configuration field.

2024-02-27T01:00:56,712           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,713           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,713           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,714           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,715           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,716           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-02-27T01:00:56,717           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-02-27T01:00:56,717           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,718           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,718           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,720           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,721           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,722           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,722                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,723                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,723                 directory, all directories are treated like packages.
2024-02-27T01:00:56,723           ********************************************************************************

2024-02-27T01:00:56,724   !!
2024-02-27T01:00:56,725     check.warn(importable)
2024-02-27T01:00:56,725   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-02-27T01:00:56,725   !!

2024-02-27T01:00:56,726           ********************************************************************************
2024-02-27T01:00:56,727           ############################
2024-02-27T01:00:56,727           # Package would be ignored #
2024-02-27T01:00:56,728           ############################
2024-02-27T01:00:56,728           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-02-27T01:00:56,729           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,730           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,730           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-02-27T01:00:56,730           to the `packages` configuration field.

2024-02-27T01:00:56,731           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,732           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,732           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,733           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,734           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,735           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-02-27T01:00:56,736           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-02-27T01:00:56,736           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,737           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,737           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,738           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,739           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,741           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,742                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,742                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,743                 directory, all directories are treated like packages.
2024-02-27T01:00:56,743           ********************************************************************************

2024-02-27T01:00:56,745   !!
2024-02-27T01:00:56,745     check.warn(importable)
2024-02-27T01:00:56,746   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-02-27T01:00:56,746   !!

2024-02-27T01:00:56,747           ********************************************************************************
2024-02-27T01:00:56,748           ############################
2024-02-27T01:00:56,748           # Package would be ignored #
2024-02-27T01:00:56,749           ############################
2024-02-27T01:00:56,749           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-02-27T01:00:56,750           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,750           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,751           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-02-27T01:00:56,751           to the `packages` configuration field.

2024-02-27T01:00:56,752           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,753           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,753           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,754           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,755           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,756           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-02-27T01:00:56,756           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-02-27T01:00:56,757           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,757           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,758           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,758           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,759           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,761           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,761                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,762                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,762                 directory, all directories are treated like packages.
2024-02-27T01:00:56,763           ********************************************************************************

2024-02-27T01:00:56,764   !!
2024-02-27T01:00:56,764     check.warn(importable)
2024-02-27T01:00:56,765   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-02-27T01:00:56,765   !!

2024-02-27T01:00:56,766           ********************************************************************************
2024-02-27T01:00:56,767           ############################
2024-02-27T01:00:56,767           # Package would be ignored #
2024-02-27T01:00:56,768           ############################
2024-02-27T01:00:56,768           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-02-27T01:00:56,769           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,770           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,770           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-02-27T01:00:56,771           to the `packages` configuration field.

2024-02-27T01:00:56,772           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,773           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,773           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,774           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,775           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,776           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-02-27T01:00:56,777           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-02-27T01:00:56,777           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,777           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,778           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,779           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,780           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,781           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,782                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,782                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,783                 directory, all directories are treated like packages.
2024-02-27T01:00:56,783           ********************************************************************************

2024-02-27T01:00:56,785   !!
2024-02-27T01:00:56,786     check.warn(importable)
2024-02-27T01:00:56,786   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-02-27T01:00:56,786   !!

2024-02-27T01:00:56,787           ********************************************************************************
2024-02-27T01:00:56,788           ############################
2024-02-27T01:00:56,788           # Package would be ignored #
2024-02-27T01:00:56,789           ############################
2024-02-27T01:00:56,789           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-02-27T01:00:56,790           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,791           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,791           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-02-27T01:00:56,792           to the `packages` configuration field.

2024-02-27T01:00:56,792           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,793           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,793           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,794           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,795           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,797           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-02-27T01:00:56,797           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-02-27T01:00:56,798           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,798           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,799           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,800           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,801           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,802           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,803                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,803                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,804                 directory, all directories are treated like packages.
2024-02-27T01:00:56,805           ********************************************************************************

2024-02-27T01:00:56,806   !!
2024-02-27T01:00:56,807     check.warn(importable)
2024-02-27T01:00:56,807   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-02-27T01:00:56,807   !!

2024-02-27T01:00:56,808           ********************************************************************************
2024-02-27T01:00:56,809           ############################
2024-02-27T01:00:56,809           # Package would be ignored #
2024-02-27T01:00:56,809           ############################
2024-02-27T01:00:56,810           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-02-27T01:00:56,810           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,811           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,811           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-02-27T01:00:56,812           to the `packages` configuration field.

2024-02-27T01:00:56,813           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,813           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,814           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,815           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,816           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,817           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-02-27T01:00:56,817           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-02-27T01:00:56,817           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,818           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,818           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,819           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,820           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,822           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,822                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,823                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,823                 directory, all directories are treated like packages.
2024-02-27T01:00:56,824           ********************************************************************************

2024-02-27T01:00:56,825   !!
2024-02-27T01:00:56,825     check.warn(importable)
2024-02-27T01:00:56,826   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-02-27T01:00:56,826   !!

2024-02-27T01:00:56,827           ********************************************************************************
2024-02-27T01:00:56,828           ############################
2024-02-27T01:00:56,828           # Package would be ignored #
2024-02-27T01:00:56,829           ############################
2024-02-27T01:00:56,829           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-02-27T01:00:56,830           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,831           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,831           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-02-27T01:00:56,832           to the `packages` configuration field.

2024-02-27T01:00:56,833           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,833           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,834           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,835           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,835           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,836           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-02-27T01:00:56,836           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-02-27T01:00:56,837           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,837           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,838           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,839           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,839           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,841           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,841                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,842                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,842                 directory, all directories are treated like packages.
2024-02-27T01:00:56,843           ********************************************************************************

2024-02-27T01:00:56,844   !!
2024-02-27T01:00:56,844     check.warn(importable)
2024-02-27T01:00:56,845   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-02-27T01:00:56,845   !!

2024-02-27T01:00:56,846           ********************************************************************************
2024-02-27T01:00:56,847           ############################
2024-02-27T01:00:56,847           # Package would be ignored #
2024-02-27T01:00:56,847           ############################
2024-02-27T01:00:56,848           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-02-27T01:00:56,849           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,849           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,850           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-02-27T01:00:56,851           to the `packages` configuration field.

2024-02-27T01:00:56,852           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,852           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,853           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,854           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,855           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,855           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-02-27T01:00:56,856           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-02-27T01:00:56,857           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,857           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,858           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,859           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,860           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,861           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,861                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,862                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,862                 directory, all directories are treated like packages.
2024-02-27T01:00:56,862           ********************************************************************************

2024-02-27T01:00:56,863   !!
2024-02-27T01:00:56,864     check.warn(importable)
2024-02-27T01:00:56,864   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-02-27T01:00:56,865   !!

2024-02-27T01:00:56,865           ********************************************************************************
2024-02-27T01:00:56,866           ############################
2024-02-27T01:00:56,866           # Package would be ignored #
2024-02-27T01:00:56,867           ############################
2024-02-27T01:00:56,867           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-02-27T01:00:56,868           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,869           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,869           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-02-27T01:00:56,869           to the `packages` configuration field.

2024-02-27T01:00:56,870           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,871           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,871           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,872           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,873           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,874           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-02-27T01:00:56,875           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-02-27T01:00:56,875           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,876           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,876           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,877           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,878           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,880           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,881                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,881                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,882                 directory, all directories are treated like packages.
2024-02-27T01:00:56,882           ********************************************************************************

2024-02-27T01:00:56,884   !!
2024-02-27T01:00:56,884     check.warn(importable)
2024-02-27T01:00:56,885   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-02-27T01:00:56,885   !!

2024-02-27T01:00:56,886           ********************************************************************************
2024-02-27T01:00:56,887           ############################
2024-02-27T01:00:56,888           # Package would be ignored #
2024-02-27T01:00:56,888           ############################
2024-02-27T01:00:56,889           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-02-27T01:00:56,889           but it is absent from setuptools' `packages` configuration.

2024-02-27T01:00:56,890           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-27T01:00:56,890           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-02-27T01:00:56,891           to the `packages` configuration field.

2024-02-27T01:00:56,891           Alternatively, you can also rely on setuptools' discovery methods
2024-02-27T01:00:56,892           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-27T01:00:56,892           instead of `find_packages(...)`/`find:`).

2024-02-27T01:00:56,893           You can read more about "package discovery" on setuptools documentation page:

2024-02-27T01:00:56,894           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-27T01:00:56,895           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-02-27T01:00:56,895           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-02-27T01:00:56,896           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-27T01:00:56,896           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-27T01:00:56,897           combination with a more fine grained `package-data` configuration.

2024-02-27T01:00:56,898           You can read more about "package data files" on setuptools documentation page:

2024-02-27T01:00:56,898           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-27T01:00:56,900           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-27T01:00:56,900                 even if it does not contain any `.py` files.
2024-02-27T01:00:56,901                 On the other hand, currently there is no concept of package data
2024-02-27T01:00:56,901                 directory, all directories are treated like packages.
2024-02-27T01:00:56,902           ********************************************************************************

2024-02-27T01:00:56,903   !!
2024-02-27T01:00:56,903     check.warn(importable)
2024-02-27T01:00:56,904   creating build/lib/deepspeed/autotuning/config_templates
2024-02-27T01:00:56,904   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-27T01:00:56,905   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-27T01:00:56,905   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-27T01:00:56,906   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-27T01:00:56,906   creating build/lib/deepspeed/ops/csrc
2024-02-27T01:00:56,907   creating build/lib/deepspeed/ops/csrc/adagrad
2024-02-27T01:00:56,907   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-02-27T01:00:56,908   creating build/lib/deepspeed/ops/csrc/adam
2024-02-27T01:00:56,908   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-02-27T01:00:56,909   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-02-27T01:00:56,909   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-02-27T01:00:56,910   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-02-27T01:00:56,910   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-02-27T01:00:56,911   creating build/lib/deepspeed/ops/csrc/aio
2024-02-27T01:00:56,911   creating build/lib/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:56,912   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:56,913   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:56,913   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:56,913   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:56,914   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:56,914   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:56,914   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,915   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,915   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,916   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,916   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,917   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,917   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,917   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,918   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,918   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,919   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,919   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:56,920   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-02-27T01:00:56,920   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-02-27T01:00:56,921   creating build/lib/deepspeed/ops/csrc/common
2024-02-27T01:00:56,921   copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common
2024-02-27T01:00:56,922   creating build/lib/deepspeed/ops/csrc/cpu
2024-02-27T01:00:56,922   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-02-27T01:00:56,923   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-02-27T01:00:56,923   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-02-27T01:00:56,924   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-02-27T01:00:56,924   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-02-27T01:00:56,925   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-02-27T01:00:56,925   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-02-27T01:00:56,926   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:56,926   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:56,927   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:56,927   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:56,928   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:56,928   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:56,929   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:56,929   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-27T01:00:56,930   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-27T01:00:56,930   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-27T01:00:56,930   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-27T01:00:56,931   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-27T01:00:56,931   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:56,932   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:56,932   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:56,933   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:56,933   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:56,934   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:56,934   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:56,935   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:56,935   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:56,936   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:56,936   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:56,937   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:56,937   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:56,938   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:56,938   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:56,939   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:56,939   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-27T01:00:56,940   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-27T01:00:56,941   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-27T01:00:56,941   creating build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,942   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,942   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,942   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,943   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,943   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,944   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,944   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,945   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,945   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,945   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,946   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,946   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,947   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,948   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,948   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,949   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,949   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,950   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,950   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,951   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,951   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,952   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,952   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,953   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,953   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,954   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,954   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,955   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,955   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-27T01:00:56,956   creating build/lib/deepspeed/ops/csrc/lamb
2024-02-27T01:00:56,956   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-02-27T01:00:56,957   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-02-27T01:00:56,957   creating build/lib/deepspeed/ops/csrc/lion
2024-02-27T01:00:56,958   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-02-27T01:00:56,958   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-02-27T01:00:56,958   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-02-27T01:00:56,959   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-02-27T01:00:56,959   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-02-27T01:00:56,960   creating build/lib/deepspeed/ops/csrc/quantization
2024-02-27T01:00:56,960   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-27T01:00:56,961   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-27T01:00:56,961   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-02-27T01:00:56,961   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-27T01:00:56,962   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-27T01:00:56,962   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-27T01:00:56,963   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-27T01:00:56,963   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-02-27T01:00:56,964   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-27T01:00:56,964   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-27T01:00:56,965   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-27T01:00:56,965   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-27T01:00:56,966   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-02-27T01:00:56,966   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-02-27T01:00:56,969   creating build/lib/deepspeed/ops/csrc/spatial
2024-02-27T01:00:56,970   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-02-27T01:00:56,972   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-02-27T01:00:56,975   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-02-27T01:00:56,977   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-02-27T01:00:56,978   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-02-27T01:00:56,980   creating build/lib/deepspeed/ops/csrc/transformer
2024-02-27T01:00:56,981   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-27T01:00:56,984   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-27T01:00:56,987   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-02-27T01:00:56,990   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-27T01:00:56,992   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-27T01:00:56,995   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-27T01:00:56,999   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-27T01:00:57,001   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-27T01:00:57,004   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-02-27T01:00:57,004   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,005   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,008   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,010   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,013   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,015   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,017   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,021   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,023   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,025   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,028   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:57,031   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-27T01:00:57,032   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-27T01:00:57,034   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-27T01:00:57,037   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-27T01:00:57,040   creating build/lib/deepspeed/ops/csrc/utils
2024-02-27T01:00:57,040   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-02-27T01:00:57,042   creating build/lib/deepspeed/ops/csrc/xpu
2024-02-27T01:00:57,043   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-02-27T01:00:57,044   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-02-27T01:00:57,046   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-27T01:00:57,047   copying deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-27T01:00:57,049   copying deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-27T01:00:57,052   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-27T01:00:57,054   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-27T01:00:57,056   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-02-27T01:00:57,058   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-02-27T01:00:57,060   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:57,062   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:57,064   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:57,067   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:57,069   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:57,071   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:57,073   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,074   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,076   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,079   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,080   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,083   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,086   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-02-27T01:00:57,087   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-02-27T01:00:57,089   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-02-27T01:00:57,091   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-02-27T01:00:57,092   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-02-27T01:00:57,094   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-02-27T01:00:57,096   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-02-27T01:00:57,098   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-27T01:00:57,099   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-27T01:00:57,101   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-27T01:00:57,102   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-27T01:00:57,104   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-27T01:00:57,106   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-27T01:00:57,107   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-27T01:00:57,109   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-27T01:00:57,110   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-27T01:00:57,113   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,115   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,117   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,119   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-27T01:00:57,121   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-27T01:00:57,124   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,126   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,128   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,131   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:57,133   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:57,135   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:57,137   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:57,139   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:57,142   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:57,145   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,148   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,150   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,152   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,154   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,156   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,158   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,160   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,163   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,165   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,167   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,168   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,170   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,173   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,175   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,177   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,180   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,182   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,184   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,185   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,188   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,190   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,192   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,193   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,196   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-27T01:00:57,198   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-27T01:00:57,200   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,202   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,204   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,206   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,208   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:57,211   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:57,213   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:57,215   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:57,217   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:57,219   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:57,221   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-27T01:00:57,223   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-27T01:00:57,225   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-27T01:00:57,272   running build_scripts
2024-02-27T01:00:57,273   creating build/scripts-3.11
2024-02-27T01:00:57,274   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-02-27T01:00:57,275   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-02-27T01:00:57,276   copying and adjusting bin/ds -> build/scripts-3.11
2024-02-27T01:00:57,278   copying bin/ds_ssh -> build/scripts-3.11
2024-02-27T01:00:57,279   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-02-27T01:00:57,281   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-02-27T01:00:57,282   copying and adjusting bin/dsr -> build/scripts-3.11
2024-02-27T01:00:57,283   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-02-27T01:00:57,284   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-02-27T01:00:57,285   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-02-27T01:00:57,285   changing mode of build/scripts-3.11/ds from 644 to 755
2024-02-27T01:00:57,286   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-02-27T01:00:57,286   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-02-27T01:00:57,287   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-02-27T01:00:57,287   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-02-27T01:00:57,319   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-02-27T01:00:57,320   !!

2024-02-27T01:00:57,321           ********************************************************************************
2024-02-27T01:00:57,321           Please avoid running ``setup.py`` directly.
2024-02-27T01:00:57,322           Instead, use pypa/build, pypa/installer or other
2024-02-27T01:00:57,323           standards-based tools.

2024-02-27T01:00:57,324           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-02-27T01:00:57,324           ********************************************************************************

2024-02-27T01:00:57,326   !!
2024-02-27T01:00:57,326     self.initialize_options()
2024-02-27T01:00:57,354   installing to build/bdist.linux-armv7l/wheel
2024-02-27T01:00:57,355   running install
2024-02-27T01:00:57,378   running install_lib
2024-02-27T01:00:57,412   creating build/bdist.linux-armv7l
2024-02-27T01:00:57,412   creating build/bdist.linux-armv7l/wheel
2024-02-27T01:00:57,414   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-02-27T01:00:57,416   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-27T01:00:57,417   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-27T01:00:57,420   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-27T01:00:57,422   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-27T01:00:57,423   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-27T01:00:57,426   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-27T01:00:57,428   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-27T01:00:57,430   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-27T01:00:57,431   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-27T01:00:57,433   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-27T01:00:57,435   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-27T01:00:57,436   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-27T01:00:57,438   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-27T01:00:57,441   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-27T01:00:57,444   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-27T01:00:57,445   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-27T01:00:57,446   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-27T01:00:57,448   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-27T01:00:57,450   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-27T01:00:57,452   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:57,454   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-27T01:00:57,455   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-27T01:00:57,458   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-27T01:00:57,460   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-27T01:00:57,461   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-27T01:00:57,463   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-27T01:00:57,464   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-27T01:00:57,466   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-27T01:00:57,468   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-27T01:00:57,470   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-27T01:00:57,472   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-27T01:00:57,473   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-27T01:00:57,475   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-27T01:00:57,477   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-27T01:00:57,479   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-27T01:00:57,481   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:57,482   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:57,485   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:57,487   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:57,488   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:57,490   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:57,492   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:57,494   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:57,495   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:57,497   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-27T01:00:57,499   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:57,502   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-27T01:00:57,503   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-27T01:00:57,505   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-27T01:00:57,507   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-27T01:00:57,509   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-27T01:00:57,510   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:57,513   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:57,514   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:57,516   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:57,518   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:57,520   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:57,522   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:57,523   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:57,525   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:57,527   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:57,528   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-27T01:00:57,530   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:57,533   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-27T01:00:57,533   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-27T01:00:57,536   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-27T01:00:57,538   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-27T01:00:57,540   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-27T01:00:57,542   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:57,545   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:57,547   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:57,549   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-27T01:00:57,552   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-27T01:00:57,553   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-27T01:00:57,555   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-27T01:00:57,557   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-27T01:00:57,559   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-27T01:00:57,561   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-27T01:00:57,562   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-27T01:00:57,564   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-27T01:00:57,566   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-27T01:00:57,568   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-27T01:00:57,570   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-27T01:00:57,571   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-27T01:00:57,572   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-27T01:00:57,574   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-27T01:00:57,576   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-27T01:00:57,578   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-27T01:00:57,580   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-27T01:00:57,582   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-02-27T01:00:57,583   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,584   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,587   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,589   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,591   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,594   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-27T01:00:57,596   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-02-27T01:00:57,597   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,598   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,601   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,602   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,605   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,606   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,608   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,610   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-27T01:00:57,611   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-02-27T01:00:57,614   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-27T01:00:57,614   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-27T01:00:57,616   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-27T01:00:57,618   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-27T01:00:57,620   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-27T01:00:57,623   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,624   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,626   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,630   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,632   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,634   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,636   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,637   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,639   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-27T01:00:57,641   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:57,642   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:57,644   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:57,646   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:57,648   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:57,650   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-27T01:00:57,652   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-02-27T01:00:57,654   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:57,655   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:57,657   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:57,658   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:57,660   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:57,662   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-27T01:00:57,664   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-02-27T01:00:57,666   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,667   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,668   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,670   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,672   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,674   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,676   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-27T01:00:57,678   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,679   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,681   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,683   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,685   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,686   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,688   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-27T01:00:57,691   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-27T01:00:57,692   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-27T01:00:57,694   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-02-27T01:00:57,696   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,697   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,698   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,700   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,702   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,703   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,705   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-27T01:00:57,707   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,708   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,710   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,713   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,715   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,717   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,718   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,720   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,722   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-27T01:00:57,724   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-27T01:00:57,725   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-27T01:00:57,727   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-27T01:00:57,729   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-27T01:00:57,731   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,732   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,734   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,735   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,737   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,740   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,743   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-27T01:00:57,745   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,746   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,748   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,750   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,753   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,754   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,756   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-27T01:00:57,758   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-27T01:00:57,759   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-27T01:00:57,761   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-27T01:00:57,763   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-27T01:00:57,765   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-27T01:00:57,766   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-02-27T01:00:57,769   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,769   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,771   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,773   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,775   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,777   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,778   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-27T01:00:57,780   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-02-27T01:00:57,782   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-02-27T01:00:57,784   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-27T01:00:57,785   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-27T01:00:57,787   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-27T01:00:57,788   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-27T01:00:57,790   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:57,791   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:57,793   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:57,795   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:57,797   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:57,799   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:57,801   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-27T01:00:57,804   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:57,805   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:57,807   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:57,809   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:57,811   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:57,813   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-27T01:00:57,815   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-27T01:00:57,817   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-27T01:00:57,819   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-27T01:00:57,821   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-27T01:00:57,823   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-27T01:00:57,824   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-27T01:00:57,827   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-27T01:00:57,830   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-02-27T01:00:57,831   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-02-27T01:00:57,833   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-27T01:00:57,836   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-02-27T01:00:57,837   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-02-27T01:00:57,839   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-02-27T01:00:57,841   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-27T01:00:57,843   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-27T01:00:57,846   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-27T01:00:57,849   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-27T01:00:57,851   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-27T01:00:57,853   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:57,855   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:57,857   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:57,859   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:57,862   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:57,864   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:57,866   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:57,868   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:57,870   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-27T01:00:57,873   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-02-27T01:00:57,875   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-02-27T01:00:57,876   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-02-27T01:00:57,879   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-02-27T01:00:57,881   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-02-27T01:00:57,883   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-02-27T01:00:57,885   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-02-27T01:00:57,888   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-02-27T01:00:57,889   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-02-27T01:00:57,891   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-02-27T01:00:57,894   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-27T01:00:57,895   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-27T01:00:57,897   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-27T01:00:57,900   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-27T01:00:57,901   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-27T01:00:57,903   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-27T01:00:57,906   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-27T01:00:57,908   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-02-27T01:00:57,910   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-02-27T01:00:57,911   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-02-27T01:00:57,914   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-02-27T01:00:57,916   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-02-27T01:00:57,917   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-02-27T01:00:57,919   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-02-27T01:00:57,922   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-27T01:00:57,924   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-27T01:00:57,926   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-27T01:00:57,929   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:57,930   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:57,932   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:57,934   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:57,936   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:57,937   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:57,939   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:57,941   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-27T01:00:57,943   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-27T01:00:57,944   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-27T01:00:57,946   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-27T01:00:57,949   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-27T01:00:57,952   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-27T01:00:57,953   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-27T01:00:57,955   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-27T01:00:57,957   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-27T01:00:57,959   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-27T01:00:57,961   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-27T01:00:57,963   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-27T01:00:57,966   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-27T01:00:57,966   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-27T01:00:57,969   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-27T01:00:57,970   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-27T01:00:57,973   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-27T01:00:57,974   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-27T01:00:57,976   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-27T01:00:57,978   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-27T01:00:57,980   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-27T01:00:57,982   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-27T01:00:57,984   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-27T01:00:57,986   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-27T01:00:57,989   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-27T01:00:57,991   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-27T01:00:57,993   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-27T01:00:57,995   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-27T01:00:57,997   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-27T01:00:57,999   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-27T01:00:58,002   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-27T01:00:58,006   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-02-27T01:00:58,007   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-02-27T01:00:58,009   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-27T01:00:58,011   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-27T01:00:58,013   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-27T01:00:58,015   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-27T01:00:58,017   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-27T01:00:58,019   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-27T01:00:58,021   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-27T01:00:58,023   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-27T01:00:58,025   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-27T01:00:58,028   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-27T01:00:58,029   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-27T01:00:58,031   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-27T01:00:58,034   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-27T01:00:58,036   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-27T01:00:58,039   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-27T01:00:58,041   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-27T01:00:58,043   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-27T01:00:58,045   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-27T01:00:58,048   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-27T01:00:58,051   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-02-27T01:00:58,052   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-27T01:00:58,053   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-27T01:00:58,056   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-27T01:00:58,058   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-27T01:00:58,060   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-27T01:00:58,063   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-27T01:00:58,064   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-27T01:00:58,067   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-27T01:00:58,069   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-27T01:00:58,071   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-27T01:00:58,073   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-27T01:00:58,077   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-27T01:00:58,079   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-27T01:00:58,083   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-27T01:00:58,084   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-27T01:00:58,087   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-27T01:00:58,089   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-27T01:00:58,091   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-27T01:00:58,094   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-02-27T01:00:58,095   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-02-27T01:00:58,098   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,099   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,102   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,105   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,107   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,109   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,111   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,114   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,116   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,118   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,120   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,122   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,125   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,127   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:58,128   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:58,130   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:58,132   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:58,134   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:58,137   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:58,139   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-27T01:00:58,141   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,143   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:58,144   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:58,147   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:58,149   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:58,151   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:58,153   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-27T01:00:58,155   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,157   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,160   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-27T01:00:58,161   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-27T01:00:58,164   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-27T01:00:58,166   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-27T01:00:58,168   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-27T01:00:58,171   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-27T01:00:58,173   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-27T01:00:58,176   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-27T01:00:58,178   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-27T01:00:58,180   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-27T01:00:58,182   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,184   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,186   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,188   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,191   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:58,192   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:58,195   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:58,197   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:58,199   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:58,201   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:58,203   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-27T01:00:58,205   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,207   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,209   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-27T01:00:58,212   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-02-27T01:00:58,213   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-02-27T01:00:58,215   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-02-27T01:00:58,218   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-02-27T01:00:58,219   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-02-27T01:00:58,221   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-02-27T01:00:58,224   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-02-27T01:00:58,225   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-02-27T01:00:58,227   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-02-27T01:00:58,230   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-27T01:00:58,231   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-27T01:00:58,234   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-27T01:00:58,236   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-27T01:00:58,238   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-27T01:00:58,241   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-02-27T01:00:58,242   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-02-27T01:00:58,244   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-02-27T01:00:58,245   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-02-27T01:00:58,247   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-02-27T01:00:58,249   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-02-27T01:00:58,251   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-02-27T01:00:58,254   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-27T01:00:58,255   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-27T01:00:58,257   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-27T01:00:58,260   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-27T01:00:58,262   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-27T01:00:58,264   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-27T01:00:58,267   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-02-27T01:00:58,268   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-02-27T01:00:58,271   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-02-27T01:00:58,273   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-02-27T01:00:58,274   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-02-27T01:00:58,277   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,278   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,282   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,284   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,287   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,289   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,291   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,294   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,296   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,298   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,300   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,303   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-27T01:00:58,306   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:58,307   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:58,309   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:58,312   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:58,314   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:58,316   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:58,319   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-27T01:00:58,322   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,323   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,325   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,328   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,331   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,333   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,336   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,338   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,340   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,346   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,348   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,350   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,353   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,356   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,358   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,360   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,362   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,365   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,367   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,369   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,371   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,373   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,376   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,378   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,380   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,383   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,386   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,389   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,391   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,394   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-27T01:00:58,397   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-02-27T01:00:58,398   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:58,400   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:58,402   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:58,405   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:58,408   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:58,409   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:58,412   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:58,414   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:58,417   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:58,420   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:58,422   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:58,425   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-27T01:00:58,430   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:58,431   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:58,434   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:58,437   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:58,440   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:58,443   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:58,447   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:58,449   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-27T01:00:58,453   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:58,457   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-27T01:00:58,458   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-27T01:00:58,461   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-27T01:00:58,463   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-27T01:00:58,464   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-27T01:00:58,467   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-27T01:00:58,469   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-27T01:00:58,472   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-27T01:00:58,474   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:58,477   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-27T01:00:58,480   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-02-27T01:00:58,481   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-02-27T01:00:58,484   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-27T01:00:58,485   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-27T01:00:58,487   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-27T01:00:58,489   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-27T01:00:58,492   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-27T01:00:58,494   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-27T01:00:58,496   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-27T01:00:58,498   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-27T01:00:58,501   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-27T01:00:58,502   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-27T01:00:58,504   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-27T01:00:58,506   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-27T01:00:58,508   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-27T01:00:58,510   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-27T01:00:58,513   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-02-27T01:00:58,514   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-02-27T01:00:58,517   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-02-27T01:00:58,518   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-02-27T01:00:58,519   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-02-27T01:00:58,521   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-02-27T01:00:58,522   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-02-27T01:00:58,526   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-02-27T01:00:58,526   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-02-27T01:00:58,529   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-27T01:00:58,530   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-27T01:00:58,532   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-27T01:00:58,535   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-27T01:00:58,537   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-27T01:00:58,539   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-27T01:00:58,540   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-02-27T01:00:58,542   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-27T01:00:58,543   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-27T01:00:58,545   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-27T01:00:58,547   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-27T01:00:58,550   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,551   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,553   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,556   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,558   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,561   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,564   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,567   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,569   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,572   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,574   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-27T01:00:58,576   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-27T01:00:58,579   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-27T01:00:58,582   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-27T01:00:58,584   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-27T01:00:58,586   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-27T01:00:58,589   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-27T01:00:58,592   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-27T01:00:58,595   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-27T01:00:58,598   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-02-27T01:00:58,600   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:58,601   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:58,603   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:58,605   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:58,607   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:58,609   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-27T01:00:58,611   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-02-27T01:00:58,612   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-02-27T01:00:58,615   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-27T01:00:58,616   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-27T01:00:58,618   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-27T01:00:58,620   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-27T01:00:58,622   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-27T01:00:58,624   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-02-27T01:00:58,625   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-02-27T01:00:58,627   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-02-27T01:00:58,628   copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-02-27T01:00:58,630   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-02-27T01:00:58,631   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-02-27T01:00:58,633   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-02-27T01:00:58,636   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-02-27T01:00:58,638   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-02-27T01:00:58,639   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-02-27T01:00:58,641   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-02-27T01:00:58,643   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-02-27T01:00:58,645   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,646   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,649   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,650   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,652   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,654   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,656   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,658   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,661   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,662   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,665   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,666   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,668   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-27T01:00:58,670   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,672   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,675   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,676   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,678   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,680   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,682   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,683   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,685   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,687   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,689   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,691   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,693   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-27T01:00:58,695   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,697   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,700   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,701   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,703   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,705   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,707   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-27T01:00:58,709   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-02-27T01:00:58,711   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-02-27T01:00:58,713   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-02-27T01:00:58,714   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-02-27T01:00:58,716   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-02-27T01:00:58,718   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-02-27T01:00:58,720   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-27T01:00:58,721   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-27T01:00:58,723   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-27T01:00:58,725   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-27T01:00:58,726   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-02-27T01:00:58,729   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-02-27T01:00:58,730   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-02-27T01:00:58,731   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-02-27T01:00:58,734   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,735   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,737   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,738   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,740   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,742   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,745   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,746   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,748   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,750   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,751   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-27T01:00:58,754   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,754   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,757   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,759   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,762   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,764   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,766   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,767   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,769   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,771   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,773   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-27T01:00:58,775   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-27T01:00:58,776   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-27T01:00:58,779   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-02-27T01:00:58,780   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-02-27T01:00:58,783   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-02-27T01:00:58,785   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-27T01:00:58,787   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-27T01:00:58,789   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-27T01:00:58,790   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-27T01:00:58,793   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-27T01:00:58,796   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-27T01:00:58,798   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-27T01:00:58,800   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-27T01:00:58,803   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-27T01:00:58,805   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-27T01:00:58,807   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-27T01:00:58,810   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,810   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,813   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,815   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,817   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,820   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,823   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,825   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,826   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,828   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,830   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,832   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,834   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,836   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,838   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,841   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,843   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,845   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,847   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,849   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,851   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,853   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,855   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,857   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,859   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,862   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-27T01:00:58,862   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-27T01:00:58,864   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-27T01:00:58,866   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-27T01:00:58,868   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-27T01:00:58,870   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-27T01:00:58,871   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-27T01:00:58,873   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-27T01:00:58,876   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,878   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-27T01:00:58,879   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,881   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,883   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,884   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,887   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,888   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,891   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-27T01:00:58,893   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-27T01:00:58,894   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-27T01:00:58,896   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-27T01:00:58,898   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-27T01:00:58,900   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-27T01:00:58,902   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,903   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,905   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,908   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,910   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,912   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,914   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,916   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,918   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,920   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,922   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,924   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,926   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,928   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,930   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,932   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-27T01:00:58,934   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-27T01:00:58,935   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-27T01:00:58,938   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-27T01:00:58,939   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-27T01:00:58,941   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-27T01:00:58,944   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-27T01:00:58,946   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-27T01:00:58,949   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-27T01:00:58,950   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-27T01:00:58,952   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-27T01:00:58,954   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-27T01:00:58,956   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-27T01:00:58,958   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-27T01:00:58,961   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-27T01:00:58,963   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-27T01:00:58,965   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-27T01:00:58,967   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-27T01:00:58,969   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-27T01:00:58,973   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:58,974   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-27T01:00:58,975   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-27T01:00:58,978   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-27T01:00:58,980   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-27T01:00:58,982   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-27T01:00:58,984   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-27T01:00:58,985   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-27T01:00:58,988   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-27T01:00:58,990   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-27T01:00:58,993   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-27T01:00:58,995   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:58,998   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-27T01:00:58,999   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-27T01:00:59,001   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-27T01:00:59,003   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-27T01:00:59,005   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,008   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,010   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,012   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-27T01:00:59,013   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-27T01:00:59,016   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-27T01:00:59,018   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-27T01:00:59,021   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-27T01:00:59,022   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-27T01:00:59,025   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-27T01:00:59,027   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-27T01:00:59,029   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-27T01:00:59,031   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-27T01:00:59,033   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-27T01:00:59,034   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-27T01:00:59,037   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-27T01:00:59,040   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-27T01:00:59,042   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-27T01:00:59,045   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-27T01:00:59,047   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-27T01:00:59,050   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-27T01:00:59,050   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-27T01:00:59,053   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-27T01:00:59,055   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-27T01:00:59,057   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-27T01:00:59,059   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-27T01:00:59,061   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,064   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-27T01:00:59,064   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-27T01:00:59,067   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:59,068   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:59,070   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:59,072   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:59,073   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:59,075   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-27T01:00:59,077   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-27T01:00:59,079   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-27T01:00:59,081   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-27T01:00:59,083   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:59,084   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:59,087   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:59,090   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:59,092   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:59,093   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-27T01:00:59,096   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,099   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,100   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,103   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,105   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,107   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,110   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,111   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,113   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,116   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,120   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,122   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,124   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,128   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,133   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,135   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,137   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,139   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-27T01:00:59,141   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,147   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-02-27T01:00:59,149   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-02-27T01:00:59,151   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-02-27T01:00:59,153   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,155   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,158   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,160   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,163   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,166   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-27T01:00:59,167   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-27T01:00:59,169   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-27T01:00:59,172   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-27T01:00:59,174   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-27T01:00:59,176   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,178   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,180   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,183   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,185   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-27T01:00:59,188   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-02-27T01:00:59,189   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-02-27T01:00:59,191   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-02-27T01:00:59,193   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-27T01:00:59,195   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-27T01:00:59,197   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-27T01:00:59,198   running install_egg_info
2024-02-27T01:00:59,238   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.13.4-py3.11.egg-info
2024-02-27T01:00:59,250   running install_scripts
2024-02-27T01:00:59,251   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data
2024-02-27T01:00:59,251   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts
2024-02-27T01:00:59,253   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts
2024-02-27T01:00:59,254   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts
2024-02-27T01:00:59,256   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts
2024-02-27T01:00:59,258   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts
2024-02-27T01:00:59,260   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts
2024-02-27T01:00:59,261   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts
2024-02-27T01:00:59,263   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts
2024-02-27T01:00:59,265   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts
2024-02-27T01:00:59,266   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts/ds_bench to 755
2024-02-27T01:00:59,267   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts/deepspeed to 755
2024-02-27T01:00:59,267   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts/ds to 755
2024-02-27T01:00:59,268   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts/ds_report to 755
2024-02-27T01:00:59,269   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts/deepspeed.pt to 755
2024-02-27T01:00:59,269   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts/ds_ssh to 755
2024-02-27T01:00:59,270   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts/ds_elastic to 755
2024-02-27T01:00:59,270   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.data/scripts/dsr to 755
2024-02-27T01:00:59,312   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.4.dist-info/WHEEL
2024-02-27T01:00:59,315   creating '/tmp/pip-wheel-5pqd6hzz/deepspeed-0.13.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-02-27T01:00:59,318   adding 'deepspeed/__init__.py'
2024-02-27T01:00:59,319   adding 'deepspeed/constants.py'
2024-02-27T01:00:59,321   adding 'deepspeed/env_report.py'
2024-02-27T01:00:59,322   adding 'deepspeed/git_version_info.py'
2024-02-27T01:00:59,323   adding 'deepspeed/git_version_info_installed.py'
2024-02-27T01:00:59,324   adding 'deepspeed/pydantic_v1.py'
2024-02-27T01:00:59,326   adding 'deepspeed/accelerator/__init__.py'
2024-02-27T01:00:59,327   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-02-27T01:00:59,329   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-02-27T01:00:59,331   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-02-27T01:00:59,332   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-02-27T01:00:59,334   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-02-27T01:00:59,335   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-02-27T01:00:59,337   adding 'deepspeed/accelerator/real_accelerator.py'
2024-02-27T01:00:59,339   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-02-27T01:00:59,340   adding 'deepspeed/autotuning/__init__.py'
2024-02-27T01:00:59,345   adding 'deepspeed/autotuning/autotuner.py'
2024-02-27T01:00:59,347   adding 'deepspeed/autotuning/config.py'
2024-02-27T01:00:59,348   adding 'deepspeed/autotuning/constants.py'
2024-02-27T01:00:59,351   adding 'deepspeed/autotuning/scheduler.py'
2024-02-27T01:00:59,353   adding 'deepspeed/autotuning/utils.py'
2024-02-27T01:00:59,354   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-02-27T01:00:59,355   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-02-27T01:00:59,357   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-02-27T01:00:59,358   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-02-27T01:00:59,359   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-02-27T01:00:59,361   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-02-27T01:00:59,362   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-02-27T01:00:59,363   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-02-27T01:00:59,365   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-02-27T01:00:59,366   adding 'deepspeed/autotuning/tuner/utils.py'
2024-02-27T01:00:59,368   adding 'deepspeed/checkpoint/__init__.py'
2024-02-27T01:00:59,370   adding 'deepspeed/checkpoint/constants.py'
2024-02-27T01:00:59,372   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-02-27T01:00:59,374   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-02-27T01:00:59,375   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-02-27T01:00:59,377   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-02-27T01:00:59,378   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-02-27T01:00:59,380   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-02-27T01:00:59,381   adding 'deepspeed/checkpoint/utils.py'
2024-02-27T01:00:59,382   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-02-27T01:00:59,384   adding 'deepspeed/comm/__init__.py'
2024-02-27T01:00:59,386   adding 'deepspeed/comm/backend.py'
2024-02-27T01:00:59,387   adding 'deepspeed/comm/ccl.py'
2024-02-27T01:00:59,390   adding 'deepspeed/comm/comm.py'
2024-02-27T01:00:59,392   adding 'deepspeed/comm/config.py'
2024-02-27T01:00:59,393   adding 'deepspeed/comm/constants.py'
2024-02-27T01:00:59,394   adding 'deepspeed/comm/reduce_op.py'
2024-02-27T01:00:59,396   adding 'deepspeed/comm/torch.py'
2024-02-27T01:00:59,398   adding 'deepspeed/comm/utils.py'
2024-02-27T01:00:59,399   adding 'deepspeed/compression/__init__.py'
2024-02-27T01:00:59,403   adding 'deepspeed/compression/basic_layer.py'
2024-02-27T01:00:59,405   adding 'deepspeed/compression/compress.py'
2024-02-27T01:00:59,407   adding 'deepspeed/compression/config.py'
2024-02-27T01:00:59,409   adding 'deepspeed/compression/constants.py'
2024-02-27T01:00:59,411   adding 'deepspeed/compression/helper.py'
2024-02-27T01:00:59,412   adding 'deepspeed/compression/scheduler.py'
2024-02-27T01:00:59,413   adding 'deepspeed/compression/utils.py'
2024-02-27T01:00:59,415   adding 'deepspeed/elasticity/__init__.py'
2024-02-27T01:00:59,416   adding 'deepspeed/elasticity/config.py'
2024-02-27T01:00:59,418   adding 'deepspeed/elasticity/constants.py'
2024-02-27T01:00:59,419   adding 'deepspeed/elasticity/elastic_agent.py'
2024-02-27T01:00:59,421   adding 'deepspeed/elasticity/elasticity.py'
2024-02-27T01:00:59,423   adding 'deepspeed/elasticity/utils.py'
2024-02-27T01:00:59,424   adding 'deepspeed/inference/__init__.py'
2024-02-27T01:00:59,426   adding 'deepspeed/inference/config.py'
2024-02-27T01:00:59,430   adding 'deepspeed/inference/engine.py'
2024-02-27T01:00:59,431   adding 'deepspeed/inference/quantization/__init__.py'
2024-02-27T01:00:59,433   adding 'deepspeed/inference/quantization/layers.py'
2024-02-27T01:00:59,434   adding 'deepspeed/inference/quantization/quantization.py'
2024-02-27T01:00:59,435   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-02-27T01:00:59,437   adding 'deepspeed/inference/quantization/utils.py'
2024-02-27T01:00:59,439   adding 'deepspeed/inference/v2/__init__.py'
2024-02-27T01:00:59,440   adding 'deepspeed/inference/v2/allocator.py'
2024-02-27T01:00:59,441   adding 'deepspeed/inference/v2/config_v2.py'
2024-02-27T01:00:59,443   adding 'deepspeed/inference/v2/engine_factory.py'
2024-02-27T01:00:59,445   adding 'deepspeed/inference/v2/engine_v2.py'
2024-02-27T01:00:59,446   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-02-27T01:00:59,447   adding 'deepspeed/inference/v2/inference_utils.py'
2024-02-27T01:00:59,449   adding 'deepspeed/inference/v2/logging.py'
2024-02-27T01:00:59,450   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-02-27T01:00:59,452   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-02-27T01:00:59,453   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-02-27T01:00:59,454   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-02-27T01:00:59,456   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-02-27T01:00:59,457   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-02-27T01:00:59,458   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-02-27T01:00:59,460   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-02-27T01:00:59,461   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-02-27T01:00:59,463   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-02-27T01:00:59,464   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-02-27T01:00:59,466   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-02-27T01:00:59,467   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-02-27T01:00:59,468   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-02-27T01:00:59,470   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-02-27T01:00:59,472   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-02-27T01:00:59,473   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-02-27T01:00:59,475   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-02-27T01:00:59,476   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-02-27T01:00:59,478   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-02-27T01:00:59,479   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-02-27T01:00:59,480   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-02-27T01:00:59,481   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-02-27T01:00:59,483   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-02-27T01:00:59,484   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-02-27T01:00:59,486   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-02-27T01:00:59,488   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-02-27T01:00:59,489   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-02-27T01:00:59,490   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-02-27T01:00:59,492   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-02-27T01:00:59,493   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-02-27T01:00:59,495   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-02-27T01:00:59,496   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-02-27T01:00:59,498   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-02-27T01:00:59,499   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-02-27T01:00:59,500   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-02-27T01:00:59,502   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-02-27T01:00:59,503   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-02-27T01:00:59,505   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-02-27T01:00:59,506   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-02-27T01:00:59,508   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-02-27T01:00:59,509   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-02-27T01:00:59,511   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-02-27T01:00:59,512   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-02-27T01:00:59,513   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-02-27T01:00:59,515   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-02-27T01:00:59,516   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-02-27T01:00:59,518   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-02-27T01:00:59,519   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-02-27T01:00:59,521   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-02-27T01:00:59,522   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-02-27T01:00:59,524   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-02-27T01:00:59,526   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-02-27T01:00:59,527   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-02-27T01:00:59,529   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-02-27T01:00:59,531   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-02-27T01:00:59,534   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-02-27T01:00:59,536   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-02-27T01:00:59,537   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-02-27T01:00:59,539   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-02-27T01:00:59,540   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-02-27T01:00:59,541   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-02-27T01:00:59,543   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-02-27T01:00:59,544   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-02-27T01:00:59,546   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-02-27T01:00:59,547   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-02-27T01:00:59,548   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-02-27T01:00:59,550   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-02-27T01:00:59,551   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-02-27T01:00:59,553   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-02-27T01:00:59,554   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-02-27T01:00:59,555   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-02-27T01:00:59,557   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-02-27T01:00:59,558   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-02-27T01:00:59,559   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-02-27T01:00:59,561   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-02-27T01:00:59,563   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-02-27T01:00:59,564   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-02-27T01:00:59,565   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-02-27T01:00:59,567   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-02-27T01:00:59,568   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-02-27T01:00:59,570   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-02-27T01:00:59,571   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-02-27T01:00:59,573   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-02-27T01:00:59,574   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-02-27T01:00:59,576   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-02-27T01:00:59,577   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-02-27T01:00:59,578   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-02-27T01:00:59,580   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-02-27T01:00:59,581   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-02-27T01:00:59,583   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-02-27T01:00:59,584   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-02-27T01:00:59,585   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-02-27T01:00:59,586   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-02-27T01:00:59,588   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-02-27T01:00:59,589   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-02-27T01:00:59,591   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-02-27T01:00:59,592   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-02-27T01:00:59,593   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-02-27T01:00:59,595   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-02-27T01:00:59,596   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-02-27T01:00:59,598   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-02-27T01:00:59,600   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-02-27T01:00:59,601   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-02-27T01:00:59,602   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-02-27T01:00:59,604   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-02-27T01:00:59,605   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-02-27T01:00:59,607   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-02-27T01:00:59,608   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-02-27T01:00:59,609   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-02-27T01:00:59,610   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-02-27T01:00:59,612   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-02-27T01:00:59,614   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-02-27T01:00:59,616   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-02-27T01:00:59,617   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-02-27T01:00:59,620   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-02-27T01:00:59,622   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-02-27T01:00:59,624   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-02-27T01:00:59,626   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-02-27T01:00:59,627   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-02-27T01:00:59,629   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-02-27T01:00:59,630   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-02-27T01:00:59,631   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-02-27T01:00:59,632   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-02-27T01:00:59,634   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-02-27T01:00:59,635   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-02-27T01:00:59,636   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-02-27T01:00:59,638   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-02-27T01:00:59,639   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-02-27T01:00:59,641   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-02-27T01:00:59,642   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-02-27T01:00:59,644   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-02-27T01:00:59,645   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-02-27T01:00:59,647   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-02-27T01:00:59,648   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-02-27T01:00:59,650   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-02-27T01:00:59,651   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-02-27T01:00:59,653   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-02-27T01:00:59,654   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-02-27T01:00:59,656   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-02-27T01:00:59,657   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-02-27T01:00:59,659   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-02-27T01:00:59,660   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-02-27T01:00:59,662   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-02-27T01:00:59,663   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-02-27T01:00:59,665   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-02-27T01:00:59,666   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-02-27T01:00:59,668   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-02-27T01:00:59,669   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-02-27T01:00:59,670   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-02-27T01:00:59,672   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-02-27T01:00:59,673   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-02-27T01:00:59,675   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-02-27T01:00:59,676   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-02-27T01:00:59,678   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-02-27T01:00:59,679   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-02-27T01:00:59,680   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-02-27T01:00:59,682   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-02-27T01:00:59,683   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-02-27T01:00:59,684   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-02-27T01:00:59,686   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-02-27T01:00:59,687   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-02-27T01:00:59,688   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-02-27T01:00:59,690   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-02-27T01:00:59,692   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-02-27T01:00:59,693   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-02-27T01:00:59,695   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-02-27T01:00:59,696   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-02-27T01:00:59,698   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-02-27T01:00:59,699   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-02-27T01:00:59,700   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-02-27T01:00:59,702   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-02-27T01:00:59,703   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-02-27T01:00:59,704   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-02-27T01:00:59,706   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-02-27T01:00:59,708   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-02-27T01:00:59,710   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-02-27T01:00:59,711   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-02-27T01:00:59,713   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-02-27T01:00:59,714   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-02-27T01:00:59,716   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-02-27T01:00:59,717   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-02-27T01:00:59,719   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-02-27T01:00:59,721   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-02-27T01:00:59,723   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-02-27T01:00:59,724   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-02-27T01:00:59,725   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-02-27T01:00:59,726   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-02-27T01:00:59,728   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-02-27T01:00:59,729   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-02-27T01:00:59,731   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-02-27T01:00:59,733   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-02-27T01:00:59,734   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-02-27T01:00:59,736   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-02-27T01:00:59,737   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-02-27T01:00:59,738   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-02-27T01:00:59,740   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-02-27T01:00:59,741   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-02-27T01:00:59,742   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-02-27T01:00:59,744   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-02-27T01:00:59,745   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-02-27T01:00:59,747   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-02-27T01:00:59,748   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-02-27T01:00:59,750   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-02-27T01:00:59,752   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-02-27T01:00:59,754   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-02-27T01:00:59,756   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-02-27T01:00:59,757   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-02-27T01:00:59,759   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-02-27T01:00:59,761   adding 'deepspeed/launcher/__init__.py'
2024-02-27T01:00:59,762   adding 'deepspeed/launcher/constants.py'
2024-02-27T01:00:59,764   adding 'deepspeed/launcher/launch.py'
2024-02-27T01:00:59,766   adding 'deepspeed/launcher/launcher_helper.py'
2024-02-27T01:00:59,768   adding 'deepspeed/launcher/multinode_runner.py'
2024-02-27T01:00:59,771   adding 'deepspeed/launcher/runner.py'
2024-02-27T01:00:59,773   adding 'deepspeed/model_implementations/__init__.py'
2024-02-27T01:00:59,774   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-02-27T01:00:59,776   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-02-27T01:00:59,777   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-02-27T01:00:59,779   adding 'deepspeed/model_implementations/features/__init__.py'
2024-02-27T01:00:59,780   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-02-27T01:00:59,782   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-02-27T01:00:59,783   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-02-27T01:00:59,784   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-02-27T01:00:59,785   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-02-27T01:00:59,787   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-02-27T01:00:59,788   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-02-27T01:00:59,789   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-02-27T01:00:59,791   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-02-27T01:00:59,792   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-02-27T01:00:59,794   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-02-27T01:00:59,796   adding 'deepspeed/module_inject/__init__.py'
2024-02-27T01:00:59,798   adding 'deepspeed/module_inject/auto_tp.py'
2024-02-27T01:00:59,800   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-02-27T01:00:59,801   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-02-27T01:00:59,803   adding 'deepspeed/module_inject/inject.py'
2024-02-27T01:00:59,804   adding 'deepspeed/module_inject/layers.py'
2024-02-27T01:00:59,806   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-02-27T01:00:59,807   adding 'deepspeed/module_inject/module_quantize.py'
2024-02-27T01:00:59,809   adding 'deepspeed/module_inject/policy.py'
2024-02-27T01:00:59,813   adding 'deepspeed/module_inject/replace_module.py'
2024-02-27T01:00:59,814   adding 'deepspeed/module_inject/replace_policy.py'
2024-02-27T01:00:59,815   adding 'deepspeed/module_inject/tp_shard.py'
2024-02-27T01:00:59,816   adding 'deepspeed/module_inject/utils.py'
2024-02-27T01:00:59,818   adding 'deepspeed/module_inject/containers/__init__.py'
2024-02-27T01:00:59,820   adding 'deepspeed/module_inject/containers/base.py'
2024-02-27T01:00:59,822   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-02-27T01:00:59,823   adding 'deepspeed/module_inject/containers/bert.py'
2024-02-27T01:00:59,824   adding 'deepspeed/module_inject/containers/bloom.py'
2024-02-27T01:00:59,826   adding 'deepspeed/module_inject/containers/clip.py'
2024-02-27T01:00:59,827   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-02-27T01:00:59,828   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-02-27T01:00:59,830   adding 'deepspeed/module_inject/containers/gptj.py'
2024-02-27T01:00:59,831   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-02-27T01:00:59,833   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-02-27T01:00:59,834   adding 'deepspeed/module_inject/containers/internlm.py'
2024-02-27T01:00:59,836   adding 'deepspeed/module_inject/containers/llama.py'
2024-02-27T01:00:59,837   adding 'deepspeed/module_inject/containers/llama2.py'
2024-02-27T01:00:59,839   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-02-27T01:00:59,840   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-02-27T01:00:59,842   adding 'deepspeed/module_inject/containers/opt.py'
2024-02-27T01:00:59,843   adding 'deepspeed/module_inject/containers/unet.py'
2024-02-27T01:00:59,845   adding 'deepspeed/module_inject/containers/vae.py'
2024-02-27T01:00:59,846   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-02-27T01:00:59,848   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-02-27T01:00:59,849   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-02-27T01:00:59,851   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-02-27T01:00:59,852   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-02-27T01:00:59,853   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-02-27T01:00:59,855   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-02-27T01:00:59,857   adding 'deepspeed/moe/__init__.py'
2024-02-27T01:00:59,858   adding 'deepspeed/moe/experts.py'
2024-02-27T01:00:59,859   adding 'deepspeed/moe/layer.py'
2024-02-27T01:00:59,861   adding 'deepspeed/moe/mappings.py'
2024-02-27T01:00:59,864   adding 'deepspeed/moe/sharded_moe.py'
2024-02-27T01:00:59,865   adding 'deepspeed/moe/utils.py'
2024-02-27T01:00:59,867   adding 'deepspeed/monitor/__init__.py'
2024-02-27T01:00:59,868   adding 'deepspeed/monitor/config.py'
2024-02-27T01:00:59,869   adding 'deepspeed/monitor/csv_monitor.py'
2024-02-27T01:00:59,871   adding 'deepspeed/monitor/monitor.py'
2024-02-27T01:00:59,872   adding 'deepspeed/monitor/tensorboard.py'
2024-02-27T01:00:59,873   adding 'deepspeed/monitor/utils.py'
2024-02-27T01:00:59,874   adding 'deepspeed/monitor/wandb.py'
2024-02-27T01:00:59,876   adding 'deepspeed/nebula/__init__.py'
2024-02-27T01:00:59,877   adding 'deepspeed/nebula/config.py'
2024-02-27T01:00:59,878   adding 'deepspeed/nebula/constants.py'
2024-02-27T01:00:59,880   adding 'deepspeed/ops/__init__.py'
2024-02-27T01:00:59,882   adding 'deepspeed/ops/adagrad/__init__.py'
2024-02-27T01:00:59,883   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-02-27T01:00:59,884   adding 'deepspeed/ops/adam/__init__.py'
2024-02-27T01:00:59,886   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-02-27T01:00:59,888   adding 'deepspeed/ops/adam/fused_adam.py'
2024-02-27T01:00:59,889   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-02-27T01:00:59,890   adding 'deepspeed/ops/aio/__init__.py'
2024-02-27T01:00:59,893   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-02-27T01:00:59,894   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-02-27T01:00:59,896   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-02-27T01:00:59,897   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-02-27T01:00:59,898   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-02-27T01:00:59,900   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-02-27T01:00:59,903   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-02-27T01:00:59,904   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-02-27T01:00:59,905   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-02-27T01:00:59,906   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-02-27T01:00:59,908   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-02-27T01:00:59,909   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-02-27T01:00:59,911   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-02-27T01:00:59,912   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-02-27T01:00:59,913   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-02-27T01:00:59,915   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-02-27T01:00:59,916   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-02-27T01:00:59,917   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-02-27T01:00:59,919   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-02-27T01:00:59,920   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-02-27T01:00:59,921   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-02-27T01:00:59,923   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-02-27T01:00:59,924   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-02-27T01:00:59,926   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-02-27T01:00:59,927   adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu'
2024-02-27T01:00:59,929   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-02-27T01:00:59,933   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-02-27T01:00:59,934   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-02-27T01:00:59,937   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-02-27T01:00:59,938   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-02-27T01:00:59,940   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-02-27T01:00:59,942   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-02-27T01:00:59,949   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-02-27T01:00:59,955   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-02-27T01:00:59,957   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-02-27T01:00:59,960   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-02-27T01:00:59,961   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-02-27T01:00:59,963   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-02-27T01:00:59,965   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-02-27T01:00:59,967   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-02-27T01:00:59,970   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-02-27T01:00:59,972   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-02-27T01:00:59,973   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-02-27T01:00:59,975   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-02-27T01:00:59,983   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-02-27T01:00:59,986   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-02-27T01:00:59,988   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-02-27T01:00:59,992   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-02-27T01:00:59,995   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-02-27T01:00:59,999   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-02-27T01:01:00,000   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-02-27T01:01:00,002   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-02-27T01:01:00,004   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-02-27T01:01:00,006   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-02-27T01:01:00,008   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-02-27T01:01:00,009   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-02-27T01:01:00,010   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-02-27T01:01:00,011   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-02-27T01:01:00,013   adding 'deepspeed/ops/csrc/includes/context.h'
2024-02-27T01:01:00,015   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-02-27T01:01:00,016   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-02-27T01:01:00,018   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-02-27T01:01:00,020   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-02-27T01:01:00,021   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-02-27T01:01:00,023   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-02-27T01:01:00,024   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-02-27T01:01:00,025   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-02-27T01:01:00,027   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-02-27T01:01:00,028   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-02-27T01:01:00,029   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-02-27T01:01:00,031   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-02-27T01:01:00,032   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-02-27T01:01:00,033   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-02-27T01:01:00,036   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-02-27T01:01:00,037   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-02-27T01:01:00,039   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-02-27T01:01:00,041   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-02-27T01:01:00,042   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-02-27T01:01:00,045   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-02-27T01:01:00,046   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-02-27T01:01:00,048   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-02-27T01:01:00,049   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-02-27T01:01:00,050   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-02-27T01:01:00,052   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-02-27T01:01:00,054   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-02-27T01:01:00,056   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-02-27T01:01:00,057   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-02-27T01:01:00,058   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-02-27T01:01:00,059   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-02-27T01:01:00,061   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-02-27T01:01:00,063   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-02-27T01:01:00,065   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-02-27T01:01:00,067   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-02-27T01:01:00,069   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-02-27T01:01:00,071   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-02-27T01:01:00,072   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-02-27T01:01:00,074   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-02-27T01:01:00,076   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-02-27T01:01:00,077   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-02-27T01:01:00,079   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-02-27T01:01:00,080   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-02-27T01:01:00,082   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-02-27T01:01:00,084   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-02-27T01:01:00,085   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-02-27T01:01:00,087   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-02-27T01:01:00,089   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-02-27T01:01:00,092   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-02-27T01:01:00,096   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-02-27T01:01:00,098   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-02-27T01:01:00,099   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-02-27T01:01:00,104   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-02-27T01:01:00,107   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-02-27T01:01:00,109   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-02-27T01:01:00,112   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-02-27T01:01:00,113   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-02-27T01:01:00,116   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-02-27T01:01:00,118   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-02-27T01:01:00,120   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-02-27T01:01:00,125   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-02-27T01:01:00,127   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-02-27T01:01:00,128   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-02-27T01:01:00,131   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-02-27T01:01:00,134   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-02-27T01:01:00,136   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-02-27T01:01:00,138   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-02-27T01:01:00,140   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-02-27T01:01:00,141   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-02-27T01:01:00,144   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-02-27T01:01:00,146   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp'
2024-02-27T01:01:00,147   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp'
2024-02-27T01:01:00,148   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-02-27T01:01:00,150   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-02-27T01:01:00,151   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-02-27T01:01:00,153   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-02-27T01:01:00,154   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-02-27T01:01:00,156   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-02-27T01:01:00,157   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-02-27T01:01:00,158   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-02-27T01:01:00,160   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-02-27T01:01:00,161   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-02-27T01:01:00,163   adding 'deepspeed/ops/lamb/__init__.py'
2024-02-27T01:01:00,164   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-02-27T01:01:00,166   adding 'deepspeed/ops/lion/__init__.py'
2024-02-27T01:01:00,167   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-02-27T01:01:00,169   adding 'deepspeed/ops/lion/fused_lion.py'
2024-02-27T01:01:00,170   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-02-27T01:01:00,172   adding 'deepspeed/ops/op_builder/__init__.py'
2024-02-27T01:01:00,174   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-02-27T01:01:00,175   adding 'deepspeed/ops/op_builder/async_io.py'
2024-02-27T01:01:00,179   adding 'deepspeed/ops/op_builder/builder.py'
2024-02-27T01:01:00,180   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-02-27T01:01:00,181   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-02-27T01:01:00,183   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-02-27T01:01:00,184   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-02-27T01:01:00,185   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-02-27T01:01:00,186   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-02-27T01:01:00,188   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-02-27T01:01:00,189   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-02-27T01:01:00,190   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-02-27T01:01:00,192   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-02-27T01:01:00,193   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-02-27T01:01:00,194   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-02-27T01:01:00,196   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-02-27T01:01:00,197   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-02-27T01:01:00,198   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-02-27T01:01:00,199   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-02-27T01:01:00,201   adding 'deepspeed/ops/op_builder/transformer.py'
2024-02-27T01:01:00,202   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-02-27T01:01:00,204   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-02-27T01:01:00,205   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-02-27T01:01:00,206   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-02-27T01:01:00,207   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-02-27T01:01:00,209   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-02-27T01:01:00,210   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-02-27T01:01:00,211   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-02-27T01:01:00,213   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-02-27T01:01:00,214   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-02-27T01:01:00,215   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-02-27T01:01:00,217   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-02-27T01:01:00,218   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-02-27T01:01:00,220   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-02-27T01:01:00,221   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-02-27T01:01:00,222   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-02-27T01:01:00,223   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-02-27T01:01:00,224   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-02-27T01:01:00,226   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-02-27T01:01:00,227   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-02-27T01:01:00,228   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-02-27T01:01:00,230   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-02-27T01:01:00,231   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-02-27T01:01:00,233   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-02-27T01:01:00,234   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-02-27T01:01:00,235   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-02-27T01:01:00,236   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-02-27T01:01:00,238   adding 'deepspeed/ops/quantizer/__init__.py'
2024-02-27T01:01:00,239   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-02-27T01:01:00,240   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-02-27T01:01:00,242   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-02-27T01:01:00,243   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-02-27T01:01:00,245   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-02-27T01:01:00,248   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-02-27T01:01:00,250   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-02-27T01:01:00,252   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-02-27T01:01:00,254   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-02-27T01:01:00,257   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-02-27T01:01:00,259   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-02-27T01:01:00,260   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-02-27T01:01:00,262   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-02-27T01:01:00,263   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-02-27T01:01:00,265   adding 'deepspeed/ops/transformer/__init__.py'
2024-02-27T01:01:00,268   adding 'deepspeed/ops/transformer/transformer.py'
2024-02-27T01:01:00,270   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-02-27T01:01:00,271   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-02-27T01:01:00,272   adding 'deepspeed/ops/transformer/inference/config.py'
2024-02-27T01:01:00,274   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-02-27T01:01:00,275   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-02-27T01:01:00,277   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-02-27T01:01:00,279   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-02-27T01:01:00,281   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-02-27T01:01:00,283   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-02-27T01:01:00,285   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-02-27T01:01:00,287   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-02-27T01:01:00,288   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-02-27T01:01:00,290   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-02-27T01:01:00,291   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-02-27T01:01:00,293   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-02-27T01:01:00,294   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-02-27T01:01:00,296   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-02-27T01:01:00,297   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-02-27T01:01:00,298   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-02-27T01:01:00,300   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-02-27T01:01:00,301   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-02-27T01:01:00,304   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-02-27T01:01:00,305   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-02-27T01:01:00,307   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-02-27T01:01:00,308   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-02-27T01:01:00,310   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-02-27T01:01:00,311   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-02-27T01:01:00,312   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-02-27T01:01:00,313   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-02-27T01:01:00,315   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-02-27T01:01:00,317   adding 'deepspeed/pipe/__init__.py'
2024-02-27T01:01:00,318   adding 'deepspeed/profiling/__init__.py'
2024-02-27T01:01:00,319   adding 'deepspeed/profiling/config.py'
2024-02-27T01:01:00,321   adding 'deepspeed/profiling/constants.py'
2024-02-27T01:01:00,322   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-02-27T01:01:00,328   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-02-27T01:01:00,330   adding 'deepspeed/runtime/__init__.py'
2024-02-27T01:01:00,333   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-02-27T01:01:00,334   adding 'deepspeed/runtime/compiler.py'
2024-02-27T01:01:00,338   adding 'deepspeed/runtime/config.py'
2024-02-27T01:01:00,340   adding 'deepspeed/runtime/config_utils.py'
2024-02-27T01:01:00,342   adding 'deepspeed/runtime/constants.py'
2024-02-27T01:01:00,344   adding 'deepspeed/runtime/dataloader.py'
2024-02-27T01:01:00,345   adding 'deepspeed/runtime/eigenvalue.py'
2024-02-27T01:01:00,363   adding 'deepspeed/runtime/engine.py'
2024-02-27T01:01:00,367   adding 'deepspeed/runtime/hybrid_engine.py'
2024-02-27T01:01:00,370   adding 'deepspeed/runtime/lr_schedules.py'
2024-02-27T01:01:00,372   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-02-27T01:01:00,374   adding 'deepspeed/runtime/quantize.py'
2024-02-27T01:01:00,375   adding 'deepspeed/runtime/sparse_tensor.py'
2024-02-27T01:01:00,377   adding 'deepspeed/runtime/state_dict_factory.py'
2024-02-27T01:01:00,382   adding 'deepspeed/runtime/utils.py'
2024-02-27T01:01:00,383   adding 'deepspeed/runtime/weight_quantizer.py'
2024-02-27T01:01:00,385   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-02-27T01:01:00,390   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-02-27T01:01:00,392   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-02-27T01:01:00,394   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-02-27T01:01:00,395   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-02-27T01:01:00,396   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-02-27T01:01:00,398   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-02-27T01:01:00,399   adding 'deepspeed/runtime/comm/__init__.py'
2024-02-27T01:01:00,401   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-02-27T01:01:00,402   adding 'deepspeed/runtime/comm/hccl.py'
2024-02-27T01:01:00,404   adding 'deepspeed/runtime/comm/mpi.py'
2024-02-27T01:01:00,406   adding 'deepspeed/runtime/comm/nccl.py'
2024-02-27T01:01:00,407   adding 'deepspeed/runtime/compression/__init__.py'
2024-02-27T01:01:00,409   adding 'deepspeed/runtime/compression/cupy.py'
2024-02-27T01:01:00,410   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-02-27T01:01:00,412   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-02-27T01:01:00,413   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-02-27T01:01:00,415   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-02-27T01:01:00,417   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-02-27T01:01:00,418   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-02-27T01:01:00,419   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-02-27T01:01:00,421   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-02-27T01:01:00,422   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-02-27T01:01:00,423   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-02-27T01:01:00,428   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-02-27T01:01:00,430   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-02-27T01:01:00,433   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-02-27T01:01:00,434   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-02-27T01:01:00,436   adding 'deepspeed/runtime/fp16/__init__.py'
2024-02-27T01:01:00,439   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-02-27T01:01:00,441   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-02-27T01:01:00,443   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-02-27T01:01:00,445   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-02-27T01:01:00,447   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-02-27T01:01:00,450   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-02-27T01:01:00,453   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-02-27T01:01:00,455   adding 'deepspeed/runtime/pipe/__init__.py'
2024-02-27T01:01:00,461   adding 'deepspeed/runtime/pipe/engine.py'
2024-02-27T01:01:00,465   adding 'deepspeed/runtime/pipe/module.py'
2024-02-27T01:01:00,467   adding 'deepspeed/runtime/pipe/p2p.py'
2024-02-27T01:01:00,469   adding 'deepspeed/runtime/pipe/schedule.py'
2024-02-27T01:01:00,471   adding 'deepspeed/runtime/pipe/topology.py'
2024-02-27T01:01:00,473   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-02-27T01:01:00,475   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-02-27T01:01:00,476   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-02-27T01:01:00,477   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-02-27T01:01:00,480   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-02-27T01:01:00,482   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-02-27T01:01:00,484   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-02-27T01:01:00,486   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-02-27T01:01:00,488   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-02-27T01:01:00,490   adding 'deepspeed/runtime/zero/__init__.py'
2024-02-27T01:01:00,492   adding 'deepspeed/runtime/zero/config.py'
2024-02-27T01:01:00,493   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-02-27T01:01:00,495   adding 'deepspeed/runtime/zero/linear.py'
2024-02-27T01:01:00,498   adding 'deepspeed/runtime/zero/mics.py'
2024-02-27T01:01:00,500   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-02-27T01:01:00,501   adding 'deepspeed/runtime/zero/offload_config.py'
2024-02-27T01:01:00,504   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-02-27T01:01:00,515   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-02-27T01:01:00,519   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-02-27T01:01:00,520   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-02-27T01:01:00,535   adding 'deepspeed/runtime/zero/stage3.py'
2024-02-27T01:01:00,549   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-02-27T01:01:00,551   adding 'deepspeed/runtime/zero/test.py'
2024-02-27T01:01:00,553   adding 'deepspeed/runtime/zero/tiling.py'
2024-02-27T01:01:00,554   adding 'deepspeed/runtime/zero/utils.py'
2024-02-27T01:01:00,556   adding 'deepspeed/sequence/__init__.py'
2024-02-27T01:01:00,557   adding 'deepspeed/sequence/layer.py'
2024-02-27T01:01:00,559   adding 'deepspeed/utils/__init__.py'
2024-02-27T01:01:00,561   adding 'deepspeed/utils/comms_logging.py'
2024-02-27T01:01:00,563   adding 'deepspeed/utils/debug.py'
2024-02-27T01:01:00,564   adding 'deepspeed/utils/exceptions.py'
2024-02-27T01:01:00,566   adding 'deepspeed/utils/groups.py'
2024-02-27T01:01:00,568   adding 'deepspeed/utils/init_on_device.py'
2024-02-27T01:01:00,569   adding 'deepspeed/utils/logging.py'
2024-02-27T01:01:00,570   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-02-27T01:01:00,572   adding 'deepspeed/utils/numa.py'
2024-02-27T01:01:00,573   adding 'deepspeed/utils/nvtx.py'
2024-02-27T01:01:00,575   adding 'deepspeed/utils/tensor_fragment.py'
2024-02-27T01:01:00,576   adding 'deepspeed/utils/timer.py'
2024-02-27T01:01:00,577   adding 'deepspeed/utils/types.py'
2024-02-27T01:01:00,579   adding 'deepspeed/utils/z3_leaf_module.py'
2024-02-27T01:01:00,582   adding 'deepspeed/utils/zero_to_fp32.py'
2024-02-27T01:01:00,584   adding 'deepspeed-0.13.4.data/scripts/deepspeed'
2024-02-27T01:01:00,585   adding 'deepspeed-0.13.4.data/scripts/deepspeed.pt'
2024-02-27T01:01:00,586   adding 'deepspeed-0.13.4.data/scripts/ds'
2024-02-27T01:01:00,587   adding 'deepspeed-0.13.4.data/scripts/ds_bench'
2024-02-27T01:01:00,589   adding 'deepspeed-0.13.4.data/scripts/ds_elastic'
2024-02-27T01:01:00,590   adding 'deepspeed-0.13.4.data/scripts/ds_report'
2024-02-27T01:01:00,591   adding 'deepspeed-0.13.4.data/scripts/ds_ssh'
2024-02-27T01:01:00,592   adding 'deepspeed-0.13.4.data/scripts/dsr'
2024-02-27T01:01:00,597   adding 'deepspeed-0.13.4.dist-info/METADATA'
2024-02-27T01:01:00,598   adding 'deepspeed-0.13.4.dist-info/WHEEL'
2024-02-27T01:01:00,599   adding 'deepspeed-0.13.4.dist-info/entry_points.txt'
2024-02-27T01:01:00,600   adding 'deepspeed-0.13.4.dist-info/top_level.txt'
2024-02-27T01:01:00,613   adding 'deepspeed-0.13.4.dist-info/RECORD'
2024-02-27T01:01:00,637   removing build/bdist.linux-armv7l/wheel
2024-02-27T01:01:00,845   deepspeed build time = 9.619651317596436 secs
2024-02-27T01:01:00,966   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-02-27T01:01:00,982   Created wheel for deepspeed: filename=deepspeed-0.13.4-py3-none-any.whl size=1365792 sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7
2024-02-27T01:01:00,983   Stored in directory: /tmp/pip-ephem-wheel-cache-o1vyhtk_/wheels/86/8d/d7/5015c8850d5328ce0bad89c9996ed95f30aaa4f4d1910df22f
2024-02-27T01:01:01,022 Successfully built deepspeed
2024-02-27T01:01:01,069 Removed build tracker: '/tmp/pip-build-tracker-rlkrbsn8'