2024-02-12T18:11:19,177 Created temporary directory: /tmp/pip-build-tracker-38jckk0q
2024-02-12T18:11:19,178 Initialized build tracking at /tmp/pip-build-tracker-38jckk0q
2024-02-12T18:11:19,178 Created build tracker: /tmp/pip-build-tracker-38jckk0q
2024-02-12T18:11:19,179 Entered build tracker: /tmp/pip-build-tracker-38jckk0q
2024-02-12T18:11:19,180 Created temporary directory: /tmp/pip-wheel-nb7k90ct
2024-02-12T18:11:19,182 Created temporary directory: /tmp/pip-ephem-wheel-cache-oq0j4rd6
2024-02-12T18:11:19,204 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-02-12T18:11:19,208 2 location(s) to search for versions of deepspeed:
2024-02-12T18:11:19,208 * https://pypi.org/simple/deepspeed/
2024-02-12T18:11:19,208 * https://www.piwheels.org/simple/deepspeed/
2024-02-12T18:11:19,214 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-02-12T18:11:19,215 Getting page https://pypi.org/simple/deepspeed/
2024-02-12T18:11:19,216 Found index url https://pypi.org/simple/
2024-02-12T18:11:19,354 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-02-12T18:11:19,369   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-12T18:11:19,370   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-02-12T18:11:19,371   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-12T18:11:19,372   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-02-12T18:11:19,372   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-12T18:11:19,373   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-02-12T18:11:19,374   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-12T18:11:19,375   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-02-12T18:11:19,376   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-02-12T18:11:19,376   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-02-12T18:11:19,377   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-02-12T18:11:19,378   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-02-12T18:11:19,379   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-02-12T18:11:19,380   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-02-12T18:11:19,380   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-02-12T18:11:19,381   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-02-12T18:11:19,381   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-02-12T18:11:19,382   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-02-12T18:11:19,383   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-02-12T18:11:19,383   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-02-12T18:11:19,384   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-02-12T18:11:19,384   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-02-12T18:11:19,385   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-02-12T18:11:19,386   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-02-12T18:11:19,386   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-02-12T18:11:19,387   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-02-12T18:11:19,388   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-02-12T18:11:19,389   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-02-12T18:11:19,389   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-02-12T18:11:19,390   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-02-12T18:11:19,391   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-02-12T18:11:19,392   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-02-12T18:11:19,392   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-02-12T18:11:19,393   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-02-12T18:11:19,393   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-02-12T18:11:19,394   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-02-12T18:11:19,395   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-02-12T18:11:19,395   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-02-12T18:11:19,396   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-02-12T18:11:19,396   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-02-12T18:11:19,397   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-02-12T18:11:19,398   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-02-12T18:11:19,399   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-02-12T18:11:19,400   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-02-12T18:11:19,400   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-02-12T18:11:19,401   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-02-12T18:11:19,402   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-02-12T18:11:19,402   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-02-12T18:11:19,403   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-02-12T18:11:19,404   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-02-12T18:11:19,405   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-02-12T18:11:19,405   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-02-12T18:11:19,406   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-02-12T18:11:19,407   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-02-12T18:11:19,407   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-02-12T18:11:19,408   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-02-12T18:11:19,408   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-02-12T18:11:19,409   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-02-12T18:11:19,410   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-02-12T18:11:19,410   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-02-12T18:11:19,411   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-02-12T18:11:19,412   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-02-12T18:11:19,413   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-02-12T18:11:19,413   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-02-12T18:11:19,414   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-02-12T18:11:19,415   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-02-12T18:11:19,415   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-02-12T18:11:19,416   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-02-12T18:11:19,417   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-02-12T18:11:19,418   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-02-12T18:11:19,418   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-02-12T18:11:19,419   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-02-12T18:11:19,419   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-02-12T18:11:19,420   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-02-12T18:11:19,420   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-02-12T18:11:19,421   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-02-12T18:11:19,421   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-02-12T18:11:19,422   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-02-12T18:11:19,423   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-02-12T18:11:19,424   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-02-12T18:11:19,424   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-02-12T18:11:19,425   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-02-12T18:11:19,426   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-02-12T18:11:19,426   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-02-12T18:11:19,427   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-02-12T18:11:19,428   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-02-12T18:11:19,429   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-02-12T18:11:19,429   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-02-12T18:11:19,430 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-02-12T18:11:19,431 Getting page https://www.piwheels.org/simple/deepspeed/
2024-02-12T18:11:19,432 Found index url https://www.piwheels.org/simple/
2024-02-12T18:11:19,611 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-02-12T18:11:19,626   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,626   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,627   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,627   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,628   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,628   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,629   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,630   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,630   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,631   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,632   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,632   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,633   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,634   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,634   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,635   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,635   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,636   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,636   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,637   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,638   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,638   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,639   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,639   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,640   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,641   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,641   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,642   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,643   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,643   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,643   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,644   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,644   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,645   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,645   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,646   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,647   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,647   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,648   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,648   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,649   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,650   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,651   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,651   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,652   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,652   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,652   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,653   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,653   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,654   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,655   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,655   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,656   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,657   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,657   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,658   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,658   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-02-12T18:11:19,659 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-02-12T18:11:19,660 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-02-12T18:11:19,689 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-02-12T18:11:19,709 Collecting deepspeed==0.13.2
2024-02-12T18:11:19,711   Created temporary directory: /tmp/pip-unpack-7mblr7rf
2024-02-12T18:11:20,097   Downloading deepspeed-0.13.2.tar.gz (1.3 MB)
2024-02-12T18:11:22,259   Added deepspeed==0.13.2 from https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz to build tracker '/tmp/pip-build-tracker-38jckk0q'
2024-02-12T18:11:22,261   Running setup.py (path:/tmp/pip-wheel-nb7k90ct/deepspeed_7d1a52ecbdf948149fad112272693b50/setup.py) egg_info for package deepspeed
2024-02-12T18:11:22,262   Created temporary directory: /tmp/pip-pip-egg-info-uxjbltqr
2024-02-12T18:11:22,262   Preparing metadata (setup.py): started
2024-02-12T18:11:22,263   Running command python setup.py egg_info
2024-02-12T18:11:23,175   fatal: not a git repository (or any of the parent directories): .git
2024-02-12T18:11:23,920   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-02-12T18:11:23,921    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-02-12T18:11:23,921   DS_BUILD_OPS=0
2024-02-12T18:11:23,922    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-02-12T18:11:23,922    [WARNING]  async_io: please install the libaio-dev package with apt
2024-02-12T18:11:23,923    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-02-12T18:11:23,923    [WARNING]  Please install torch if trying to pre-compile kernels
2024-02-12T18:11:23,924    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:23,925    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:23,925    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:23,926    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:23,927    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:23,927    [WARNING]  unable to import torch, please install it first
2024-02-12T18:11:23,928    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:23,928   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-02-12T18:11:23,929   version=0.13.2, git_hash=unknown, git_branch=unknown
2024-02-12T18:11:23,929   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-02-12T18:11:23,930   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False}
2024-02-12T18:11:23,931   ext_modules=[]
2024-02-12T18:11:23,932   running egg_info
2024-02-12T18:11:23,932   creating /tmp/pip-pip-egg-info-uxjbltqr/deepspeed.egg-info
2024-02-12T18:11:23,960   writing /tmp/pip-pip-egg-info-uxjbltqr/deepspeed.egg-info/PKG-INFO
2024-02-12T18:11:23,992   writing dependency_links to /tmp/pip-pip-egg-info-uxjbltqr/deepspeed.egg-info/dependency_links.txt
2024-02-12T18:11:23,993   writing entry points to /tmp/pip-pip-egg-info-uxjbltqr/deepspeed.egg-info/entry_points.txt
2024-02-12T18:11:24,009   writing requirements to /tmp/pip-pip-egg-info-uxjbltqr/deepspeed.egg-info/requires.txt
2024-02-12T18:11:24,010   writing top-level names to /tmp/pip-pip-egg-info-uxjbltqr/deepspeed.egg-info/top_level.txt
2024-02-12T18:11:24,012   writing manifest file '/tmp/pip-pip-egg-info-uxjbltqr/deepspeed.egg-info/SOURCES.txt'
2024-02-12T18:11:24,258   reading manifest file '/tmp/pip-pip-egg-info-uxjbltqr/deepspeed.egg-info/SOURCES.txt'
2024-02-12T18:11:24,259   reading manifest template 'MANIFEST.in'
2024-02-12T18:11:24,261   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-02-12T18:11:24,262   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-02-12T18:11:25,369   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-02-12T18:11:26,152   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-02-12T18:11:26,657   warning: no files found matching '*.tr' under directory 'csrc'
2024-02-12T18:11:26,758   warning: no files found matching '*.cc' under directory 'csrc'
2024-02-12T18:11:26,791   warning: no files found matching '*.py' under directory 'benchmarks'
2024-02-12T18:11:26,826   writing manifest file '/tmp/pip-pip-egg-info-uxjbltqr/deepspeed.egg-info/SOURCES.txt'
2024-02-12T18:11:26,828   deepspeed build time = 3.649385452270508 secs
2024-02-12T18:11:26,942   Preparing metadata (setup.py): finished with status 'done'
2024-02-12T18:11:26,948   Source in /tmp/pip-wheel-nb7k90ct/deepspeed_7d1a52ecbdf948149fad112272693b50 has version 0.13.2, which satisfies requirement deepspeed==0.13.2 from https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz
2024-02-12T18:11:26,949   Removed deepspeed==0.13.2 from https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz from build tracker '/tmp/pip-build-tracker-38jckk0q'
2024-02-12T18:11:26,957 Created temporary directory: /tmp/pip-unpack-e43iorkg
2024-02-12T18:11:26,958 Created temporary directory: /tmp/pip-unpack-861m794p
2024-02-12T18:11:27,203 Building wheels for collected packages: deepspeed
2024-02-12T18:11:27,207   Created temporary directory: /tmp/pip-wheel-yjbdlhju
2024-02-12T18:11:27,208   Building wheel for deepspeed (setup.py): started
2024-02-12T18:11:27,209   Destination directory: /tmp/pip-wheel-yjbdlhju
2024-02-12T18:11:27,210   Running command python setup.py bdist_wheel
2024-02-12T18:11:27,642   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-02-12T18:11:27,652    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-02-12T18:11:27,728   DS_BUILD_OPS=0
2024-02-12T18:11:27,842    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-02-12T18:11:27,900    [WARNING]  async_io: please install the libaio-dev package with apt
2024-02-12T18:11:27,901    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-02-12T18:11:27,902    [WARNING]  Please install torch if trying to pre-compile kernels
2024-02-12T18:11:27,903    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:27,904    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:27,905    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:27,906    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:27,907    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:27,908    [WARNING]  unable to import torch, please install it first
2024-02-12T18:11:27,909    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-02-12T18:11:27,909   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-02-12T18:11:27,920   fatal: not a git repository (or any of the parent directories): .git
2024-02-12T18:11:27,921   version=0.13.2, git_hash=unknown, git_branch=unknown
2024-02-12T18:11:27,922   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2024-02-12T18:11:27,922   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'deepspeed_not_implemented': False}
2024-02-12T18:11:27,923   ext_modules=[]
2024-02-12T18:11:28,648   running bdist_wheel
2024-02-12T18:11:28,778   running build
2024-02-12T18:11:28,778   running build_py
2024-02-12T18:11:28,815   creating build
2024-02-12T18:11:28,815   creating build/lib
2024-02-12T18:11:28,816   creating build/lib/deepspeed
2024-02-12T18:11:28,817   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2024-02-12T18:11:28,819   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-02-12T18:11:28,821   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-02-12T18:11:28,823   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-02-12T18:11:28,825   copying deepspeed/constants.py -> build/lib/deepspeed
2024-02-12T18:11:28,827   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-02-12T18:11:28,830   creating build/lib/deepspeed/elasticity
2024-02-12T18:11:28,831   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-02-12T18:11:28,833   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-02-12T18:11:28,835   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-02-12T18:11:28,837   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-02-12T18:11:28,839   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-02-12T18:11:28,841   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-02-12T18:11:28,843   creating build/lib/deepspeed/moe
2024-02-12T18:11:28,844   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-02-12T18:11:28,846   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-02-12T18:11:28,848   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-02-12T18:11:28,849   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-02-12T18:11:28,851   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-02-12T18:11:28,853   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-02-12T18:11:28,856   creating build/lib/deepspeed/inference
2024-02-12T18:11:28,857   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-02-12T18:11:28,859   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-02-12T18:11:28,861   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-02-12T18:11:28,863   creating build/lib/deepspeed/autotuning
2024-02-12T18:11:28,864   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-02-12T18:11:28,866   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-02-12T18:11:28,868   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-02-12T18:11:28,870   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-02-12T18:11:28,872   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-02-12T18:11:28,874   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-02-12T18:11:28,877   creating build/lib/deepspeed/pipe
2024-02-12T18:11:28,878   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-02-12T18:11:28,880   creating build/lib/deepspeed/monitor
2024-02-12T18:11:28,881   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-02-12T18:11:28,883   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-02-12T18:11:28,884   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-02-12T18:11:28,886   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-02-12T18:11:28,888   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-02-12T18:11:28,889   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-02-12T18:11:28,891   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-02-12T18:11:28,893   creating build/lib/deepspeed/comm
2024-02-12T18:11:28,894   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-02-12T18:11:28,895   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-02-12T18:11:28,897   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-02-12T18:11:28,899   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-02-12T18:11:28,901   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-02-12T18:11:28,903   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-02-12T18:11:28,905   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-02-12T18:11:28,906   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-02-12T18:11:28,909   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-02-12T18:11:28,911   creating build/lib/deepspeed/ops
2024-02-12T18:11:28,912   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-02-12T18:11:28,914   creating build/lib/deepspeed/model_implementations
2024-02-12T18:11:28,915   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-02-12T18:11:28,918   creating build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,919   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,921   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,924   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,926   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,928   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,930   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,932   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,934   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,935   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,937   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-02-12T18:11:28,939   creating build/lib/deepspeed/profiling
2024-02-12T18:11:28,940   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-02-12T18:11:28,942   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-02-12T18:11:28,944   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-02-12T18:11:28,946   creating build/lib/deepspeed/compression
2024-02-12T18:11:28,947   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-02-12T18:11:28,950   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-02-12T18:11:28,952   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-02-12T18:11:28,954   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-02-12T18:11:28,956   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-02-12T18:11:28,959   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-02-12T18:11:28,961   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-02-12T18:11:28,963   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-02-12T18:11:28,966   creating build/lib/deepspeed/module_inject
2024-02-12T18:11:28,967   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,969   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,971   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,973   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,976   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,978   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,980   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,982   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,983   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,985   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,988   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,989   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,991   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-02-12T18:11:28,994   creating build/lib/deepspeed/nebula
2024-02-12T18:11:28,995   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-02-12T18:11:28,997   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-02-12T18:11:28,999   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-02-12T18:11:29,002   creating build/lib/deepspeed/utils
2024-02-12T18:11:29,003   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,005   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,007   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,009   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,011   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,013   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,015   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,017   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,018   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,021   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,022   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,024   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,026   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,028   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,030   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-02-12T18:11:29,032   creating build/lib/deepspeed/launcher
2024-02-12T18:11:29,033   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-02-12T18:11:29,035   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-02-12T18:11:29,037   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-02-12T18:11:29,039   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-02-12T18:11:29,041   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-02-12T18:11:29,042   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-02-12T18:11:29,045   creating build/lib/deepspeed/accelerator
2024-02-12T18:11:29,046   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-12T18:11:29,049   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-12T18:11:29,051   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-12T18:11:29,054   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-12T18:11:29,056   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-12T18:11:29,059   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-02-12T18:11:29,060   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-12T18:11:29,063   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-12T18:11:29,065   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-02-12T18:11:29,069   creating build/lib/deepspeed/runtime
2024-02-12T18:11:29,070   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,073   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,076   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,078   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,080   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,083   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,085   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,092   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,095   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,098   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,100   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,104   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,107   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,109   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,111   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,114   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,118   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-02-12T18:11:29,121   creating build/lib/deepspeed/sequence
2024-02-12T18:11:29,122   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-02-12T18:11:29,124   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-02-12T18:11:29,127   creating build/lib/deepspeed/inference/v2
2024-02-12T18:11:29,128   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-02-12T18:11:29,130   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-02-12T18:11:29,132   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-02-12T18:11:29,134   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-02-12T18:11:29,136   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-02-12T18:11:29,139   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-02-12T18:11:29,141   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-02-12T18:11:29,143   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-02-12T18:11:29,145   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-02-12T18:11:29,148   creating build/lib/deepspeed/inference/quantization
2024-02-12T18:11:29,149   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-02-12T18:11:29,152   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-02-12T18:11:29,154   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-02-12T18:11:29,156   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-02-12T18:11:29,158   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-02-12T18:11:29,162   creating build/lib/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:29,163   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:29,166   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:29,169   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:29,172   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:29,174   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:29,177   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:29,179   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:29,183   creating build/lib/deepspeed/inference/v2/checkpoint
2024-02-12T18:11:29,184   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-12T18:11:29,186   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-12T18:11:29,189   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-12T18:11:29,191   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-02-12T18:11:29,194   creating build/lib/deepspeed/inference/v2/kernels
2024-02-12T18:11:29,195   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-02-12T18:11:29,197   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-02-12T18:11:29,200   creating build/lib/deepspeed/inference/v2/ragged
2024-02-12T18:11:29,201   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-12T18:11:29,204   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-12T18:11:29,206   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-12T18:11:29,208   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-12T18:11:29,210   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-12T18:11:29,212   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-12T18:11:29,214   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-02-12T18:11:29,216   creating build/lib/deepspeed/inference/v2/modules
2024-02-12T18:11:29,217   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-02-12T18:11:29,219   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-02-12T18:11:29,221   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-02-12T18:11:29,223   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-02-12T18:11:29,225   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-12T18:11:29,226   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-12T18:11:29,228   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-12T18:11:29,230   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-12T18:11:29,232   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-02-12T18:11:29,234   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-12T18:11:29,235   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-12T18:11:29,237   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-12T18:11:29,240   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-12T18:11:29,241   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-02-12T18:11:29,244   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-12T18:11:29,245   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-12T18:11:29,247   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-12T18:11:29,249   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-12T18:11:29,251   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-02-12T18:11:29,253   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:29,255   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:29,258   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:29,260   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:29,262   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:29,264   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:29,266   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:29,267   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:29,269   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:29,271   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:29,274   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-12T18:11:29,275   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-12T18:11:29,277   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-12T18:11:29,279   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-12T18:11:29,281   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-02-12T18:11:29,283   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:29,284   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:29,287   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:29,288   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:29,290   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:29,292   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:29,294   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:29,296   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:29,298   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:29,299   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:29,302   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-12T18:11:29,303   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-12T18:11:29,305   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-12T18:11:29,307   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-12T18:11:29,308   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-02-12T18:11:29,310   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-12T18:11:29,311   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-12T18:11:29,313   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-12T18:11:29,315   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-12T18:11:29,317   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-12T18:11:29,319   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-12T18:11:29,320   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-12T18:11:29,322   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-12T18:11:29,324   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-12T18:11:29,326   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-02-12T18:11:29,328   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-02-12T18:11:29,329   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-02-12T18:11:29,331   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-02-12T18:11:29,332   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-02-12T18:11:29,335   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-12T18:11:29,336   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-12T18:11:29,338   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:29,339   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:29,341   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:29,343   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:29,345   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:29,347   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-12T18:11:29,348   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-12T18:11:29,350   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-12T18:11:29,352   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:29,354   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:29,355   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:29,357   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:29,359   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:29,360   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:29,363   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:29,364   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:29,366   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:29,368   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:29,369   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:29,370   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:29,373   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:29,374   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:29,376   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:29,378   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:29,379   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:29,381   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:29,383   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:29,384   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:29,386   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:29,389   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:29,390   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:29,392   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:29,393   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:29,395   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:29,398   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:29,399   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:29,401   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:29,403   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:29,404   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:29,406   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:29,408   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-12T18:11:29,409   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-12T18:11:29,410   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-12T18:11:29,413   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:29,414   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:29,415   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:29,418   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:29,419   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:29,421   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:29,422   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:29,425   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:29,426   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:29,428   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:29,431   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:29,432   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:29,434   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:29,435   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:29,437   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:29,439   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:29,441   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:29,443   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:29,445   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:29,447   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-02-12T18:11:29,448   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-02-12T18:11:29,450   creating build/lib/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:29,451   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:29,453   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:29,455   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:29,457   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:29,458   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:29,460   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:29,462   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:29,464   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-02-12T18:11:29,465   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-02-12T18:11:29,467   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-02-12T18:11:29,470   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-02-12T18:11:29,471   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-02-12T18:11:29,473   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-02-12T18:11:29,476   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-02-12T18:11:29,476   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-02-12T18:11:29,478   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-02-12T18:11:29,481   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-12T18:11:29,482   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-12T18:11:29,484   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-12T18:11:29,487   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-12T18:11:29,488   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-12T18:11:29,490   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-12T18:11:29,492   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-12T18:11:29,495   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-02-12T18:11:29,496   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-02-12T18:11:29,499   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-02-12T18:11:29,501   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-02-12T18:11:29,503   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-02-12T18:11:29,505   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-02-12T18:11:29,508   creating build/lib/deepspeed/autotuning/tuner
2024-02-12T18:11:29,510   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-02-12T18:11:29,512   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-02-12T18:11:29,514   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-02-12T18:11:29,517   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-02-12T18:11:29,519   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-02-12T18:11:29,521   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-02-12T18:11:29,523   creating build/lib/deepspeed/ops/lion
2024-02-12T18:11:29,524   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-02-12T18:11:29,527   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-02-12T18:11:29,529   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-02-12T18:11:29,531   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-02-12T18:11:29,534   creating build/lib/deepspeed/ops/sparse_attention
2024-02-12T18:11:29,535   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-12T18:11:29,538   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-12T18:11:29,540   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-12T18:11:29,543   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-12T18:11:29,545   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-12T18:11:29,548   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-12T18:11:29,550   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-02-12T18:11:29,554   creating build/lib/deepspeed/ops/aio
2024-02-12T18:11:29,556   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-02-12T18:11:29,559   creating build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,560   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,563   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,566   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,568   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,570   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,572   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,575   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,577   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,579   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,581   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,584   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,586   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,588   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,590   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,592   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,594   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,596   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,599   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,601   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,603   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,605   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,607   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-02-12T18:11:29,609   creating build/lib/deepspeed/ops/deepspeed4science
2024-02-12T18:11:29,611   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-02-12T18:11:29,613   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-02-12T18:11:29,615   creating build/lib/deepspeed/ops/quantizer
2024-02-12T18:11:29,617   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-02-12T18:11:29,619   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-02-12T18:11:29,621   creating build/lib/deepspeed/ops/adagrad
2024-02-12T18:11:29,623   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-02-12T18:11:29,625   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-02-12T18:11:29,628   creating build/lib/deepspeed/ops/adam
2024-02-12T18:11:29,629   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-02-12T18:11:29,632   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-02-12T18:11:29,634   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-02-12T18:11:29,637   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-02-12T18:11:29,640   creating build/lib/deepspeed/ops/random_ltd
2024-02-12T18:11:29,641   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-02-12T18:11:29,644   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-02-12T18:11:29,646   creating build/lib/deepspeed/ops/transformer
2024-02-12T18:11:29,648   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-02-12T18:11:29,651   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-02-12T18:11:29,653   creating build/lib/deepspeed/ops/lamb
2024-02-12T18:11:29,655   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-02-12T18:11:29,657   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-02-12T18:11:29,660   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-12T18:11:29,661   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-12T18:11:29,664   creating build/lib/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:29,666   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:29,668   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:29,670   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:29,672   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:29,674   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:29,677   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:29,679   creating build/lib/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:29,680   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:29,683   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:29,685   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:29,687   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:29,689   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:29,693   creating build/lib/deepspeed/ops/op_builder/npu
2024-02-12T18:11:29,694   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-12T18:11:29,697   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-12T18:11:29,700   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-12T18:11:29,702   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-12T18:11:29,705   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-12T18:11:29,707   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-12T18:11:29,711   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-12T18:11:29,713   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-12T18:11:29,716   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-02-12T18:11:29,719   creating build/lib/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:29,721   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:29,724   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:29,727   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:29,730   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:29,732   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:29,735   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:29,738   creating build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,740   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,743   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,746   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,749   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,753   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,756   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,758   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,761   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,764   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,767   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-02-12T18:11:29,771   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,773   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,775   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,778   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,781   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,784   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,788   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,790   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,792   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,794   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,796   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:29,800   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,801   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,803   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,805   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,807   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,809   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,811   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,813   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,816   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,818   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,820   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:29,823   creating build/lib/deepspeed/model_implementations/diffusers
2024-02-12T18:11:29,824   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-02-12T18:11:29,826   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-02-12T18:11:29,829   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-02-12T18:11:29,832   creating build/lib/deepspeed/model_implementations/features
2024-02-12T18:11:29,833   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-02-12T18:11:29,835   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-02-12T18:11:29,838   creating build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,839   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,841   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,843   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,845   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,847   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,850   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,851   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,853   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,855   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,857   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-02-12T18:11:29,860   creating build/lib/deepspeed/profiling/flops_profiler
2024-02-12T18:11:29,861   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-02-12T18:11:29,864   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-02-12T18:11:29,867   creating build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,868   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,871   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,873   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,875   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,878   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,880   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,882   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,885   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,887   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,890   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,893   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,895   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,897   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,900   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,902   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,905   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,907   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,909   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,912   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-02-12T18:11:29,914   creating build/lib/deepspeed/module_inject/containers/features
2024-02-12T18:11:29,916   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-12T18:11:29,918   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-12T18:11:29,920   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-12T18:11:29,923   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-12T18:11:29,925   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-12T18:11:29,927   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-12T18:11:29,930   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-02-12T18:11:29,933   creating build/lib/deepspeed/runtime/fp16
2024-02-12T18:11:29,934   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-02-12T18:11:29,937   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-02-12T18:11:29,940   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-02-12T18:11:29,943   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-02-12T18:11:29,945   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-02-12T18:11:29,947   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-02-12T18:11:29,949   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-02-12T18:11:29,953   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-02-12T18:11:29,955   creating build/lib/deepspeed/runtime/swap_tensor
2024-02-12T18:11:29,957   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-12T18:11:29,960   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-12T18:11:29,963   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-12T18:11:29,965   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-12T18:11:29,968   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-12T18:11:29,971   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-12T18:11:29,973   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-12T18:11:29,975   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-12T18:11:29,978   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-02-12T18:11:29,981   creating build/lib/deepspeed/runtime/pipe
2024-02-12T18:11:29,982   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-02-12T18:11:29,985   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-02-12T18:11:29,989   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-02-12T18:11:29,991   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-02-12T18:11:29,994   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-02-12T18:11:29,996   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-02-12T18:11:29,999   creating build/lib/deepspeed/runtime/comm
2024-02-12T18:11:30,001   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-02-12T18:11:30,003   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-02-12T18:11:30,006   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-02-12T18:11:30,008   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-02-12T18:11:30,010   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-02-12T18:11:30,013   creating build/lib/deepspeed/runtime/data_pipeline
2024-02-12T18:11:30,015   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-12T18:11:30,018   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-12T18:11:30,020   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-12T18:11:30,022   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-02-12T18:11:30,025   creating build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,027   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,030   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,033   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,035   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,038   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,041   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,043   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,046   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,051   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,053   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,055   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,061   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,065   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,068   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,070   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,073   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-02-12T18:11:30,076   creating build/lib/deepspeed/runtime/compression
2024-02-12T18:11:30,077   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-02-12T18:11:30,079   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-02-12T18:11:30,082   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-02-12T18:11:30,083   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-12T18:11:30,085   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-12T18:11:30,089   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-12T18:11:30,091   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-02-12T18:11:30,094   creating build/lib/deepspeed/runtime/fp16/onebit
2024-02-12T18:11:30,095   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-12T18:11:30,098   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-12T18:11:30,101   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-12T18:11:30,104   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-02-12T18:11:30,106   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:30,107   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:30,110   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:30,112   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:30,114   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:30,116   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:30,120   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:30,121   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:30,124   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:30,127   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:30,129   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:30,131   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:30,135   running egg_info
2024-02-12T18:11:30,203   writing deepspeed.egg-info/PKG-INFO
2024-02-12T18:11:30,234   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-02-12T18:11:30,236   writing entry points to deepspeed.egg-info/entry_points.txt
2024-02-12T18:11:30,252   writing requirements to deepspeed.egg-info/requires.txt
2024-02-12T18:11:30,254   writing top-level names to deepspeed.egg-info/top_level.txt
2024-02-12T18:11:30,374   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-02-12T18:11:30,418   reading manifest template 'MANIFEST.in'
2024-02-12T18:11:30,420   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-02-12T18:11:30,420   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-02-12T18:11:31,509   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-02-12T18:11:32,305   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-02-12T18:11:32,786   warning: no files found matching '*.tr' under directory 'csrc'
2024-02-12T18:11:32,886   warning: no files found matching '*.cc' under directory 'csrc'
2024-02-12T18:11:32,918   warning: no files found matching '*.py' under directory 'benchmarks'
2024-02-12T18:11:32,965   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-02-12T18:11:32,972   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-02-12T18:11:32,973   !!

2024-02-12T18:11:32,974           ********************************************************************************
2024-02-12T18:11:32,975           ############################
2024-02-12T18:11:32,975           # Package would be ignored #
2024-02-12T18:11:32,976           ############################
2024-02-12T18:11:32,976           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-02-12T18:11:32,977           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:32,977           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:32,978           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-02-12T18:11:32,978           to the `packages` configuration field.

2024-02-12T18:11:32,979           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:32,979           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:32,980           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:32,981           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:32,982           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:32,982           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-02-12T18:11:32,983           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-02-12T18:11:32,983           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:32,984           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:32,985           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:32,987           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:32,988           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:32,990           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:32,990                 even if it does not contain any `.py` files.
2024-02-12T18:11:32,991                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:32,992                 directory, all directories are treated like packages.
2024-02-12T18:11:32,992           ********************************************************************************

2024-02-12T18:11:32,993   !!
2024-02-12T18:11:32,994     check.warn(importable)
2024-02-12T18:11:32,994   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-02-12T18:11:32,995   !!

2024-02-12T18:11:32,996           ********************************************************************************
2024-02-12T18:11:32,997           ############################
2024-02-12T18:11:32,997           # Package would be ignored #
2024-02-12T18:11:32,998           ############################
2024-02-12T18:11:32,998           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-02-12T18:11:32,999           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,000           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,000           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-02-12T18:11:33,001           to the `packages` configuration field.

2024-02-12T18:11:33,002           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,002           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,003           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,004           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,005           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,006           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-02-12T18:11:33,006           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-02-12T18:11:33,006           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,007           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,007           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,008           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,008           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,009           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,010                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,010                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,011                 directory, all directories are treated like packages.
2024-02-12T18:11:33,011           ********************************************************************************

2024-02-12T18:11:33,012   !!
2024-02-12T18:11:33,012     check.warn(importable)
2024-02-12T18:11:33,013   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-02-12T18:11:33,013   !!

2024-02-12T18:11:33,014           ********************************************************************************
2024-02-12T18:11:33,015           ############################
2024-02-12T18:11:33,015           # Package would be ignored #
2024-02-12T18:11:33,016           ############################
2024-02-12T18:11:33,017           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-02-12T18:11:33,017           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,018           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,019           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-02-12T18:11:33,019           to the `packages` configuration field.

2024-02-12T18:11:33,020           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,021           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,021           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,022           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,023           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,024           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-02-12T18:11:33,024           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-02-12T18:11:33,025           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,025           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,026           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,027           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,028           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,030           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,030                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,030                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,031                 directory, all directories are treated like packages.
2024-02-12T18:11:33,031           ********************************************************************************

2024-02-12T18:11:33,032   !!
2024-02-12T18:11:33,032     check.warn(importable)
2024-02-12T18:11:33,032   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-02-12T18:11:33,033   !!

2024-02-12T18:11:33,033           ********************************************************************************
2024-02-12T18:11:33,034           ############################
2024-02-12T18:11:33,034           # Package would be ignored #
2024-02-12T18:11:33,034           ############################
2024-02-12T18:11:33,035           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-02-12T18:11:33,035           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,036           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,036           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-02-12T18:11:33,037           to the `packages` configuration field.

2024-02-12T18:11:33,038           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,038           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,039           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,040           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,041           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,042           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-02-12T18:11:33,043           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-02-12T18:11:33,043           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,044           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,044           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,045           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,046           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,048           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,048                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,048                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,049                 directory, all directories are treated like packages.
2024-02-12T18:11:33,049           ********************************************************************************

2024-02-12T18:11:33,050   !!
2024-02-12T18:11:33,051     check.warn(importable)
2024-02-12T18:11:33,051   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-02-12T18:11:33,052   !!

2024-02-12T18:11:33,053           ********************************************************************************
2024-02-12T18:11:33,053           ############################
2024-02-12T18:11:33,054           # Package would be ignored #
2024-02-12T18:11:33,055           ############################
2024-02-12T18:11:33,055           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-02-12T18:11:33,055           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,056           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,056           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-02-12T18:11:33,057           to the `packages` configuration field.

2024-02-12T18:11:33,057           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,058           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,058           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,059           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,059           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,060           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-02-12T18:11:33,060           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-02-12T18:11:33,061           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,061           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,061           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,063           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,064           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,066           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,066                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,067                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,068                 directory, all directories are treated like packages.
2024-02-12T18:11:33,068           ********************************************************************************

2024-02-12T18:11:33,069   !!
2024-02-12T18:11:33,070     check.warn(importable)
2024-02-12T18:11:33,070   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-02-12T18:11:33,071   !!

2024-02-12T18:11:33,072           ********************************************************************************
2024-02-12T18:11:33,072           ############################
2024-02-12T18:11:33,073           # Package would be ignored #
2024-02-12T18:11:33,073           ############################
2024-02-12T18:11:33,074           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-02-12T18:11:33,074           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,075           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,076           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-02-12T18:11:33,076           to the `packages` configuration field.

2024-02-12T18:11:33,077           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,078           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,078           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,079           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,080           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,081           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-02-12T18:11:33,082           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-02-12T18:11:33,082           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,082           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,083           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,084           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,085           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,086           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,086                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,086                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,087                 directory, all directories are treated like packages.
2024-02-12T18:11:33,087           ********************************************************************************

2024-02-12T18:11:33,088   !!
2024-02-12T18:11:33,088     check.warn(importable)
2024-02-12T18:11:33,089   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-02-12T18:11:33,089   !!

2024-02-12T18:11:33,090           ********************************************************************************
2024-02-12T18:11:33,090           ############################
2024-02-12T18:11:33,091           # Package would be ignored #
2024-02-12T18:11:33,091           ############################
2024-02-12T18:11:33,092           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-02-12T18:11:33,092           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,093           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,094           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-02-12T18:11:33,094           to the `packages` configuration field.

2024-02-12T18:11:33,095           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,096           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,096           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,097           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,098           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,099           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-02-12T18:11:33,100           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-02-12T18:11:33,100           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,101           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,101           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,102           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,103           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,105           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,105                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,106                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,106                 directory, all directories are treated like packages.
2024-02-12T18:11:33,107           ********************************************************************************

2024-02-12T18:11:33,108   !!
2024-02-12T18:11:33,108     check.warn(importable)
2024-02-12T18:11:33,109   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-02-12T18:11:33,109   !!

2024-02-12T18:11:33,110           ********************************************************************************
2024-02-12T18:11:33,110           ############################
2024-02-12T18:11:33,110           # Package would be ignored #
2024-02-12T18:11:33,111           ############################
2024-02-12T18:11:33,111           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-02-12T18:11:33,111           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,112           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,112           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-02-12T18:11:33,113           to the `packages` configuration field.

2024-02-12T18:11:33,113           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,114           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,114           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,115           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,116           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,117           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-02-12T18:11:33,117           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-02-12T18:11:33,118           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,118           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,119           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,120           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,121           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,122           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,123                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,124                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,124                 directory, all directories are treated like packages.
2024-02-12T18:11:33,125           ********************************************************************************

2024-02-12T18:11:33,126   !!
2024-02-12T18:11:33,126     check.warn(importable)
2024-02-12T18:11:33,126   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-02-12T18:11:33,127   !!

2024-02-12T18:11:33,128           ********************************************************************************
2024-02-12T18:11:33,128           ############################
2024-02-12T18:11:33,129           # Package would be ignored #
2024-02-12T18:11:33,129           ############################
2024-02-12T18:11:33,130           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-02-12T18:11:33,130           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,131           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,132           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-02-12T18:11:33,132           to the `packages` configuration field.

2024-02-12T18:11:33,133           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,134           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,134           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,135           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,135           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,136           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-02-12T18:11:33,138           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-02-12T18:11:33,138           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,139           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,139           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,140           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,141           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,142           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,142                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,142                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,143                 directory, all directories are treated like packages.
2024-02-12T18:11:33,143           ********************************************************************************

2024-02-12T18:11:33,144   !!
2024-02-12T18:11:33,144     check.warn(importable)
2024-02-12T18:11:33,145   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-02-12T18:11:33,145   !!

2024-02-12T18:11:33,146           ********************************************************************************
2024-02-12T18:11:33,147           ############################
2024-02-12T18:11:33,148           # Package would be ignored #
2024-02-12T18:11:33,148           ############################
2024-02-12T18:11:33,149           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-02-12T18:11:33,149           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,150           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,151           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-02-12T18:11:33,151           to the `packages` configuration field.

2024-02-12T18:11:33,152           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,153           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,153           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,154           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,155           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,156           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-02-12T18:11:33,156           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-02-12T18:11:33,157           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,157           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,158           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,159           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,160           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,161           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,162                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,162                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,162                 directory, all directories are treated like packages.
2024-02-12T18:11:33,163           ********************************************************************************

2024-02-12T18:11:33,163   !!
2024-02-12T18:11:33,164     check.warn(importable)
2024-02-12T18:11:33,164   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-02-12T18:11:33,165   !!

2024-02-12T18:11:33,165           ********************************************************************************
2024-02-12T18:11:33,165           ############################
2024-02-12T18:11:33,166           # Package would be ignored #
2024-02-12T18:11:33,166           ############################
2024-02-12T18:11:33,166           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-02-12T18:11:33,167           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,168           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,168           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-02-12T18:11:33,168           to the `packages` configuration field.

2024-02-12T18:11:33,169           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,170           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,170           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,171           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,172           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,173           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-02-12T18:11:33,174           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-02-12T18:11:33,174           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,175           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,176           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,177           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,178           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,179           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,180                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,180                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,180                 directory, all directories are treated like packages.
2024-02-12T18:11:33,181           ********************************************************************************

2024-02-12T18:11:33,182   !!
2024-02-12T18:11:33,182     check.warn(importable)
2024-02-12T18:11:33,183   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-02-12T18:11:33,183   !!

2024-02-12T18:11:33,184           ********************************************************************************
2024-02-12T18:11:33,185           ############################
2024-02-12T18:11:33,185           # Package would be ignored #
2024-02-12T18:11:33,186           ############################
2024-02-12T18:11:33,186           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-02-12T18:11:33,187           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,188           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,188           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-02-12T18:11:33,188           to the `packages` configuration field.

2024-02-12T18:11:33,189           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,189           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,190           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,190           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,191           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,192           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-02-12T18:11:33,192           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-02-12T18:11:33,192           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,193           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,193           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,194           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,194           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,196           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,197                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,197                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,198                 directory, all directories are treated like packages.
2024-02-12T18:11:33,198           ********************************************************************************

2024-02-12T18:11:33,199   !!
2024-02-12T18:11:33,200     check.warn(importable)
2024-02-12T18:11:33,200   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration.
2024-02-12T18:11:33,201   !!

2024-02-12T18:11:33,202           ********************************************************************************
2024-02-12T18:11:33,202           ############################
2024-02-12T18:11:33,203           # Package would be ignored #
2024-02-12T18:11:33,203           ############################
2024-02-12T18:11:33,204           Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1],
2024-02-12T18:11:33,205           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,205           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,206           package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added
2024-02-12T18:11:33,206           to the `packages` configuration field.

2024-02-12T18:11:33,207           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,208           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,208           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,209           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,213           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,214           If you don't want 'deepspeed.ops.csrc.common' to be distributed and are
2024-02-12T18:11:33,214           already explicitly excluding 'deepspeed.ops.csrc.common' via
2024-02-12T18:11:33,215           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,216           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,216           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,217           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,218           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,219           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,219                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,220                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,220                 directory, all directories are treated like packages.
2024-02-12T18:11:33,220           ********************************************************************************

2024-02-12T18:11:33,221   !!
2024-02-12T18:11:33,221     check.warn(importable)
2024-02-12T18:11:33,222   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-02-12T18:11:33,222   !!

2024-02-12T18:11:33,223           ********************************************************************************
2024-02-12T18:11:33,223           ############################
2024-02-12T18:11:33,223           # Package would be ignored #
2024-02-12T18:11:33,224           ############################
2024-02-12T18:11:33,224           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-02-12T18:11:33,225           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,225           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,226           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-02-12T18:11:33,227           to the `packages` configuration field.

2024-02-12T18:11:33,228           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,228           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,229           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,230           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,231           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,232           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-02-12T18:11:33,232           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-02-12T18:11:33,233           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,234           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,234           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,235           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,236           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,237           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,238                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,238                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,239                 directory, all directories are treated like packages.
2024-02-12T18:11:33,239           ********************************************************************************

2024-02-12T18:11:33,240   !!
2024-02-12T18:11:33,241     check.warn(importable)
2024-02-12T18:11:33,241   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-02-12T18:11:33,242   !!

2024-02-12T18:11:33,243           ********************************************************************************
2024-02-12T18:11:33,244           ############################
2024-02-12T18:11:33,244           # Package would be ignored #
2024-02-12T18:11:33,244           ############################
2024-02-12T18:11:33,245           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-02-12T18:11:33,245           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,246           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,246           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-02-12T18:11:33,246           to the `packages` configuration field.

2024-02-12T18:11:33,247           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,247           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,247           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,248           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,249           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,249           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-02-12T18:11:33,250           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-02-12T18:11:33,250           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,251           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,251           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,252           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,253           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,255           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,255                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,256                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,256                 directory, all directories are treated like packages.
2024-02-12T18:11:33,257           ********************************************************************************

2024-02-12T18:11:33,258   !!
2024-02-12T18:11:33,258     check.warn(importable)
2024-02-12T18:11:33,259   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-02-12T18:11:33,260   !!

2024-02-12T18:11:33,260           ********************************************************************************
2024-02-12T18:11:33,261           ############################
2024-02-12T18:11:33,261           # Package would be ignored #
2024-02-12T18:11:33,262           ############################
2024-02-12T18:11:33,262           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-02-12T18:11:33,263           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,264           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,264           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-02-12T18:11:33,265           to the `packages` configuration field.

2024-02-12T18:11:33,266           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,266           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,267           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,268           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,269           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,270           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-02-12T18:11:33,270           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-02-12T18:11:33,270           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,271           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,271           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,272           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,272           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,273           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,274                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,274                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,274                 directory, all directories are treated like packages.
2024-02-12T18:11:33,275           ********************************************************************************

2024-02-12T18:11:33,276   !!
2024-02-12T18:11:33,276     check.warn(importable)
2024-02-12T18:11:33,276   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-02-12T18:11:33,277   !!

2024-02-12T18:11:33,278           ********************************************************************************
2024-02-12T18:11:33,278           ############################
2024-02-12T18:11:33,279           # Package would be ignored #
2024-02-12T18:11:33,279           ############################
2024-02-12T18:11:33,280           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-02-12T18:11:33,280           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,281           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,282           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-02-12T18:11:33,282           to the `packages` configuration field.

2024-02-12T18:11:33,283           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,284           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,285           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,286           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,287           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,288           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-02-12T18:11:33,288           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-02-12T18:11:33,289           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,289           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,289           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,291           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,292           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,293           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,294                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,294                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,295                 directory, all directories are treated like packages.
2024-02-12T18:11:33,296           ********************************************************************************

2024-02-12T18:11:33,297   !!
2024-02-12T18:11:33,297     check.warn(importable)
2024-02-12T18:11:33,297   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-02-12T18:11:33,298   !!

2024-02-12T18:11:33,298           ********************************************************************************
2024-02-12T18:11:33,299           ############################
2024-02-12T18:11:33,299           # Package would be ignored #
2024-02-12T18:11:33,300           ############################
2024-02-12T18:11:33,300           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-02-12T18:11:33,300           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,301           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,301           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-02-12T18:11:33,302           to the `packages` configuration field.

2024-02-12T18:11:33,303           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,303           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,304           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,305           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,306           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,307           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-02-12T18:11:33,307           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-02-12T18:11:33,308           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,308           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,309           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,310           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,311           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,312           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,313                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,313                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,314                 directory, all directories are treated like packages.
2024-02-12T18:11:33,314           ********************************************************************************

2024-02-12T18:11:33,315   !!
2024-02-12T18:11:33,316     check.warn(importable)
2024-02-12T18:11:33,316   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-02-12T18:11:33,317   !!

2024-02-12T18:11:33,318           ********************************************************************************
2024-02-12T18:11:33,318           ############################
2024-02-12T18:11:33,319           # Package would be ignored #
2024-02-12T18:11:33,319           ############################
2024-02-12T18:11:33,320           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-02-12T18:11:33,320           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,322           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,322           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-02-12T18:11:33,322           to the `packages` configuration field.

2024-02-12T18:11:33,323           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,323           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,324           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,324           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,325           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,326           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-02-12T18:11:33,326           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-02-12T18:11:33,326           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,327           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,327           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,328           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,329           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,330           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,331                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,331                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,332                 directory, all directories are treated like packages.
2024-02-12T18:11:33,332           ********************************************************************************

2024-02-12T18:11:33,333   !!
2024-02-12T18:11:33,334     check.warn(importable)
2024-02-12T18:11:33,335   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-02-12T18:11:33,335   !!

2024-02-12T18:11:33,336           ********************************************************************************
2024-02-12T18:11:33,337           ############################
2024-02-12T18:11:33,337           # Package would be ignored #
2024-02-12T18:11:33,338           ############################
2024-02-12T18:11:33,338           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-02-12T18:11:33,339           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,340           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,340           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-02-12T18:11:33,341           to the `packages` configuration field.

2024-02-12T18:11:33,342           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,342           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,343           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,344           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,345           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,346           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-02-12T18:11:33,346           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-02-12T18:11:33,347           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,348           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,348           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,349           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,349           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,350           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,351                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,351                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,351                 directory, all directories are treated like packages.
2024-02-12T18:11:33,352           ********************************************************************************

2024-02-12T18:11:33,352   !!
2024-02-12T18:11:33,353     check.warn(importable)
2024-02-12T18:11:33,353   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-02-12T18:11:33,354   !!

2024-02-12T18:11:33,354           ********************************************************************************
2024-02-12T18:11:33,355           ############################
2024-02-12T18:11:33,355           # Package would be ignored #
2024-02-12T18:11:33,356           ############################
2024-02-12T18:11:33,356           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-02-12T18:11:33,357           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,358           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,358           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-02-12T18:11:33,359           to the `packages` configuration field.

2024-02-12T18:11:33,360           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,360           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,361           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,362           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,363           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,364           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-02-12T18:11:33,365           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-02-12T18:11:33,365           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,366           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,366           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,367           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,368           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,370           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,370                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,371                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,372                 directory, all directories are treated like packages.
2024-02-12T18:11:33,372           ********************************************************************************

2024-02-12T18:11:33,373   !!
2024-02-12T18:11:33,374     check.warn(importable)
2024-02-12T18:11:33,374   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-02-12T18:11:33,375   !!

2024-02-12T18:11:33,375           ********************************************************************************
2024-02-12T18:11:33,376           ############################
2024-02-12T18:11:33,376           # Package would be ignored #
2024-02-12T18:11:33,377           ############################
2024-02-12T18:11:33,377           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-02-12T18:11:33,377           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,378           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,379           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-02-12T18:11:33,379           to the `packages` configuration field.

2024-02-12T18:11:33,380           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,380           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,381           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,381           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,382           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,383           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-02-12T18:11:33,384           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-02-12T18:11:33,384           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,385           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,385           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,386           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,388           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,389           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,390                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,390                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,391                 directory, all directories are treated like packages.
2024-02-12T18:11:33,391           ********************************************************************************

2024-02-12T18:11:33,392   !!
2024-02-12T18:11:33,393     check.warn(importable)
2024-02-12T18:11:33,393   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-02-12T18:11:33,394   !!

2024-02-12T18:11:33,395           ********************************************************************************
2024-02-12T18:11:33,396           ############################
2024-02-12T18:11:33,396           # Package would be ignored #
2024-02-12T18:11:33,397           ############################
2024-02-12T18:11:33,397           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-02-12T18:11:33,398           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,399           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,400           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-02-12T18:11:33,400           to the `packages` configuration field.

2024-02-12T18:11:33,402           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,402           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,403           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,403           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,404           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,405           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-02-12T18:11:33,405           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-02-12T18:11:33,406           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,406           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,406           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,407           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,408           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,410           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,410                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,410                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,411                 directory, all directories are treated like packages.
2024-02-12T18:11:33,411           ********************************************************************************

2024-02-12T18:11:33,412   !!
2024-02-12T18:11:33,413     check.warn(importable)
2024-02-12T18:11:33,413   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-02-12T18:11:33,414   !!

2024-02-12T18:11:33,415           ********************************************************************************
2024-02-12T18:11:33,415           ############################
2024-02-12T18:11:33,416           # Package would be ignored #
2024-02-12T18:11:33,416           ############################
2024-02-12T18:11:33,417           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-02-12T18:11:33,418           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,419           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,420           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-02-12T18:11:33,420           to the `packages` configuration field.

2024-02-12T18:11:33,421           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,422           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,422           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,424           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,425           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,426           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-02-12T18:11:33,427           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-02-12T18:11:33,427           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,428           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,428           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,430           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,431           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,433           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,434                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,434                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,435                 directory, all directories are treated like packages.
2024-02-12T18:11:33,436           ********************************************************************************

2024-02-12T18:11:33,437   !!
2024-02-12T18:11:33,437     check.warn(importable)
2024-02-12T18:11:33,438   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-02-12T18:11:33,438   !!

2024-02-12T18:11:33,439           ********************************************************************************
2024-02-12T18:11:33,440           ############################
2024-02-12T18:11:33,440           # Package would be ignored #
2024-02-12T18:11:33,441           ############################
2024-02-12T18:11:33,441           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-02-12T18:11:33,442           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,443           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,444           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-02-12T18:11:33,445           to the `packages` configuration field.

2024-02-12T18:11:33,446           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,447           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,447           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,448           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,450           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,451           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-02-12T18:11:33,452           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-02-12T18:11:33,452           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,453           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,454           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,456           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,458           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,460           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,461                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,462                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,462                 directory, all directories are treated like packages.
2024-02-12T18:11:33,463           ********************************************************************************

2024-02-12T18:11:33,464   !!
2024-02-12T18:11:33,465     check.warn(importable)
2024-02-12T18:11:33,466   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-02-12T18:11:33,466   !!

2024-02-12T18:11:33,468           ********************************************************************************
2024-02-12T18:11:33,468           ############################
2024-02-12T18:11:33,469           # Package would be ignored #
2024-02-12T18:11:33,470           ############################
2024-02-12T18:11:33,471           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-02-12T18:11:33,472           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,474           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,475           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-02-12T18:11:33,475           to the `packages` configuration field.

2024-02-12T18:11:33,476           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,477           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,477           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,479           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,480           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,481           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-02-12T18:11:33,481           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-02-12T18:11:33,482           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,482           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,483           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,485           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,486           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,487           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,488                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,488                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,489                 directory, all directories are treated like packages.
2024-02-12T18:11:33,490           ********************************************************************************

2024-02-12T18:11:33,491   !!
2024-02-12T18:11:33,491     check.warn(importable)
2024-02-12T18:11:33,492   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-02-12T18:11:33,492   !!

2024-02-12T18:11:33,494           ********************************************************************************
2024-02-12T18:11:33,494           ############################
2024-02-12T18:11:33,495           # Package would be ignored #
2024-02-12T18:11:33,495           ############################
2024-02-12T18:11:33,496           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-02-12T18:11:33,497           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,498           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,499           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-02-12T18:11:33,499           to the `packages` configuration field.

2024-02-12T18:11:33,500           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,501           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,502           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,503           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,504           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,505           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-02-12T18:11:33,506           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-02-12T18:11:33,507           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,507           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,508           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,509           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,510           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,512           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,512                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,513                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,513                 directory, all directories are treated like packages.
2024-02-12T18:11:33,514           ********************************************************************************

2024-02-12T18:11:33,515   !!
2024-02-12T18:11:33,515     check.warn(importable)
2024-02-12T18:11:33,516   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-02-12T18:11:33,516   !!

2024-02-12T18:11:33,517           ********************************************************************************
2024-02-12T18:11:33,518           ############################
2024-02-12T18:11:33,518           # Package would be ignored #
2024-02-12T18:11:33,518           ############################
2024-02-12T18:11:33,519           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-02-12T18:11:33,519           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,520           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,521           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-02-12T18:11:33,521           to the `packages` configuration field.

2024-02-12T18:11:33,522           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,522           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,523           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,524           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,525           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,526           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-02-12T18:11:33,526           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-02-12T18:11:33,527           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,527           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,528           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,529           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,530           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,531           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,532                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,532                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,533                 directory, all directories are treated like packages.
2024-02-12T18:11:33,533           ********************************************************************************

2024-02-12T18:11:33,534   !!
2024-02-12T18:11:33,535     check.warn(importable)
2024-02-12T18:11:33,535   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-02-12T18:11:33,536   !!

2024-02-12T18:11:33,537           ********************************************************************************
2024-02-12T18:11:33,537           ############################
2024-02-12T18:11:33,538           # Package would be ignored #
2024-02-12T18:11:33,538           ############################
2024-02-12T18:11:33,538           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-02-12T18:11:33,539           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,540           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,540           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-02-12T18:11:33,541           to the `packages` configuration field.

2024-02-12T18:11:33,541           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,542           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,542           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,543           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,544           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,545           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-02-12T18:11:33,545           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-02-12T18:11:33,546           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,546           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,547           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,548           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,549           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,551           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,551                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,552                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,552                 directory, all directories are treated like packages.
2024-02-12T18:11:33,553           ********************************************************************************

2024-02-12T18:11:33,554   !!
2024-02-12T18:11:33,554     check.warn(importable)
2024-02-12T18:11:33,555   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-02-12T18:11:33,555   !!

2024-02-12T18:11:33,556           ********************************************************************************
2024-02-12T18:11:33,557           ############################
2024-02-12T18:11:33,557           # Package would be ignored #
2024-02-12T18:11:33,558           ############################
2024-02-12T18:11:33,558           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-02-12T18:11:33,559           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,560           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,560           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-02-12T18:11:33,561           to the `packages` configuration field.

2024-02-12T18:11:33,562           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,562           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,563           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,564           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,565           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,566           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-02-12T18:11:33,566           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-02-12T18:11:33,567           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,567           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,567           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,568           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,569           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,570           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,571                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,571                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,571                 directory, all directories are treated like packages.
2024-02-12T18:11:33,572           ********************************************************************************

2024-02-12T18:11:33,573   !!
2024-02-12T18:11:33,573     check.warn(importable)
2024-02-12T18:11:33,574   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-02-12T18:11:33,574   !!

2024-02-12T18:11:33,575           ********************************************************************************
2024-02-12T18:11:33,576           ############################
2024-02-12T18:11:33,576           # Package would be ignored #
2024-02-12T18:11:33,577           ############################
2024-02-12T18:11:33,577           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-02-12T18:11:33,578           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,578           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,579           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-02-12T18:11:33,580           to the `packages` configuration field.

2024-02-12T18:11:33,580           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,581           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,581           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,583           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,584           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,585           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-02-12T18:11:33,585           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-02-12T18:11:33,586           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,586           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,586           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,588           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,589           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,590           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,591                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,591                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,592                 directory, all directories are treated like packages.
2024-02-12T18:11:33,593           ********************************************************************************

2024-02-12T18:11:33,594   !!
2024-02-12T18:11:33,594     check.warn(importable)
2024-02-12T18:11:33,595   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-02-12T18:11:33,595   !!

2024-02-12T18:11:33,596           ********************************************************************************
2024-02-12T18:11:33,596           ############################
2024-02-12T18:11:33,597           # Package would be ignored #
2024-02-12T18:11:33,597           ############################
2024-02-12T18:11:33,598           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-02-12T18:11:33,598           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,599           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,600           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-02-12T18:11:33,600           to the `packages` configuration field.

2024-02-12T18:11:33,601           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,601           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,602           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,603           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,604           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,605           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-02-12T18:11:33,606           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-02-12T18:11:33,606           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,607           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,607           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,608           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,609           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,611           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,611                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,612                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,613                 directory, all directories are treated like packages.
2024-02-12T18:11:33,613           ********************************************************************************

2024-02-12T18:11:33,615   !!
2024-02-12T18:11:33,616     check.warn(importable)
2024-02-12T18:11:33,616   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-02-12T18:11:33,617   !!

2024-02-12T18:11:33,618           ********************************************************************************
2024-02-12T18:11:33,619           ############################
2024-02-12T18:11:33,620           # Package would be ignored #
2024-02-12T18:11:33,620           ############################
2024-02-12T18:11:33,621           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-02-12T18:11:33,621           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,623           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,624           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-02-12T18:11:33,624           to the `packages` configuration field.

2024-02-12T18:11:33,625           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,625           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,626           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,627           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,628           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,629           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-02-12T18:11:33,630           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-02-12T18:11:33,630           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,631           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,631           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,632           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,633           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,634           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,635                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,635                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,636                 directory, all directories are treated like packages.
2024-02-12T18:11:33,636           ********************************************************************************

2024-02-12T18:11:33,637   !!
2024-02-12T18:11:33,638     check.warn(importable)
2024-02-12T18:11:33,638   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-02-12T18:11:33,639   !!

2024-02-12T18:11:33,640           ********************************************************************************
2024-02-12T18:11:33,640           ############################
2024-02-12T18:11:33,640           # Package would be ignored #
2024-02-12T18:11:33,641           ############################
2024-02-12T18:11:33,641           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-02-12T18:11:33,642           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,643           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,644           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-02-12T18:11:33,644           to the `packages` configuration field.

2024-02-12T18:11:33,645           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,646           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,646           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,647           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,648           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,649           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-02-12T18:11:33,650           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-02-12T18:11:33,650           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,651           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,651           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,653           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,654           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,655           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,655                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,656                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,656                 directory, all directories are treated like packages.
2024-02-12T18:11:33,657           ********************************************************************************

2024-02-12T18:11:33,657   !!
2024-02-12T18:11:33,658     check.warn(importable)
2024-02-12T18:11:33,658   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-02-12T18:11:33,659   !!

2024-02-12T18:11:33,659           ********************************************************************************
2024-02-12T18:11:33,660           ############################
2024-02-12T18:11:33,660           # Package would be ignored #
2024-02-12T18:11:33,661           ############################
2024-02-12T18:11:33,661           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-02-12T18:11:33,661           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,662           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,663           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-02-12T18:11:33,663           to the `packages` configuration field.

2024-02-12T18:11:33,664           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,665           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,665           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,666           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,667           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,668           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-02-12T18:11:33,669           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-02-12T18:11:33,669           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,669           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,670           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,671           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,672           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,673           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,674                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,674                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,675                 directory, all directories are treated like packages.
2024-02-12T18:11:33,675           ********************************************************************************

2024-02-12T18:11:33,676   !!
2024-02-12T18:11:33,677     check.warn(importable)
2024-02-12T18:11:33,677   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-02-12T18:11:33,678   !!

2024-02-12T18:11:33,679           ********************************************************************************
2024-02-12T18:11:33,679           ############################
2024-02-12T18:11:33,680           # Package would be ignored #
2024-02-12T18:11:33,680           ############################
2024-02-12T18:11:33,681           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-02-12T18:11:33,681           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,682           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,682           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-02-12T18:11:33,683           to the `packages` configuration field.

2024-02-12T18:11:33,684           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,684           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,684           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,685           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,686           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,687           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-02-12T18:11:33,688           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-02-12T18:11:33,688           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,689           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,689           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,690           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,691           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,692           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,693                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,693                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,693                 directory, all directories are treated like packages.
2024-02-12T18:11:33,694           ********************************************************************************

2024-02-12T18:11:33,695   !!
2024-02-12T18:11:33,696     check.warn(importable)
2024-02-12T18:11:33,696   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:207: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-02-12T18:11:33,697   !!

2024-02-12T18:11:33,698           ********************************************************************************
2024-02-12T18:11:33,699           ############################
2024-02-12T18:11:33,699           # Package would be ignored #
2024-02-12T18:11:33,700           ############################
2024-02-12T18:11:33,700           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-02-12T18:11:33,701           but it is absent from setuptools' `packages` configuration.

2024-02-12T18:11:33,702           This leads to an ambiguous overall configuration. If you want to distribute this
2024-02-12T18:11:33,702           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-02-12T18:11:33,703           to the `packages` configuration field.

2024-02-12T18:11:33,704           Alternatively, you can also rely on setuptools' discovery methods
2024-02-12T18:11:33,704           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-02-12T18:11:33,705           instead of `find_packages(...)`/`find:`).

2024-02-12T18:11:33,706           You can read more about "package discovery" on setuptools documentation page:

2024-02-12T18:11:33,708           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-02-12T18:11:33,708           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-02-12T18:11:33,709           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-02-12T18:11:33,709           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-02-12T18:11:33,710           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-02-12T18:11:33,710           combination with a more fine grained `package-data` configuration.

2024-02-12T18:11:33,711           You can read more about "package data files" on setuptools documentation page:

2024-02-12T18:11:33,712           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-02-12T18:11:33,714           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-02-12T18:11:33,714                 even if it does not contain any `.py` files.
2024-02-12T18:11:33,715                 On the other hand, currently there is no concept of package data
2024-02-12T18:11:33,715                 directory, all directories are treated like packages.
2024-02-12T18:11:33,716           ********************************************************************************

2024-02-12T18:11:33,717   !!
2024-02-12T18:11:33,717     check.warn(importable)
2024-02-12T18:11:33,718   creating build/lib/deepspeed/autotuning/config_templates
2024-02-12T18:11:33,719   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-12T18:11:33,719   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-12T18:11:33,720   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-12T18:11:33,720   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-02-12T18:11:33,721   creating build/lib/deepspeed/ops/csrc
2024-02-12T18:11:33,721   creating build/lib/deepspeed/ops/csrc/adagrad
2024-02-12T18:11:33,722   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-02-12T18:11:33,723   creating build/lib/deepspeed/ops/csrc/adam
2024-02-12T18:11:33,723   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-02-12T18:11:33,724   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-02-12T18:11:33,724   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-02-12T18:11:33,725   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-02-12T18:11:33,725   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-02-12T18:11:33,726   creating build/lib/deepspeed/ops/csrc/aio
2024-02-12T18:11:33,726   creating build/lib/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:33,727   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:33,728   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:33,728   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:33,729   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:33,729   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:33,730   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:33,730   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,731   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,731   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,732   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,732   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,733   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,733   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,733   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,734   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,734   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,735   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,736   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:33,736   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-02-12T18:11:33,737   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-02-12T18:11:33,737   creating build/lib/deepspeed/ops/csrc/common
2024-02-12T18:11:33,738   copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common
2024-02-12T18:11:33,738   creating build/lib/deepspeed/ops/csrc/cpu
2024-02-12T18:11:33,739   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-02-12T18:11:33,739   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-02-12T18:11:33,740   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-02-12T18:11:33,740   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-02-12T18:11:33,741   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-02-12T18:11:33,741   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-02-12T18:11:33,742   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-02-12T18:11:33,742   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:33,743   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:33,743   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:33,744   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:33,744   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:33,745   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:33,745   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:33,746   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-12T18:11:33,746   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-12T18:11:33,747   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-12T18:11:33,747   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-12T18:11:33,748   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-12T18:11:33,748   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:33,749   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:33,749   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:33,750   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:33,750   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:33,751   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:33,751   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:33,752   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:33,752   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:33,752   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:33,753   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:33,753   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:33,754   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:33,755   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:33,755   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:33,756   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:33,756   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-12T18:11:33,757   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-12T18:11:33,757   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-12T18:11:33,758   creating build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,758   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,759   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,759   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,760   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,761   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,761   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,761   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,762   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,762   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,763   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,763   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,763   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,764   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,764   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,765   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,765   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,765   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,766   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,766   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,767   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,767   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,768   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,768   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,769   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,769   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,770   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,770   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,771   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,771   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-02-12T18:11:33,772   creating build/lib/deepspeed/ops/csrc/lamb
2024-02-12T18:11:33,772   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-02-12T18:11:33,773   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-02-12T18:11:33,773   creating build/lib/deepspeed/ops/csrc/lion
2024-02-12T18:11:33,774   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-02-12T18:11:33,774   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-02-12T18:11:33,775   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-02-12T18:11:33,776   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-02-12T18:11:33,776   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-02-12T18:11:33,777   creating build/lib/deepspeed/ops/csrc/quantization
2024-02-12T18:11:33,777   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-12T18:11:33,778   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-12T18:11:33,778   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-02-12T18:11:33,778   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-12T18:11:33,779   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-12T18:11:33,779   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-12T18:11:33,780   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-02-12T18:11:33,780   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-02-12T18:11:33,780   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-12T18:11:33,781   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-12T18:11:33,781   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-12T18:11:33,782   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-02-12T18:11:33,782   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-02-12T18:11:33,782   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-02-12T18:11:33,783   creating build/lib/deepspeed/ops/csrc/spatial
2024-02-12T18:11:33,783   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-02-12T18:11:33,784   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-02-12T18:11:33,784   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-02-12T18:11:33,785   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-02-12T18:11:33,785   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-02-12T18:11:33,786   creating build/lib/deepspeed/ops/csrc/transformer
2024-02-12T18:11:33,786   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-12T18:11:33,787   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-12T18:11:33,789   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-02-12T18:11:33,792   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-12T18:11:33,795   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-12T18:11:33,798   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-12T18:11:33,802   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-12T18:11:33,805   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-02-12T18:11:33,808   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-02-12T18:11:33,808   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,809   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,812   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,814   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,817   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,820   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,822   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,827   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,829   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,831   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,834   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:33,837   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-12T18:11:33,838   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-12T18:11:33,841   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-12T18:11:33,843   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-02-12T18:11:33,846   creating build/lib/deepspeed/ops/csrc/utils
2024-02-12T18:11:33,846   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-02-12T18:11:33,848   creating build/lib/deepspeed/ops/csrc/xpu
2024-02-12T18:11:33,849   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-02-12T18:11:33,850   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-02-12T18:11:33,852   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-12T18:11:33,853   copying deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-12T18:11:33,855   copying deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-12T18:11:33,857   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-12T18:11:33,860   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-02-12T18:11:33,862   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-02-12T18:11:33,863   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-02-12T18:11:33,865   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:33,866   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:33,868   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:33,870   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:33,872   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:33,875   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:33,877   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:33,878   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:33,880   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:33,883   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:33,885   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:33,888   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:33,891   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-02-12T18:11:33,891   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-02-12T18:11:33,893   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-02-12T18:11:33,895   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-02-12T18:11:33,896   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-02-12T18:11:33,898   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-02-12T18:11:33,900   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-02-12T18:11:33,902   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-12T18:11:33,902   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-12T18:11:33,904   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-12T18:11:33,905   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-12T18:11:33,907   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-12T18:11:33,909   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-12T18:11:33,911   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-12T18:11:33,913   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-12T18:11:33,913   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-12T18:11:33,916   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:33,918   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:33,920   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:33,922   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-12T18:11:33,925   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-12T18:11:33,927   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:33,930   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:33,932   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:33,934   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:33,936   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:33,938   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:33,941   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:33,942   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:33,945   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:33,947   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:33,949   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:33,951   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:33,953   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:33,955   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:33,957   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:33,959   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:33,961   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:33,963   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:33,965   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:33,967   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:33,969   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:33,971   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:33,973   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:33,976   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:33,978   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:33,981   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:33,983   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:33,985   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:33,987   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:33,989   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:33,991   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:33,994   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:33,995   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:33,997   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-12T18:11:33,999   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-12T18:11:34,001   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,003   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,006   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,007   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,009   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:34,012   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:34,014   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:34,016   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:34,018   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:34,020   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:34,022   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-12T18:11:34,024   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-12T18:11:34,026   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-02-12T18:11:34,075   running build_scripts
2024-02-12T18:11:34,075   creating build/scripts-3.11
2024-02-12T18:11:34,076   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-02-12T18:11:34,078   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-02-12T18:11:34,079   copying and adjusting bin/ds -> build/scripts-3.11
2024-02-12T18:11:34,081   copying bin/ds_ssh -> build/scripts-3.11
2024-02-12T18:11:34,083   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-02-12T18:11:34,084   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-02-12T18:11:34,085   copying and adjusting bin/dsr -> build/scripts-3.11
2024-02-12T18:11:34,087   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-02-12T18:11:34,088   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-02-12T18:11:34,089   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-02-12T18:11:34,089   changing mode of build/scripts-3.11/ds from 644 to 755
2024-02-12T18:11:34,090   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-02-12T18:11:34,090   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-02-12T18:11:34,090   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-02-12T18:11:34,091   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-02-12T18:11:34,124   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-02-12T18:11:34,125   !!

2024-02-12T18:11:34,126           ********************************************************************************
2024-02-12T18:11:34,126           Please avoid running ``setup.py`` directly.
2024-02-12T18:11:34,127           Instead, use pypa/build, pypa/installer or other
2024-02-12T18:11:34,127           standards-based tools.

2024-02-12T18:11:34,128           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-02-12T18:11:34,129           ********************************************************************************

2024-02-12T18:11:34,129   !!
2024-02-12T18:11:34,130     self.initialize_options()
2024-02-12T18:11:34,158   installing to build/bdist.linux-armv7l/wheel
2024-02-12T18:11:34,158   running install
2024-02-12T18:11:34,183   running install_lib
2024-02-12T18:11:34,220   creating build/bdist.linux-armv7l
2024-02-12T18:11:34,221   creating build/bdist.linux-armv7l/wheel
2024-02-12T18:11:34,222   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-02-12T18:11:34,224   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-12T18:11:34,225   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-12T18:11:34,227   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-12T18:11:34,229   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-12T18:11:34,231   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-12T18:11:34,234   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-12T18:11:34,235   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-02-12T18:11:34,238   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-12T18:11:34,238   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-12T18:11:34,240   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-12T18:11:34,242   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-12T18:11:34,244   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-12T18:11:34,246   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-12T18:11:34,248   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-02-12T18:11:34,251   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-12T18:11:34,253   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-12T18:11:34,254   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-12T18:11:34,256   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-12T18:11:34,258   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-12T18:11:34,260   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:34,261   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-12T18:11:34,262   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-12T18:11:34,264   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-12T18:11:34,267   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-12T18:11:34,268   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-02-12T18:11:34,270   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-12T18:11:34,271   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-12T18:11:34,273   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-12T18:11:34,275   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-12T18:11:34,277   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-02-12T18:11:34,279   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-12T18:11:34,280   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-12T18:11:34,282   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-12T18:11:34,284   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-12T18:11:34,286   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-02-12T18:11:34,288   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:34,289   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:34,291   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:34,293   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:34,295   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:34,296   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:34,299   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:34,300   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:34,302   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:34,304   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-02-12T18:11:34,306   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:34,309   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-12T18:11:34,309   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-12T18:11:34,311   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-12T18:11:34,314   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-12T18:11:34,316   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-02-12T18:11:34,318   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:34,321   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:34,322   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:34,324   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:34,325   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:34,327   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:34,329   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:34,330   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:34,332   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:34,334   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:34,336   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-02-12T18:11:34,337   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:34,340   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-12T18:11:34,341   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-12T18:11:34,343   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-12T18:11:34,345   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-12T18:11:34,347   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-02-12T18:11:34,348   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:34,350   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:34,353   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:34,354   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-02-12T18:11:34,357   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-12T18:11:34,358   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-12T18:11:34,360   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-12T18:11:34,362   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-12T18:11:34,364   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-02-12T18:11:34,366   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-12T18:11:34,367   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-12T18:11:34,369   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-12T18:11:34,371   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-12T18:11:34,373   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-02-12T18:11:34,375   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-12T18:11:34,376   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-12T18:11:34,378   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-12T18:11:34,380   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-12T18:11:34,382   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-02-12T18:11:34,384   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-12T18:11:34,386   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-12T18:11:34,388   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-02-12T18:11:34,389   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:34,390   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:34,393   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:34,394   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:34,397   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:34,399   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-02-12T18:11:34,401   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-02-12T18:11:34,402   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:34,403   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:34,405   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:34,407   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:34,409   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:34,411   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:34,413   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:34,414   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-02-12T18:11:34,416   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-02-12T18:11:34,418   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-12T18:11:34,419   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-12T18:11:34,421   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-12T18:11:34,423   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-12T18:11:34,426   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-02-12T18:11:34,428   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:34,429   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:34,431   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:34,433   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:34,435   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:34,437   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:34,439   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:34,441   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:34,442   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-02-12T18:11:34,444   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:34,445   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:34,447   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:34,449   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:34,451   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:34,453   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-02-12T18:11:34,455   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-02-12T18:11:34,457   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:34,458   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:34,460   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:34,461   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:34,464   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:34,466   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-02-12T18:11:34,468   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-02-12T18:11:34,470   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:34,471   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:34,472   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:34,474   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:34,476   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:34,478   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:34,480   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-02-12T18:11:34,482   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:34,483   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:34,484   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:34,486   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:34,488   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:34,490   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:34,492   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-02-12T18:11:34,494   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-12T18:11:34,495   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-02-12T18:11:34,497   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-02-12T18:11:34,499   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:34,500   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:34,502   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:34,504   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:34,506   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:34,507   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:34,509   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-02-12T18:11:34,511   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:34,512   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:34,513   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:34,516   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:34,518   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:34,520   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:34,521   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:34,523   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:34,525   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-02-12T18:11:34,527   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-12T18:11:34,528   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-12T18:11:34,530   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-12T18:11:34,532   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-02-12T18:11:34,534   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:34,535   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:34,538   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:34,539   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:34,541   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:34,543   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:34,545   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-02-12T18:11:34,547   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:34,548   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:34,550   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:34,552   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:34,554   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:34,555   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:34,557   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-02-12T18:11:34,559   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-12T18:11:34,560   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-12T18:11:34,562   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-12T18:11:34,564   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-12T18:11:34,566   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-02-12T18:11:34,568   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-02-12T18:11:34,570   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,571   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,573   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,575   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,577   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,578   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,581   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-02-12T18:11:34,582   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-02-12T18:11:34,584   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-02-12T18:11:34,586   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-12T18:11:34,587   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-12T18:11:34,589   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-12T18:11:34,590   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-02-12T18:11:34,592   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:34,593   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:34,595   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:34,597   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:34,599   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:34,601   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:34,603   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-02-12T18:11:34,605   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:34,606   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:34,608   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:34,610   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:34,612   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:34,614   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-02-12T18:11:34,615   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-02-12T18:11:34,617   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-12T18:11:34,619   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-12T18:11:34,621   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-12T18:11:34,623   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-12T18:11:34,624   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-12T18:11:34,626   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-12T18:11:34,629   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-02-12T18:11:34,630   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-02-12T18:11:34,631   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-12T18:11:34,635   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-02-12T18:11:34,635   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-02-12T18:11:34,637   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-02-12T18:11:34,639   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-12T18:11:34,641   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-12T18:11:34,643   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-12T18:11:34,645   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-02-12T18:11:34,647   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-12T18:11:34,649   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:34,650   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:34,651   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:34,653   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:34,655   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:34,657   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:34,659   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:34,661   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:34,662   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-02-12T18:11:34,665   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-02-12T18:11:34,666   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-02-12T18:11:34,667   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-02-12T18:11:34,670   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-02-12T18:11:34,672   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-02-12T18:11:34,673   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-02-12T18:11:34,675   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-02-12T18:11:34,678   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-02-12T18:11:34,679   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-02-12T18:11:34,681   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-02-12T18:11:34,683   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-12T18:11:34,684   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-12T18:11:34,686   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-02-12T18:11:34,688   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-12T18:11:34,689   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-12T18:11:34,690   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-12T18:11:34,692   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-02-12T18:11:34,694   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-02-12T18:11:34,696   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-02-12T18:11:34,697   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-02-12T18:11:34,699   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-02-12T18:11:34,701   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-02-12T18:11:34,702   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-02-12T18:11:34,705   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-02-12T18:11:34,707   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-12T18:11:34,709   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-12T18:11:34,711   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-12T18:11:34,713   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:34,714   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:34,716   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:34,718   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:34,719   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:34,721   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:34,723   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:34,724   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-02-12T18:11:34,726   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-02-12T18:11:34,728   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-02-12T18:11:34,730   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-12T18:11:34,732   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-12T18:11:34,736   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-12T18:11:34,737   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-12T18:11:34,739   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-12T18:11:34,741   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-12T18:11:34,743   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-12T18:11:34,745   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-02-12T18:11:34,747   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-02-12T18:11:34,749   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-12T18:11:34,750   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-12T18:11:34,753   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-12T18:11:34,754   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-12T18:11:34,757   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-12T18:11:34,758   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-12T18:11:34,760   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-12T18:11:34,762   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-12T18:11:34,764   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-12T18:11:34,766   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-12T18:11:34,768   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-02-12T18:11:34,770   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-12T18:11:34,772   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-12T18:11:34,773   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-12T18:11:34,775   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-12T18:11:34,777   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-12T18:11:34,778   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-02-12T18:11:34,780   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-12T18:11:34,782   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-02-12T18:11:34,786   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-02-12T18:11:34,786   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-02-12T18:11:34,788   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-12T18:11:34,790   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-12T18:11:34,791   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-12T18:11:34,793   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-12T18:11:34,795   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-12T18:11:34,797   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-12T18:11:34,798   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-12T18:11:34,800   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-12T18:11:34,802   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-02-12T18:11:34,804   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-12T18:11:34,805   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-12T18:11:34,807   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-12T18:11:34,809   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-12T18:11:34,810   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-12T18:11:34,813   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-12T18:11:34,815   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-12T18:11:34,817   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-12T18:11:34,819   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-12T18:11:34,821   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-02-12T18:11:34,823   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-02-12T18:11:34,825   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-12T18:11:34,825   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-12T18:11:34,828   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-12T18:11:34,830   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-12T18:11:34,831   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-02-12T18:11:34,834   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-12T18:11:34,835   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-12T18:11:34,837   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-12T18:11:34,839   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-12T18:11:34,841   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-12T18:11:34,843   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-12T18:11:34,845   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-12T18:11:34,847   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-02-12T18:11:34,851   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-12T18:11:34,851   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-12T18:11:34,854   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-12T18:11:34,856   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-12T18:11:34,859   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-02-12T18:11:34,861   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-02-12T18:11:34,862   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-02-12T18:11:34,864   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,865   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,868   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,870   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,872   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,873   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,875   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,877   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,879   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,881   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,883   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,885   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,887   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,889   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:34,890   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:34,893   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:34,894   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:34,896   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:34,898   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:34,899   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-02-12T18:11:34,901   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,903   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:34,904   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:34,906   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:34,907   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:34,909   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:34,911   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-02-12T18:11:34,912   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,914   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,917   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-12T18:11:34,918   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-12T18:11:34,920   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-12T18:11:34,921   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-12T18:11:34,923   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-12T18:11:34,925   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-12T18:11:34,927   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-12T18:11:34,929   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-12T18:11:34,931   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-12T18:11:34,933   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-02-12T18:11:34,935   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,937   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,938   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,940   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,942   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:34,943   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:34,945   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:34,947   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:34,949   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:34,950   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:34,952   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-02-12T18:11:34,953   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,955   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,957   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-02-12T18:11:34,959   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-02-12T18:11:34,960   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-02-12T18:11:34,962   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-02-12T18:11:34,964   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-02-12T18:11:34,965   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-02-12T18:11:34,967   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-02-12T18:11:34,969   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-02-12T18:11:34,970   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-02-12T18:11:34,972   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-02-12T18:11:34,975   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-12T18:11:34,976   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-12T18:11:34,979   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-12T18:11:34,980   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-12T18:11:34,982   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-02-12T18:11:34,985   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-02-12T18:11:34,986   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-02-12T18:11:34,988   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-02-12T18:11:34,989   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-02-12T18:11:34,991   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-02-12T18:11:34,992   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-02-12T18:11:34,994   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-02-12T18:11:34,997   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-12T18:11:34,998   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-12T18:11:34,999   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-12T18:11:35,001   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-12T18:11:35,003   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-12T18:11:35,005   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-02-12T18:11:35,008   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-02-12T18:11:35,009   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-02-12T18:11:35,011   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-02-12T18:11:35,013   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-02-12T18:11:35,013   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-02-12T18:11:35,016   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,017   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,019   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,021   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,022   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,024   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,026   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,028   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,030   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,032   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,034   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,036   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-02-12T18:11:35,038   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:35,039   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:35,041   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:35,043   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:35,045   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:35,047   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:35,049   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-02-12T18:11:35,052   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,052   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,054   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,056   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,059   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,061   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,063   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,066   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,068   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,070   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,072   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,074   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,076   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,079   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,081   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,083   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,085   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,087   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,090   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,091   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,093   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,095   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,098   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,100   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,101   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,104   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,106   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,109   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,111   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,113   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-02-12T18:11:35,116   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-02-12T18:11:35,117   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:35,118   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:35,120   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:35,122   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:35,125   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:35,126   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:35,129   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:35,131   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:35,133   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:35,136   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:35,138   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:35,141   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-02-12T18:11:35,145   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:35,146   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:35,149   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:35,151   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:35,154   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:35,157   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:35,161   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:35,163   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-02-12T18:11:35,166   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:35,171   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-12T18:11:35,172   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-12T18:11:35,175   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-02-12T18:11:35,178   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-12T18:11:35,179   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-12T18:11:35,182   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-12T18:11:35,184   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-12T18:11:35,187   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-02-12T18:11:35,189   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:35,193   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-02-12T18:11:35,196   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-02-12T18:11:35,197   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-02-12T18:11:35,200   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-12T18:11:35,201   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-12T18:11:35,205   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-12T18:11:35,208   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-12T18:11:35,211   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-12T18:11:35,213   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-12T18:11:35,215   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-12T18:11:35,218   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-02-12T18:11:35,221   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-12T18:11:35,222   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-12T18:11:35,223   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-12T18:11:35,226   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-12T18:11:35,227   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-12T18:11:35,229   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-02-12T18:11:35,233   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-02-12T18:11:35,233   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-02-12T18:11:35,236   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-02-12T18:11:35,237   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-02-12T18:11:35,238   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-02-12T18:11:35,241   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-02-12T18:11:35,242   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-02-12T18:11:35,245   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-02-12T18:11:35,246   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-02-12T18:11:35,249   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-12T18:11:35,249   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-12T18:11:35,252   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-12T18:11:35,254   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-12T18:11:35,256   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-02-12T18:11:35,259   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-12T18:11:35,260   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-02-12T18:11:35,262   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-12T18:11:35,263   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-12T18:11:35,266   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-12T18:11:35,268   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-02-12T18:11:35,271   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,276   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,279   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,282   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,283   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,286   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,290   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,293   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,295   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,298   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,300   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-02-12T18:11:35,303   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-12T18:11:35,306   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-12T18:11:35,324   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-12T18:11:35,327   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-12T18:11:35,478   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-12T18:11:35,482   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-12T18:11:35,485   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-12T18:11:35,488   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-02-12T18:11:35,493   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-02-12T18:11:35,494   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:35,495   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:35,498   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:35,500   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:35,503   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:35,505   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-02-12T18:11:35,507   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-02-12T18:11:35,508   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-02-12T18:11:35,511   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-12T18:11:35,512   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-12T18:11:35,514   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-12T18:11:35,516   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-12T18:11:35,518   copying build/lib/deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-02-12T18:11:35,521   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-02-12T18:11:35,522   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-02-12T18:11:35,524   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-02-12T18:11:35,525   copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2024-02-12T18:11:35,527   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-02-12T18:11:35,528   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-02-12T18:11:35,530   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-02-12T18:11:35,533   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-02-12T18:11:35,535   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-02-12T18:11:35,536   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-02-12T18:11:35,538   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-02-12T18:11:35,541   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-02-12T18:11:35,542   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,543   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,546   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,547   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,549   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,552   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,554   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,556   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,559   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,561   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,563   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,565   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,567   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-02-12T18:11:35,570   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,572   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,574   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,575   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,578   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,580   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,582   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,583   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,585   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,587   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,590   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,591   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,594   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-02-12T18:11:35,596   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,598   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,601   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,603   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,605   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,608   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,610   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-02-12T18:11:35,613   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-02-12T18:11:35,615   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-02-12T18:11:35,617   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-02-12T18:11:35,618   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-02-12T18:11:35,620   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-02-12T18:11:35,623   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-02-12T18:11:35,624   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-12T18:11:35,625   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-12T18:11:35,628   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-12T18:11:35,630   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-02-12T18:11:35,632   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-02-12T18:11:35,635   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-02-12T18:11:35,637   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-02-12T18:11:35,639   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-02-12T18:11:35,642   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,644   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,646   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,649   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,651   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,655   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,658   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,661   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,663   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,666   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,668   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-02-12T18:11:35,671   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,673   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,676   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,680   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,682   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,685   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,688   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,690   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,693   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,695   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,698   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-02-12T18:11:35,701   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-12T18:11:35,702   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-12T18:11:35,705   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-02-12T18:11:35,707   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-02-12T18:11:35,711   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-02-12T18:11:35,713   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-12T18:11:35,716   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-02-12T18:11:35,719   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-12T18:11:35,720   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-12T18:11:35,723   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-12T18:11:35,728   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-12T18:11:35,730   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-12T18:11:35,733   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-12T18:11:35,735   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-12T18:11:35,737   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-12T18:11:35,741   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-02-12T18:11:35,744   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,745   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,748   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,751   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,753   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,756   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,758   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,761   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,762   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,765   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,767   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,769   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,771   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,774   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,775   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,778   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,780   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,782   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,784   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,786   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,788   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,791   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,793   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,795   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,797   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,799   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-12T18:11:35,800   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-12T18:11:35,802   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-12T18:11:35,805   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-12T18:11:35,807   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-12T18:11:35,809   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-12T18:11:35,811   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-12T18:11:35,813   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-02-12T18:11:35,815   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,817   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-02-12T18:11:35,819   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,821   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,822   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,824   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,827   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,828   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,831   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-02-12T18:11:35,833   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-12T18:11:35,834   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-12T18:11:35,836   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-12T18:11:35,838   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-02-12T18:11:35,840   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-12T18:11:35,843   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,844   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,847   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,849   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,851   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,853   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,855   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,857   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,859   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,861   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,864   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,865   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,867   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,870   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,871   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,874   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-02-12T18:11:35,876   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-12T18:11:35,877   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-12T18:11:35,880   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-12T18:11:35,881   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-12T18:11:35,883   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-12T18:11:35,885   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-12T18:11:35,887   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-02-12T18:11:35,893   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-12T18:11:35,894   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-12T18:11:35,896   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-12T18:11:35,898   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-12T18:11:35,900   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-12T18:11:35,902   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-12T18:11:35,904   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-12T18:11:35,906   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-12T18:11:35,908   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-12T18:11:35,911   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-02-12T18:11:35,913   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-12T18:11:35,916   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:35,917   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-12T18:11:35,918   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-12T18:11:35,921   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-12T18:11:35,923   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-12T18:11:35,926   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-02-12T18:11:35,928   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-12T18:11:35,929   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-12T18:11:35,932   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-12T18:11:35,934   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-12T18:11:35,937   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-02-12T18:11:35,939   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:35,942   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-12T18:11:35,943   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-12T18:11:35,945   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-12T18:11:35,948   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-02-12T18:11:35,949   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:35,952   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:35,953   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:35,956   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-12T18:11:35,957   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-12T18:11:35,959   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-12T18:11:35,961   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-12T18:11:35,964   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-12T18:11:35,966   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-12T18:11:35,968   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-12T18:11:35,970   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-12T18:11:35,972   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-12T18:11:35,975   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-02-12T18:11:35,977   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-12T18:11:35,978   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-12T18:11:35,980   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-12T18:11:35,984   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-12T18:11:35,986   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-12T18:11:35,988   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-12T18:11:35,990   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-02-12T18:11:35,993   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-12T18:11:35,994   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-12T18:11:35,997   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-12T18:11:35,999   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-12T18:11:36,001   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-12T18:11:36,003   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-02-12T18:11:36,005   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,009   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-12T18:11:36,009   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-12T18:11:36,012   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:36,013   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:36,016   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:36,017   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:36,019   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:36,021   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-02-12T18:11:36,023   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-12T18:11:36,025   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-12T18:11:36,027   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-02-12T18:11:36,030   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:36,031   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:36,034   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:36,036   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:36,038   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:36,040   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-02-12T18:11:36,043   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,045   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,046   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,049   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,051   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,054   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,056   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,058   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,060   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,063   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,067   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,069   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,071   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,076   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,080   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,083   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,085   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,087   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-02-12T18:11:36,089   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,095   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-02-12T18:11:36,096   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-02-12T18:11:36,098   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-02-12T18:11:36,100   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,102   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,104   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,106   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,109   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,112   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-12T18:11:36,113   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-12T18:11:36,115   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-12T18:11:36,117   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-12T18:11:36,119   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-02-12T18:11:36,120   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,123   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,125   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,127   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,130   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-02-12T18:11:36,133   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-02-12T18:11:36,134   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-02-12T18:11:36,136   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-02-12T18:11:36,138   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-12T18:11:36,140   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-12T18:11:36,142   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2024-02-12T18:11:36,143   running install_egg_info
2024-02-12T18:11:36,183   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.13.2-py3.11.egg-info
2024-02-12T18:11:36,197   running install_scripts
2024-02-12T18:11:36,198   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data
2024-02-12T18:11:36,199   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts
2024-02-12T18:11:36,200   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts
2024-02-12T18:11:36,201   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts
2024-02-12T18:11:36,203   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts
2024-02-12T18:11:36,205   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts
2024-02-12T18:11:36,207   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts
2024-02-12T18:11:36,209   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts
2024-02-12T18:11:36,210   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts
2024-02-12T18:11:36,212   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts
2024-02-12T18:11:36,214   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts/ds_bench to 755
2024-02-12T18:11:36,214   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts/deepspeed to 755
2024-02-12T18:11:36,215   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts/ds to 755
2024-02-12T18:11:36,215   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts/ds_report to 755
2024-02-12T18:11:36,216   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts/deepspeed.pt to 755
2024-02-12T18:11:36,216   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts/ds_ssh to 755
2024-02-12T18:11:36,217   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts/ds_elastic to 755
2024-02-12T18:11:36,218   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.data/scripts/dsr to 755
2024-02-12T18:11:36,261   creating build/bdist.linux-armv7l/wheel/deepspeed-0.13.2.dist-info/WHEEL
2024-02-12T18:11:36,264   creating '/tmp/pip-wheel-yjbdlhju/deepspeed-0.13.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-02-12T18:11:36,267   adding 'deepspeed/__init__.py'
2024-02-12T18:11:36,269   adding 'deepspeed/constants.py'
2024-02-12T18:11:36,270   adding 'deepspeed/env_report.py'
2024-02-12T18:11:36,272   adding 'deepspeed/git_version_info.py'
2024-02-12T18:11:36,273   adding 'deepspeed/git_version_info_installed.py'
2024-02-12T18:11:36,275   adding 'deepspeed/pydantic_v1.py'
2024-02-12T18:11:36,277   adding 'deepspeed/accelerator/__init__.py'
2024-02-12T18:11:36,278   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-02-12T18:11:36,280   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-02-12T18:11:36,282   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-02-12T18:11:36,284   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-02-12T18:11:36,286   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-02-12T18:11:36,287   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-02-12T18:11:36,289   adding 'deepspeed/accelerator/real_accelerator.py'
2024-02-12T18:11:36,291   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-02-12T18:11:36,293   adding 'deepspeed/autotuning/__init__.py'
2024-02-12T18:11:36,298   adding 'deepspeed/autotuning/autotuner.py'
2024-02-12T18:11:36,299   adding 'deepspeed/autotuning/config.py'
2024-02-12T18:11:36,301   adding 'deepspeed/autotuning/constants.py'
2024-02-12T18:11:36,303   adding 'deepspeed/autotuning/scheduler.py'
2024-02-12T18:11:36,305   adding 'deepspeed/autotuning/utils.py'
2024-02-12T18:11:36,306   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-02-12T18:11:36,307   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-02-12T18:11:36,308   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-02-12T18:11:36,310   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-02-12T18:11:36,311   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-02-12T18:11:36,312   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-02-12T18:11:36,314   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-02-12T18:11:36,315   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-02-12T18:11:36,316   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-02-12T18:11:36,318   adding 'deepspeed/autotuning/tuner/utils.py'
2024-02-12T18:11:36,319   adding 'deepspeed/checkpoint/__init__.py'
2024-02-12T18:11:36,321   adding 'deepspeed/checkpoint/constants.py'
2024-02-12T18:11:36,322   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-02-12T18:11:36,325   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-02-12T18:11:36,326   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-02-12T18:11:36,328   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-02-12T18:11:36,329   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-02-12T18:11:36,330   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-02-12T18:11:36,332   adding 'deepspeed/checkpoint/utils.py'
2024-02-12T18:11:36,333   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-02-12T18:11:36,335   adding 'deepspeed/comm/__init__.py'
2024-02-12T18:11:36,336   adding 'deepspeed/comm/backend.py'
2024-02-12T18:11:36,338   adding 'deepspeed/comm/ccl.py'
2024-02-12T18:11:36,341   adding 'deepspeed/comm/comm.py'
2024-02-12T18:11:36,342   adding 'deepspeed/comm/config.py'
2024-02-12T18:11:36,344   adding 'deepspeed/comm/constants.py'
2024-02-12T18:11:36,345   adding 'deepspeed/comm/reduce_op.py'
2024-02-12T18:11:36,347   adding 'deepspeed/comm/torch.py'
2024-02-12T18:11:36,348   adding 'deepspeed/comm/utils.py'
2024-02-12T18:11:36,350   adding 'deepspeed/compression/__init__.py'
2024-02-12T18:11:36,353   adding 'deepspeed/compression/basic_layer.py'
2024-02-12T18:11:36,355   adding 'deepspeed/compression/compress.py'
2024-02-12T18:11:36,357   adding 'deepspeed/compression/config.py'
2024-02-12T18:11:36,359   adding 'deepspeed/compression/constants.py'
2024-02-12T18:11:36,361   adding 'deepspeed/compression/helper.py'
2024-02-12T18:11:36,362   adding 'deepspeed/compression/scheduler.py'
2024-02-12T18:11:36,364   adding 'deepspeed/compression/utils.py'
2024-02-12T18:11:36,366   adding 'deepspeed/elasticity/__init__.py'
2024-02-12T18:11:36,367   adding 'deepspeed/elasticity/config.py'
2024-02-12T18:11:36,369   adding 'deepspeed/elasticity/constants.py'
2024-02-12T18:11:36,370   adding 'deepspeed/elasticity/elastic_agent.py'
2024-02-12T18:11:36,372   adding 'deepspeed/elasticity/elasticity.py'
2024-02-12T18:11:36,374   adding 'deepspeed/elasticity/utils.py'
2024-02-12T18:11:36,376   adding 'deepspeed/inference/__init__.py'
2024-02-12T18:11:36,378   adding 'deepspeed/inference/config.py'
2024-02-12T18:11:36,381   adding 'deepspeed/inference/engine.py'
2024-02-12T18:11:36,383   adding 'deepspeed/inference/quantization/__init__.py'
2024-02-12T18:11:36,385   adding 'deepspeed/inference/quantization/layers.py'
2024-02-12T18:11:36,386   adding 'deepspeed/inference/quantization/quantization.py'
2024-02-12T18:11:36,387   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-02-12T18:11:36,389   adding 'deepspeed/inference/quantization/utils.py'
2024-02-12T18:11:36,391   adding 'deepspeed/inference/v2/__init__.py'
2024-02-12T18:11:36,392   adding 'deepspeed/inference/v2/allocator.py'
2024-02-12T18:11:36,394   adding 'deepspeed/inference/v2/config_v2.py'
2024-02-12T18:11:36,395   adding 'deepspeed/inference/v2/engine_factory.py'
2024-02-12T18:11:36,397   adding 'deepspeed/inference/v2/engine_v2.py'
2024-02-12T18:11:36,398   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-02-12T18:11:36,400   adding 'deepspeed/inference/v2/inference_utils.py'
2024-02-12T18:11:36,401   adding 'deepspeed/inference/v2/logging.py'
2024-02-12T18:11:36,402   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-02-12T18:11:36,403   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-02-12T18:11:36,405   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-02-12T18:11:36,406   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-02-12T18:11:36,407   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-02-12T18:11:36,409   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-02-12T18:11:36,410   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-02-12T18:11:36,412   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-02-12T18:11:36,413   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-02-12T18:11:36,415   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-02-12T18:11:36,416   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-02-12T18:11:36,418   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu'
2024-02-12T18:11:36,419   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-02-12T18:11:36,420   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-02-12T18:11:36,422   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-02-12T18:11:36,423   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-02-12T18:11:36,425   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-02-12T18:11:36,426   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-02-12T18:11:36,428   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-02-12T18:11:36,429   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-02-12T18:11:36,431   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-02-12T18:11:36,432   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-02-12T18:11:36,433   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-02-12T18:11:36,434   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-02-12T18:11:36,436   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu'
2024-02-12T18:11:36,438   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-02-12T18:11:36,440   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-02-12T18:11:36,441   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-02-12T18:11:36,443   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu'
2024-02-12T18:11:36,444   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-02-12T18:11:36,446   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-02-12T18:11:36,447   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-02-12T18:11:36,448   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-02-12T18:11:36,450   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-02-12T18:11:36,451   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-02-12T18:11:36,453   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-02-12T18:11:36,454   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu'
2024-02-12T18:11:36,456   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-02-12T18:11:36,457   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-02-12T18:11:36,458   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-02-12T18:11:36,460   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-02-12T18:11:36,461   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-02-12T18:11:36,463   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-02-12T18:11:36,464   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-02-12T18:11:36,465   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-02-12T18:11:36,467   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-02-12T18:11:36,468   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-02-12T18:11:36,470   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-02-12T18:11:36,471   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-02-12T18:11:36,472   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-02-12T18:11:36,473   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-02-12T18:11:36,475   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-02-12T18:11:36,477   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-02-12T18:11:36,479   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-02-12T18:11:36,480   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-02-12T18:11:36,482   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-02-12T18:11:36,485   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-02-12T18:11:36,487   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-02-12T18:11:36,488   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-02-12T18:11:36,490   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-02-12T18:11:36,491   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-02-12T18:11:36,492   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-02-12T18:11:36,494   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-02-12T18:11:36,495   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-02-12T18:11:36,497   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-02-12T18:11:36,498   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-02-12T18:11:36,499   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-02-12T18:11:36,501   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-02-12T18:11:36,502   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-02-12T18:11:36,504   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-02-12T18:11:36,506   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-02-12T18:11:36,508   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu'
2024-02-12T18:11:36,509   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-02-12T18:11:36,510   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-02-12T18:11:36,512   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-02-12T18:11:36,514   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-02-12T18:11:36,515   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-02-12T18:11:36,517   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-02-12T18:11:36,519   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu'
2024-02-12T18:11:36,520   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-02-12T18:11:36,521   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-02-12T18:11:36,523   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-02-12T18:11:36,524   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-02-12T18:11:36,526   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-02-12T18:11:36,527   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-02-12T18:11:36,529   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-02-12T18:11:36,530   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu'
2024-02-12T18:11:36,531   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-02-12T18:11:36,532   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-02-12T18:11:36,533   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-02-12T18:11:36,535   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-02-12T18:11:36,536   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-02-12T18:11:36,538   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu'
2024-02-12T18:11:36,539   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-02-12T18:11:36,540   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-02-12T18:11:36,541   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-02-12T18:11:36,543   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-02-12T18:11:36,545   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-02-12T18:11:36,546   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu'
2024-02-12T18:11:36,547   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-02-12T18:11:36,549   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-02-12T18:11:36,550   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-02-12T18:11:36,552   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-02-12T18:11:36,553   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-02-12T18:11:36,554   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-02-12T18:11:36,556   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-02-12T18:11:36,557   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-02-12T18:11:36,559   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cu'
2024-02-12T18:11:36,560   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-02-12T18:11:36,561   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-02-12T18:11:36,562   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-02-12T18:11:36,564   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-02-12T18:11:36,566   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-02-12T18:11:36,568   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-02-12T18:11:36,570   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-02-12T18:11:36,573   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-02-12T18:11:36,575   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-02-12T18:11:36,577   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-02-12T18:11:36,578   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-02-12T18:11:36,579   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-02-12T18:11:36,581   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-02-12T18:11:36,582   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-02-12T18:11:36,583   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-02-12T18:11:36,584   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-02-12T18:11:36,585   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-02-12T18:11:36,587   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-02-12T18:11:36,588   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-02-12T18:11:36,590   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-02-12T18:11:36,591   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-02-12T18:11:36,593   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-02-12T18:11:36,594   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-02-12T18:11:36,596   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-02-12T18:11:36,598   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-02-12T18:11:36,599   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-02-12T18:11:36,600   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-02-12T18:11:36,602   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-02-12T18:11:36,603   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-02-12T18:11:36,605   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-02-12T18:11:36,606   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-02-12T18:11:36,608   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-02-12T18:11:36,609   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-02-12T18:11:36,611   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-02-12T18:11:36,612   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-02-12T18:11:36,614   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-02-12T18:11:36,615   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-02-12T18:11:36,617   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-02-12T18:11:36,618   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-02-12T18:11:36,620   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-02-12T18:11:36,621   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-02-12T18:11:36,623   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-02-12T18:11:36,624   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-02-12T18:11:36,626   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-02-12T18:11:36,627   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-02-12T18:11:36,629   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-02-12T18:11:36,630   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-02-12T18:11:36,632   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-02-12T18:11:36,633   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-02-12T18:11:36,635   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-02-12T18:11:36,636   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-02-12T18:11:36,637   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-02-12T18:11:36,639   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-02-12T18:11:36,640   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-02-12T18:11:36,641   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-02-12T18:11:36,642   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-02-12T18:11:36,644   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-02-12T18:11:36,645   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-02-12T18:11:36,647   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-02-12T18:11:36,648   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-02-12T18:11:36,650   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-02-12T18:11:36,651   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-02-12T18:11:36,652   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-02-12T18:11:36,653   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-02-12T18:11:36,655   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-02-12T18:11:36,656   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-02-12T18:11:36,657   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-02-12T18:11:36,659   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-02-12T18:11:36,661   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-02-12T18:11:36,663   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-02-12T18:11:36,664   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-02-12T18:11:36,666   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-02-12T18:11:36,667   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-02-12T18:11:36,669   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-02-12T18:11:36,670   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-02-12T18:11:36,672   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-02-12T18:11:36,674   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-02-12T18:11:36,675   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-02-12T18:11:36,677   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-02-12T18:11:36,678   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-02-12T18:11:36,679   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-02-12T18:11:36,681   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-02-12T18:11:36,682   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-02-12T18:11:36,684   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-02-12T18:11:36,685   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-02-12T18:11:36,687   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-02-12T18:11:36,688   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-02-12T18:11:36,689   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-02-12T18:11:36,691   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-02-12T18:11:36,692   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-02-12T18:11:36,693   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-02-12T18:11:36,695   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-02-12T18:11:36,696   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-02-12T18:11:36,697   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-02-12T18:11:36,699   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-02-12T18:11:36,701   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-02-12T18:11:36,702   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-02-12T18:11:36,704   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-02-12T18:11:36,706   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-02-12T18:11:36,707   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-02-12T18:11:36,708   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-02-12T18:11:36,710   adding 'deepspeed/launcher/__init__.py'
2024-02-12T18:11:36,711   adding 'deepspeed/launcher/constants.py'
2024-02-12T18:11:36,713   adding 'deepspeed/launcher/launch.py'
2024-02-12T18:11:36,715   adding 'deepspeed/launcher/launcher_helper.py'
2024-02-12T18:11:36,717   adding 'deepspeed/launcher/multinode_runner.py'
2024-02-12T18:11:36,719   adding 'deepspeed/launcher/runner.py'
2024-02-12T18:11:36,721   adding 'deepspeed/model_implementations/__init__.py'
2024-02-12T18:11:36,723   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-02-12T18:11:36,724   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-02-12T18:11:36,725   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-02-12T18:11:36,727   adding 'deepspeed/model_implementations/features/__init__.py'
2024-02-12T18:11:36,728   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-02-12T18:11:36,730   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-02-12T18:11:36,731   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-02-12T18:11:36,732   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-02-12T18:11:36,733   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-02-12T18:11:36,735   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-02-12T18:11:36,736   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-02-12T18:11:36,737   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-02-12T18:11:36,738   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-02-12T18:11:36,740   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-02-12T18:11:36,742   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-02-12T18:11:36,743   adding 'deepspeed/module_inject/__init__.py'
2024-02-12T18:11:36,746   adding 'deepspeed/module_inject/auto_tp.py'
2024-02-12T18:11:36,748   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-02-12T18:11:36,749   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-02-12T18:11:36,751   adding 'deepspeed/module_inject/inject.py'
2024-02-12T18:11:36,753   adding 'deepspeed/module_inject/layers.py'
2024-02-12T18:11:36,755   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-02-12T18:11:36,756   adding 'deepspeed/module_inject/module_quantize.py'
2024-02-12T18:11:36,758   adding 'deepspeed/module_inject/policy.py'
2024-02-12T18:11:36,762   adding 'deepspeed/module_inject/replace_module.py'
2024-02-12T18:11:36,763   adding 'deepspeed/module_inject/replace_policy.py'
2024-02-12T18:11:36,765   adding 'deepspeed/module_inject/tp_shard.py'
2024-02-12T18:11:36,766   adding 'deepspeed/module_inject/utils.py'
2024-02-12T18:11:36,768   adding 'deepspeed/module_inject/containers/__init__.py'
2024-02-12T18:11:36,770   adding 'deepspeed/module_inject/containers/base.py'
2024-02-12T18:11:36,771   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-02-12T18:11:36,773   adding 'deepspeed/module_inject/containers/bert.py'
2024-02-12T18:11:36,774   adding 'deepspeed/module_inject/containers/bloom.py'
2024-02-12T18:11:36,776   adding 'deepspeed/module_inject/containers/clip.py'
2024-02-12T18:11:36,777   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-02-12T18:11:36,778   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-02-12T18:11:36,779   adding 'deepspeed/module_inject/containers/gptj.py'
2024-02-12T18:11:36,781   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-02-12T18:11:36,782   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-02-12T18:11:36,784   adding 'deepspeed/module_inject/containers/internlm.py'
2024-02-12T18:11:36,786   adding 'deepspeed/module_inject/containers/llama.py'
2024-02-12T18:11:36,787   adding 'deepspeed/module_inject/containers/llama2.py'
2024-02-12T18:11:36,789   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-02-12T18:11:36,790   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-02-12T18:11:36,792   adding 'deepspeed/module_inject/containers/opt.py'
2024-02-12T18:11:36,793   adding 'deepspeed/module_inject/containers/unet.py'
2024-02-12T18:11:36,794   adding 'deepspeed/module_inject/containers/vae.py'
2024-02-12T18:11:36,796   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-02-12T18:11:36,797   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-02-12T18:11:36,799   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-02-12T18:11:36,800   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-02-12T18:11:36,801   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-02-12T18:11:36,803   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-02-12T18:11:36,805   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-02-12T18:11:36,807   adding 'deepspeed/moe/__init__.py'
2024-02-12T18:11:36,808   adding 'deepspeed/moe/experts.py'
2024-02-12T18:11:36,809   adding 'deepspeed/moe/layer.py'
2024-02-12T18:11:36,811   adding 'deepspeed/moe/mappings.py'
2024-02-12T18:11:36,813   adding 'deepspeed/moe/sharded_moe.py'
2024-02-12T18:11:36,815   adding 'deepspeed/moe/utils.py'
2024-02-12T18:11:36,817   adding 'deepspeed/monitor/__init__.py'
2024-02-12T18:11:36,818   adding 'deepspeed/monitor/config.py'
2024-02-12T18:11:36,819   adding 'deepspeed/monitor/csv_monitor.py'
2024-02-12T18:11:36,820   adding 'deepspeed/monitor/monitor.py'
2024-02-12T18:11:36,822   adding 'deepspeed/monitor/tensorboard.py'
2024-02-12T18:11:36,823   adding 'deepspeed/monitor/utils.py'
2024-02-12T18:11:36,824   adding 'deepspeed/monitor/wandb.py'
2024-02-12T18:11:36,826   adding 'deepspeed/nebula/__init__.py'
2024-02-12T18:11:36,827   adding 'deepspeed/nebula/config.py'
2024-02-12T18:11:36,828   adding 'deepspeed/nebula/constants.py'
2024-02-12T18:11:36,830   adding 'deepspeed/ops/__init__.py'
2024-02-12T18:11:36,832   adding 'deepspeed/ops/adagrad/__init__.py'
2024-02-12T18:11:36,833   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-02-12T18:11:36,835   adding 'deepspeed/ops/adam/__init__.py'
2024-02-12T18:11:36,837   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-02-12T18:11:36,838   adding 'deepspeed/ops/adam/fused_adam.py'
2024-02-12T18:11:36,840   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-02-12T18:11:36,841   adding 'deepspeed/ops/aio/__init__.py'
2024-02-12T18:11:36,844   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-02-12T18:11:36,846   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-02-12T18:11:36,847   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-02-12T18:11:36,848   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-02-12T18:11:36,850   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-02-12T18:11:36,851   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-02-12T18:11:36,854   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-02-12T18:11:36,855   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-02-12T18:11:36,857   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-02-12T18:11:36,858   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-02-12T18:11:36,859   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-02-12T18:11:36,860   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-02-12T18:11:36,862   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-02-12T18:11:36,863   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-02-12T18:11:36,864   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-02-12T18:11:36,865   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-02-12T18:11:36,867   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-02-12T18:11:36,868   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-02-12T18:11:36,869   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-02-12T18:11:36,871   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-02-12T18:11:36,872   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-02-12T18:11:36,873   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-02-12T18:11:36,875   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-02-12T18:11:36,876   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-02-12T18:11:36,878   adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu'
2024-02-12T18:11:36,880   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-02-12T18:11:36,883   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-02-12T18:11:36,885   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-02-12T18:11:36,887   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-02-12T18:11:36,889   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-02-12T18:11:36,890   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-02-12T18:11:36,892   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-02-12T18:11:36,900   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-02-12T18:11:36,905   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-02-12T18:11:36,907   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-02-12T18:11:36,910   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-02-12T18:11:36,911   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-02-12T18:11:36,913   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-02-12T18:11:36,915   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-02-12T18:11:36,917   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-02-12T18:11:36,920   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-02-12T18:11:36,922   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-02-12T18:11:36,924   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-02-12T18:11:36,926   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-02-12T18:11:36,933   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-02-12T18:11:36,937   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-02-12T18:11:36,938   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-02-12T18:11:36,942   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-02-12T18:11:36,946   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-02-12T18:11:36,949   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-02-12T18:11:36,951   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-02-12T18:11:36,953   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-02-12T18:11:36,955   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-02-12T18:11:36,956   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-02-12T18:11:36,958   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-02-12T18:11:36,960   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-02-12T18:11:36,961   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-02-12T18:11:36,962   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-02-12T18:11:36,963   adding 'deepspeed/ops/csrc/includes/context.h'
2024-02-12T18:11:36,965   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-02-12T18:11:36,967   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-02-12T18:11:36,968   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-02-12T18:11:36,970   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-02-12T18:11:36,971   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-02-12T18:11:36,973   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-02-12T18:11:36,974   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-02-12T18:11:36,976   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-02-12T18:11:36,977   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-02-12T18:11:36,978   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-02-12T18:11:36,980   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-02-12T18:11:36,981   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-02-12T18:11:36,982   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-02-12T18:11:36,983   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-02-12T18:11:36,986   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-02-12T18:11:36,987   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-02-12T18:11:36,989   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-02-12T18:11:36,991   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-02-12T18:11:36,992   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-02-12T18:11:36,995   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-02-12T18:11:36,996   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-02-12T18:11:36,998   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-02-12T18:11:36,999   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-02-12T18:11:37,001   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-02-12T18:11:37,002   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-02-12T18:11:37,005   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-02-12T18:11:37,006   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-02-12T18:11:37,008   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-02-12T18:11:37,009   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-02-12T18:11:37,011   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-02-12T18:11:37,012   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-02-12T18:11:37,014   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-02-12T18:11:37,017   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-02-12T18:11:37,019   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-02-12T18:11:37,020   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-02-12T18:11:37,022   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-02-12T18:11:37,023   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-02-12T18:11:37,025   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-02-12T18:11:37,027   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-02-12T18:11:37,028   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-02-12T18:11:37,029   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-02-12T18:11:37,031   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-02-12T18:11:37,033   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-02-12T18:11:37,035   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-02-12T18:11:37,036   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-02-12T18:11:37,038   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-02-12T18:11:37,040   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-02-12T18:11:37,043   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-02-12T18:11:37,046   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-02-12T18:11:37,048   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-02-12T18:11:37,050   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-02-12T18:11:37,054   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-02-12T18:11:37,057   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-02-12T18:11:37,059   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-02-12T18:11:37,062   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-02-12T18:11:37,063   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-02-12T18:11:37,066   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-02-12T18:11:37,068   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-02-12T18:11:37,070   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-02-12T18:11:37,075   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-02-12T18:11:37,077   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-02-12T18:11:37,078   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-02-12T18:11:37,081   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-02-12T18:11:37,084   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-02-12T18:11:37,086   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-02-12T18:11:37,088   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-02-12T18:11:37,089   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-02-12T18:11:37,091   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-02-12T18:11:37,093   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-02-12T18:11:37,095   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam.cpp'
2024-02-12T18:11:37,097   adding 'deepspeed/ops/csrc/xpu/adam/cpu_adam_impl.cpp'
2024-02-12T18:11:37,098   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-02-12T18:11:37,099   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-02-12T18:11:37,101   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-02-12T18:11:37,103   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-02-12T18:11:37,104   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-02-12T18:11:37,106   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-02-12T18:11:37,107   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-02-12T18:11:37,109   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-02-12T18:11:37,110   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-02-12T18:11:37,112   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-02-12T18:11:37,113   adding 'deepspeed/ops/lamb/__init__.py'
2024-02-12T18:11:37,115   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-02-12T18:11:37,117   adding 'deepspeed/ops/lion/__init__.py'
2024-02-12T18:11:37,118   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-02-12T18:11:37,120   adding 'deepspeed/ops/lion/fused_lion.py'
2024-02-12T18:11:37,121   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-02-12T18:11:37,123   adding 'deepspeed/ops/op_builder/__init__.py'
2024-02-12T18:11:37,124   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-02-12T18:11:37,125   adding 'deepspeed/ops/op_builder/async_io.py'
2024-02-12T18:11:37,129   adding 'deepspeed/ops/op_builder/builder.py'
2024-02-12T18:11:37,130   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-02-12T18:11:37,131   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-02-12T18:11:37,132   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-02-12T18:11:37,134   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-02-12T18:11:37,135   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-02-12T18:11:37,136   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-02-12T18:11:37,137   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-02-12T18:11:37,139   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-02-12T18:11:37,140   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-02-12T18:11:37,141   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-02-12T18:11:37,143   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-02-12T18:11:37,144   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-02-12T18:11:37,145   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-02-12T18:11:37,146   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-02-12T18:11:37,148   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-02-12T18:11:37,149   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-02-12T18:11:37,150   adding 'deepspeed/ops/op_builder/transformer.py'
2024-02-12T18:11:37,151   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-02-12T18:11:37,153   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-02-12T18:11:37,154   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-02-12T18:11:37,156   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-02-12T18:11:37,157   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-02-12T18:11:37,158   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-02-12T18:11:37,159   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-02-12T18:11:37,161   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-02-12T18:11:37,162   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-02-12T18:11:37,163   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-02-12T18:11:37,164   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-02-12T18:11:37,165   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-02-12T18:11:37,167   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-02-12T18:11:37,168   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-02-12T18:11:37,170   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-02-12T18:11:37,171   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-02-12T18:11:37,172   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-02-12T18:11:37,173   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-02-12T18:11:37,175   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-02-12T18:11:37,177   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-02-12T18:11:37,178   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-02-12T18:11:37,180   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-02-12T18:11:37,181   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-02-12T18:11:37,182   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-02-12T18:11:37,184   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-02-12T18:11:37,185   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-02-12T18:11:37,186   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-02-12T18:11:37,188   adding 'deepspeed/ops/quantizer/__init__.py'
2024-02-12T18:11:37,189   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-02-12T18:11:37,191   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-02-12T18:11:37,192   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-02-12T18:11:37,194   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-02-12T18:11:37,195   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-02-12T18:11:37,199   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-02-12T18:11:37,201   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-02-12T18:11:37,203   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-02-12T18:11:37,204   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-02-12T18:11:37,207   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-02-12T18:11:37,209   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-02-12T18:11:37,211   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-02-12T18:11:37,212   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-02-12T18:11:37,213   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-02-12T18:11:37,215   adding 'deepspeed/ops/transformer/__init__.py'
2024-02-12T18:11:37,217   adding 'deepspeed/ops/transformer/transformer.py'
2024-02-12T18:11:37,219   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-02-12T18:11:37,221   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-02-12T18:11:37,222   adding 'deepspeed/ops/transformer/inference/config.py'
2024-02-12T18:11:37,223   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-02-12T18:11:37,225   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-02-12T18:11:37,226   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-02-12T18:11:37,228   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-02-12T18:11:37,230   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-02-12T18:11:37,232   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-02-12T18:11:37,234   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-02-12T18:11:37,236   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-02-12T18:11:37,237   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-02-12T18:11:37,238   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-02-12T18:11:37,239   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-02-12T18:11:37,241   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-02-12T18:11:37,242   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-02-12T18:11:37,244   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-02-12T18:11:37,245   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-02-12T18:11:37,246   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-02-12T18:11:37,247   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-02-12T18:11:37,249   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-02-12T18:11:37,251   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-02-12T18:11:37,253   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-02-12T18:11:37,254   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-02-12T18:11:37,256   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-02-12T18:11:37,258   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-02-12T18:11:37,259   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-02-12T18:11:37,260   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-02-12T18:11:37,262   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-02-12T18:11:37,264   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-02-12T18:11:37,265   adding 'deepspeed/pipe/__init__.py'
2024-02-12T18:11:37,267   adding 'deepspeed/profiling/__init__.py'
2024-02-12T18:11:37,268   adding 'deepspeed/profiling/config.py'
2024-02-12T18:11:37,269   adding 'deepspeed/profiling/constants.py'
2024-02-12T18:11:37,271   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-02-12T18:11:37,276   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-02-12T18:11:37,278   adding 'deepspeed/runtime/__init__.py'
2024-02-12T18:11:37,281   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-02-12T18:11:37,282   adding 'deepspeed/runtime/compiler.py'
2024-02-12T18:11:37,286   adding 'deepspeed/runtime/config.py'
2024-02-12T18:11:37,288   adding 'deepspeed/runtime/config_utils.py'
2024-02-12T18:11:37,290   adding 'deepspeed/runtime/constants.py'
2024-02-12T18:11:37,291   adding 'deepspeed/runtime/dataloader.py'
2024-02-12T18:11:37,293   adding 'deepspeed/runtime/eigenvalue.py'
2024-02-12T18:11:37,311   adding 'deepspeed/runtime/engine.py'
2024-02-12T18:11:37,314   adding 'deepspeed/runtime/hybrid_engine.py'
2024-02-12T18:11:37,317   adding 'deepspeed/runtime/lr_schedules.py'
2024-02-12T18:11:37,319   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-02-12T18:11:37,321   adding 'deepspeed/runtime/quantize.py'
2024-02-12T18:11:37,322   adding 'deepspeed/runtime/sparse_tensor.py'
2024-02-12T18:11:37,324   adding 'deepspeed/runtime/state_dict_factory.py'
2024-02-12T18:11:37,329   adding 'deepspeed/runtime/utils.py'
2024-02-12T18:11:37,331   adding 'deepspeed/runtime/weight_quantizer.py'
2024-02-12T18:11:37,332   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-02-12T18:11:37,337   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-02-12T18:11:37,339   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-02-12T18:11:37,341   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-02-12T18:11:37,342   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-02-12T18:11:37,344   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-02-12T18:11:37,345   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-02-12T18:11:37,348   adding 'deepspeed/runtime/comm/__init__.py'
2024-02-12T18:11:37,350   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-02-12T18:11:37,352   adding 'deepspeed/runtime/comm/hccl.py'
2024-02-12T18:11:37,354   adding 'deepspeed/runtime/comm/mpi.py'
2024-02-12T18:11:37,356   adding 'deepspeed/runtime/comm/nccl.py'
2024-02-12T18:11:37,359   adding 'deepspeed/runtime/compression/__init__.py'
2024-02-12T18:11:37,361   adding 'deepspeed/runtime/compression/cupy.py'
2024-02-12T18:11:37,364   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-02-12T18:11:37,366   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-02-12T18:11:37,368   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-02-12T18:11:37,370   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-02-12T18:11:37,371   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-02-12T18:11:37,373   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-02-12T18:11:37,374   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-02-12T18:11:37,375   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-02-12T18:11:37,377   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-02-12T18:11:37,378   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-02-12T18:11:37,381   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-02-12T18:11:37,383   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-02-12T18:11:37,386   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-02-12T18:11:37,387   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-02-12T18:11:37,389   adding 'deepspeed/runtime/fp16/__init__.py'
2024-02-12T18:11:37,392   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-02-12T18:11:37,394   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-02-12T18:11:37,396   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-02-12T18:11:37,398   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-02-12T18:11:37,400   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-02-12T18:11:37,403   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-02-12T18:11:37,405   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-02-12T18:11:37,406   adding 'deepspeed/runtime/pipe/__init__.py'
2024-02-12T18:11:37,413   adding 'deepspeed/runtime/pipe/engine.py'
2024-02-12T18:11:37,416   adding 'deepspeed/runtime/pipe/module.py'
2024-02-12T18:11:37,418   adding 'deepspeed/runtime/pipe/p2p.py'
2024-02-12T18:11:37,420   adding 'deepspeed/runtime/pipe/schedule.py'
2024-02-12T18:11:37,422   adding 'deepspeed/runtime/pipe/topology.py'
2024-02-12T18:11:37,424   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-02-12T18:11:37,425   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-02-12T18:11:37,426   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-02-12T18:11:37,427   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-02-12T18:11:37,430   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-02-12T18:11:37,432   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-02-12T18:11:37,434   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-02-12T18:11:37,436   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-02-12T18:11:37,437   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-02-12T18:11:37,439   adding 'deepspeed/runtime/zero/__init__.py'
2024-02-12T18:11:37,441   adding 'deepspeed/runtime/zero/config.py'
2024-02-12T18:11:37,443   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-02-12T18:11:37,445   adding 'deepspeed/runtime/zero/linear.py'
2024-02-12T18:11:37,447   adding 'deepspeed/runtime/zero/mics.py'
2024-02-12T18:11:37,449   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-02-12T18:11:37,450   adding 'deepspeed/runtime/zero/offload_config.py'
2024-02-12T18:11:37,453   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-02-12T18:11:37,464   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-02-12T18:11:37,468   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-02-12T18:11:37,469   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-02-12T18:11:37,484   adding 'deepspeed/runtime/zero/stage3.py'
2024-02-12T18:11:37,498   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-02-12T18:11:37,500   adding 'deepspeed/runtime/zero/test.py'
2024-02-12T18:11:37,502   adding 'deepspeed/runtime/zero/tiling.py'
2024-02-12T18:11:37,504   adding 'deepspeed/runtime/zero/utils.py'
2024-02-12T18:11:37,505   adding 'deepspeed/sequence/__init__.py'
2024-02-12T18:11:37,507   adding 'deepspeed/sequence/layer.py'
2024-02-12T18:11:37,509   adding 'deepspeed/utils/__init__.py'
2024-02-12T18:11:37,510   adding 'deepspeed/utils/comms_logging.py'
2024-02-12T18:11:37,512   adding 'deepspeed/utils/debug.py'
2024-02-12T18:11:37,513   adding 'deepspeed/utils/exceptions.py'
2024-02-12T18:11:37,516   adding 'deepspeed/utils/groups.py'
2024-02-12T18:11:37,517   adding 'deepspeed/utils/init_on_device.py'
2024-02-12T18:11:37,519   adding 'deepspeed/utils/logging.py'
2024-02-12T18:11:37,520   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-02-12T18:11:37,522   adding 'deepspeed/utils/numa.py'
2024-02-12T18:11:37,523   adding 'deepspeed/utils/nvtx.py'
2024-02-12T18:11:37,525   adding 'deepspeed/utils/tensor_fragment.py'
2024-02-12T18:11:37,527   adding 'deepspeed/utils/timer.py'
2024-02-12T18:11:37,528   adding 'deepspeed/utils/types.py'
2024-02-12T18:11:37,529   adding 'deepspeed/utils/z3_leaf_module.py'
2024-02-12T18:11:37,532   adding 'deepspeed/utils/zero_to_fp32.py'
2024-02-12T18:11:37,534   adding 'deepspeed-0.13.2.data/scripts/deepspeed'
2024-02-12T18:11:37,535   adding 'deepspeed-0.13.2.data/scripts/deepspeed.pt'
2024-02-12T18:11:37,536   adding 'deepspeed-0.13.2.data/scripts/ds'
2024-02-12T18:11:37,537   adding 'deepspeed-0.13.2.data/scripts/ds_bench'
2024-02-12T18:11:37,539   adding 'deepspeed-0.13.2.data/scripts/ds_elastic'
2024-02-12T18:11:37,540   adding 'deepspeed-0.13.2.data/scripts/ds_report'
2024-02-12T18:11:37,541   adding 'deepspeed-0.13.2.data/scripts/ds_ssh'
2024-02-12T18:11:37,542   adding 'deepspeed-0.13.2.data/scripts/dsr'
2024-02-12T18:11:37,547   adding 'deepspeed-0.13.2.dist-info/METADATA'
2024-02-12T18:11:37,548   adding 'deepspeed-0.13.2.dist-info/WHEEL'
2024-02-12T18:11:37,549   adding 'deepspeed-0.13.2.dist-info/entry_points.txt'
2024-02-12T18:11:37,550   adding 'deepspeed-0.13.2.dist-info/top_level.txt'
2024-02-12T18:11:37,563   adding 'deepspeed-0.13.2.dist-info/RECORD'
2024-02-12T18:11:37,584   removing build/bdist.linux-armv7l/wheel
2024-02-12T18:11:37,764   deepspeed build time = 9.841450929641724 secs
2024-02-12T18:11:37,886   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-02-12T18:11:37,902   Created wheel for deepspeed: filename=deepspeed-0.13.2-py3-none-any.whl size=1360137 sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd
2024-02-12T18:11:37,903   Stored in directory: /tmp/pip-ephem-wheel-cache-oq0j4rd6/wheels/5d/1b/73/4e088317ef98c399022b327a67aa76111cb407b44b40cabe8a
2024-02-12T18:11:37,941 Successfully built deepspeed
2024-02-12T18:11:37,976 Removed build tracker: '/tmp/pip-build-tracker-38jckk0q'