2023-11-03T21:28:27,341 Created temporary directory: /tmp/pip-build-tracker-66zhs6wy
2023-11-03T21:28:27,342 Initialized build tracking at /tmp/pip-build-tracker-66zhs6wy
2023-11-03T21:28:27,342 Created build tracker: /tmp/pip-build-tracker-66zhs6wy
2023-11-03T21:28:27,343 Entered build tracker: /tmp/pip-build-tracker-66zhs6wy
2023-11-03T21:28:27,344 Created temporary directory: /tmp/pip-wheel-o923f756
2023-11-03T21:28:27,347 Created temporary directory: /tmp/pip-ephem-wheel-cache-wyfm4b_u
2023-11-03T21:28:27,368 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2023-11-03T21:28:27,372 2 location(s) to search for versions of deepspeed:
2023-11-03T21:28:27,372 * https://pypi.org/simple/deepspeed/
2023-11-03T21:28:27,372 * https://www.piwheels.org/simple/deepspeed/
2023-11-03T21:28:27,373 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2023-11-03T21:28:27,374 Getting page https://pypi.org/simple/deepspeed/
2023-11-03T21:28:27,375 Found index url https://pypi.org/simple/
2023-11-03T21:28:27,599 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2023-11-03T21:28:27,613   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-11-03T21:28:27,614   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2023-11-03T21:28:27,614   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-11-03T21:28:27,615   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2023-11-03T21:28:27,616   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-11-03T21:28:27,616   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2023-11-03T21:28:27,617   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-11-03T21:28:27,618   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2023-11-03T21:28:27,618   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2023-11-03T21:28:27,619   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2023-11-03T21:28:27,620   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2023-11-03T21:28:27,620   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2023-11-03T21:28:27,621   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2023-11-03T21:28:27,622   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2023-11-03T21:28:27,623   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2023-11-03T21:28:27,623   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2023-11-03T21:28:27,624   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2023-11-03T21:28:27,625   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2023-11-03T21:28:27,625   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2023-11-03T21:28:27,626   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2023-11-03T21:28:27,626   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2023-11-03T21:28:27,627   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2023-11-03T21:28:27,628   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2023-11-03T21:28:27,629   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2023-11-03T21:28:27,629   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2023-11-03T21:28:27,630   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2023-11-03T21:28:27,631   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2023-11-03T21:28:27,631   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2023-11-03T21:28:27,632   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2023-11-03T21:28:27,633   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2023-11-03T21:28:27,633   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2023-11-03T21:28:27,634   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2023-11-03T21:28:27,635   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2023-11-03T21:28:27,635   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2023-11-03T21:28:27,636   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2023-11-03T21:28:27,637   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2023-11-03T21:28:27,637   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2023-11-03T21:28:27,638   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2023-11-03T21:28:27,638   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2023-11-03T21:28:27,639   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2023-11-03T21:28:27,640   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2023-11-03T21:28:27,640   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2023-11-03T21:28:27,641   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2023-11-03T21:28:27,642   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2023-11-03T21:28:27,642   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2023-11-03T21:28:27,643   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2023-11-03T21:28:27,644   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2023-11-03T21:28:27,644   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2023-11-03T21:28:27,645   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2023-11-03T21:28:27,646   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2023-11-03T21:28:27,647   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2023-11-03T21:28:27,647   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2023-11-03T21:28:27,648   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2023-11-03T21:28:27,649   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2023-11-03T21:28:27,649   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2023-11-03T21:28:27,650   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2023-11-03T21:28:27,650   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2023-11-03T21:28:27,651   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2023-11-03T21:28:27,651   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2023-11-03T21:28:27,652   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2023-11-03T21:28:27,653   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2023-11-03T21:28:27,653   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2023-11-03T21:28:27,654   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2023-11-03T21:28:27,655   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2023-11-03T21:28:27,655   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2023-11-03T21:28:27,656   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2023-11-03T21:28:27,657   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2023-11-03T21:28:27,658   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2023-11-03T21:28:27,659   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2023-11-03T21:28:27,659   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2023-11-03T21:28:27,660   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2023-11-03T21:28:27,660   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2023-11-03T21:28:27,661   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2023-11-03T21:28:27,661   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2023-11-03T21:28:27,662   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2023-11-03T21:28:27,662   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2023-11-03T21:28:27,663   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2023-11-03T21:28:27,663   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2023-11-03T21:28:27,664 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2023-11-03T21:28:27,665 Getting page https://www.piwheels.org/simple/deepspeed/
2023-11-03T21:28:27,666 Found index url https://www.piwheels.org/simple/
2023-11-03T21:28:27,834 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2023-11-03T21:28:27,846   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,847   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,848   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,848   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,849   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,849   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,850   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,851   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,851   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,852   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,852   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,853   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,853   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,854   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,854   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,855   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,855   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,856   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,856   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,857   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,858   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,858   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,859   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,859   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,859   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,860   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,860   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,861   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,861   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,862   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,862   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,863   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,863   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,864   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,865   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,865   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,866   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,866   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,867   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,867   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,867   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,868   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,869   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,869   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,869   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,870   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,870   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,871   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2023-11-03T21:28:27,872 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2023-11-03T21:28:27,872 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2023-11-03T21:28:27,899 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2023-11-03T21:28:27,917 Collecting deepspeed==0.11.2
2023-11-03T21:28:27,920   Created temporary directory: /tmp/pip-unpack-cs6lcg59
2023-11-03T21:28:28,167   Downloading deepspeed-0.11.2.tar.gz (1.1 MB)
2023-11-03T21:28:29,753   Added deepspeed==0.11.2 from https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz to build tracker '/tmp/pip-build-tracker-66zhs6wy'
2023-11-03T21:28:29,755   Running setup.py (path:/tmp/pip-wheel-o923f756/deepspeed_2d1e9c7f2afc4415a8dbeaa0b157d5ee/setup.py) egg_info for package deepspeed
2023-11-03T21:28:29,756   Created temporary directory: /tmp/pip-pip-egg-info-5nx9q84g
2023-11-03T21:28:29,756   Preparing metadata (setup.py): started
2023-11-03T21:28:29,757   Running command python setup.py egg_info
2023-11-03T21:28:30,542   fatal: not a git repository (or any of the parent directories): .git
2023-11-03T21:28:31,180   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2023-11-03T21:28:31,180    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2023-11-03T21:28:31,181   DS_BUILD_OPS=0
2023-11-03T21:28:31,181    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2023-11-03T21:28:31,182    [WARNING]  async_io: please install the libaio-dev package with apt
2023-11-03T21:28:31,182    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2023-11-03T21:28:31,183    [WARNING]  Please install torch if trying to pre-compile kernels
2023-11-03T21:28:31,183    [WARNING]  unable to import torch, please install it first
2023-11-03T21:28:31,184    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T21:28:31,184    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T21:28:31,185   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False}
2023-11-03T21:28:31,185   version=0.11.2, git_hash=unknown, git_branch=unknown
2023-11-03T21:28:31,186   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2023-11-03T21:28:31,187   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False}
2023-11-03T21:28:31,187   ext_modules=[]
2023-11-03T21:28:31,188   running egg_info
2023-11-03T21:28:31,188   creating /tmp/pip-pip-egg-info-5nx9q84g/deepspeed.egg-info
2023-11-03T21:28:31,207   writing /tmp/pip-pip-egg-info-5nx9q84g/deepspeed.egg-info/PKG-INFO
2023-11-03T21:28:31,238   writing dependency_links to /tmp/pip-pip-egg-info-5nx9q84g/deepspeed.egg-info/dependency_links.txt
2023-11-03T21:28:31,240   writing entry points to /tmp/pip-pip-egg-info-5nx9q84g/deepspeed.egg-info/entry_points.txt
2023-11-03T21:28:31,255   writing requirements to /tmp/pip-pip-egg-info-5nx9q84g/deepspeed.egg-info/requires.txt
2023-11-03T21:28:31,257   writing top-level names to /tmp/pip-pip-egg-info-5nx9q84g/deepspeed.egg-info/top_level.txt
2023-11-03T21:28:31,258   writing manifest file '/tmp/pip-pip-egg-info-5nx9q84g/deepspeed.egg-info/SOURCES.txt'
2023-11-03T21:28:31,395   reading manifest file '/tmp/pip-pip-egg-info-5nx9q84g/deepspeed.egg-info/SOURCES.txt'
2023-11-03T21:28:31,396   reading manifest template 'MANIFEST.in'
2023-11-03T21:28:32,067   warning: no files found matching '*.hip' under directory 'deepspeed'
2023-11-03T21:28:32,567   warning: no files found matching '*.cc' under directory 'deepspeed'
2023-11-03T21:28:32,951   warning: no files found matching '*.tr' under directory 'csrc'
2023-11-03T21:28:33,041   warning: no files found matching '*.cc' under directory 'csrc'
2023-11-03T21:28:33,060   warning: no files found matching '*.py' under directory 'benchmarks'
2023-11-03T21:28:33,085   writing manifest file '/tmp/pip-pip-egg-info-5nx9q84g/deepspeed.egg-info/SOURCES.txt'
2023-11-03T21:28:33,087   deepspeed build time = 2.541538715362549 secs
2023-11-03T21:28:33,201   Preparing metadata (setup.py): finished with status 'done'
2023-11-03T21:28:33,206   Source in /tmp/pip-wheel-o923f756/deepspeed_2d1e9c7f2afc4415a8dbeaa0b157d5ee has version 0.11.2, which satisfies requirement deepspeed==0.11.2 from https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz
2023-11-03T21:28:33,207   Removed deepspeed==0.11.2 from https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz from build tracker '/tmp/pip-build-tracker-66zhs6wy'
2023-11-03T21:28:33,215 Created temporary directory: /tmp/pip-unpack-k160d0m_
2023-11-03T21:28:33,216 Created temporary directory: /tmp/pip-unpack-kbvrcq0i
2023-11-03T21:28:33,453 Building wheels for collected packages: deepspeed
2023-11-03T21:28:33,457   Created temporary directory: /tmp/pip-wheel-evc0d1nl
2023-11-03T21:28:33,458   Building wheel for deepspeed (setup.py): started
2023-11-03T21:28:33,459   Destination directory: /tmp/pip-wheel-evc0d1nl
2023-11-03T21:28:33,459   Running command python setup.py bdist_wheel
2023-11-03T21:28:33,902   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2023-11-03T21:28:33,910    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2023-11-03T21:28:33,957   DS_BUILD_OPS=0
2023-11-03T21:28:34,068    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2023-11-03T21:28:34,125    [WARNING]  async_io: please install the libaio-dev package with apt
2023-11-03T21:28:34,126    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2023-11-03T21:28:34,126    [WARNING]  Please install torch if trying to pre-compile kernels
2023-11-03T21:28:34,127    [WARNING]  unable to import torch, please install it first
2023-11-03T21:28:34,128    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T21:28:34,128    [WARNING]  Please install torch if trying to pre-compile inference kernels
2023-11-03T21:28:34,129   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'quantizer': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False}
2023-11-03T21:28:34,138   fatal: not a git repository (or any of the parent directories): .git
2023-11-03T21:28:34,139   version=0.11.2, git_hash=unknown, git_branch=unknown
2023-11-03T21:28:34,140   install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm']
2023-11-03T21:28:34,141   compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'quantizer': True, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False}
2023-11-03T21:28:34,141   ext_modules=[]
2023-11-03T21:28:34,750   running bdist_wheel
2023-11-03T21:28:34,846   running build
2023-11-03T21:28:34,847   running build_py
2023-11-03T21:28:34,874   creating build
2023-11-03T21:28:34,874   creating build/lib
2023-11-03T21:28:34,875   creating build/lib/deepspeed
2023-11-03T21:28:34,876   copying deepspeed/constants.py -> build/lib/deepspeed
2023-11-03T21:28:34,878   copying deepspeed/__init__.py -> build/lib/deepspeed
2023-11-03T21:28:34,880   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2023-11-03T21:28:34,882   copying deepspeed/env_report.py -> build/lib/deepspeed
2023-11-03T21:28:34,884   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2023-11-03T21:28:34,885   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2023-11-03T21:28:34,887   creating build/lib/deepspeed/inference
2023-11-03T21:28:34,888   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2023-11-03T21:28:34,890   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2023-11-03T21:28:34,893   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2023-11-03T21:28:34,895   creating build/lib/deepspeed/monitor
2023-11-03T21:28:34,896   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2023-11-03T21:28:34,898   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2023-11-03T21:28:34,900   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2023-11-03T21:28:34,901   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2023-11-03T21:28:34,903   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2023-11-03T21:28:34,905   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2023-11-03T21:28:34,906   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2023-11-03T21:28:34,909   creating build/lib/deepspeed/moe
2023-11-03T21:28:34,910   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2023-11-03T21:28:34,911   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2023-11-03T21:28:34,913   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2023-11-03T21:28:34,915   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2023-11-03T21:28:34,917   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2023-11-03T21:28:34,920   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2023-11-03T21:28:34,922   creating build/lib/deepspeed/sequence
2023-11-03T21:28:34,923   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2023-11-03T21:28:34,925   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2023-11-03T21:28:34,927   creating build/lib/deepspeed/autotuning
2023-11-03T21:28:34,928   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2023-11-03T21:28:34,930   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2023-11-03T21:28:34,932   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2023-11-03T21:28:34,935   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2023-11-03T21:28:34,938   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2023-11-03T21:28:34,940   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2023-11-03T21:28:34,943   creating build/lib/deepspeed/launcher
2023-11-03T21:28:34,944   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2023-11-03T21:28:34,946   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2023-11-03T21:28:34,948   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2023-11-03T21:28:34,951   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2023-11-03T21:28:34,954   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2023-11-03T21:28:34,957   creating build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,959   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,961   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,962   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,964   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,967   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,969   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,971   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,973   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,976   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,978   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2023-11-03T21:28:34,981   creating build/lib/deepspeed/compression
2023-11-03T21:28:34,982   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2023-11-03T21:28:34,984   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2023-11-03T21:28:34,986   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2023-11-03T21:28:34,988   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2023-11-03T21:28:34,991   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2023-11-03T21:28:34,993   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2023-11-03T21:28:34,996   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2023-11-03T21:28:34,999   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2023-11-03T21:28:35,002   creating build/lib/deepspeed/accelerator
2023-11-03T21:28:35,004   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2023-11-03T21:28:35,006   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T21:28:35,008   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T21:28:35,010   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T21:28:35,013   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T21:28:35,015   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T21:28:35,018   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2023-11-03T21:28:35,020   creating build/lib/deepspeed/model_implementations
2023-11-03T21:28:35,021   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2023-11-03T21:28:35,024   creating build/lib/deepspeed/utils
2023-11-03T21:28:35,025   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,027   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,029   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,032   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,034   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,036   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,038   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,040   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,042   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,045   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,048   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,050   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,053   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,055   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2023-11-03T21:28:35,057   creating build/lib/deepspeed/ops
2023-11-03T21:28:35,058   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2023-11-03T21:28:35,061   creating build/lib/deepspeed/comm
2023-11-03T21:28:35,062   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2023-11-03T21:28:35,064   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2023-11-03T21:28:35,067   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2023-11-03T21:28:35,069   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2023-11-03T21:28:35,071   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2023-11-03T21:28:35,073   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2023-11-03T21:28:35,075   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2023-11-03T21:28:35,077   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2023-11-03T21:28:35,079   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2023-11-03T21:28:35,082   creating build/lib/deepspeed/module_inject
2023-11-03T21:28:35,083   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,085   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,087   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,089   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,091   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,093   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,096   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,098   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,101   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,103   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,106   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,107   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,110   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2023-11-03T21:28:35,113   creating build/lib/deepspeed/pipe
2023-11-03T21:28:35,114   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2023-11-03T21:28:35,117   creating build/lib/deepspeed/runtime
2023-11-03T21:28:35,118   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,121   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,123   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,126   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,128   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,130   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,132   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,135   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,138   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,141   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,143   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,149   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,152   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,155   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,157   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,160   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2023-11-03T21:28:35,167   creating build/lib/deepspeed/elasticity
2023-11-03T21:28:35,168   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2023-11-03T21:28:35,170   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2023-11-03T21:28:35,172   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2023-11-03T21:28:35,174   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2023-11-03T21:28:35,177   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2023-11-03T21:28:35,179   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2023-11-03T21:28:35,182   creating build/lib/deepspeed/profiling
2023-11-03T21:28:35,183   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2023-11-03T21:28:35,185   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2023-11-03T21:28:35,187   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2023-11-03T21:28:35,189   creating build/lib/deepspeed/nebula
2023-11-03T21:28:35,190   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2023-11-03T21:28:35,193   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2023-11-03T21:28:35,195   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2023-11-03T21:28:35,197   creating build/lib/deepspeed/inference/quantization
2023-11-03T21:28:35,198   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2023-11-03T21:28:35,201   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2023-11-03T21:28:35,203   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2023-11-03T21:28:35,206   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2023-11-03T21:28:35,208   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2023-11-03T21:28:35,210   creating build/lib/deepspeed/autotuning/tuner
2023-11-03T21:28:35,212   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T21:28:35,214   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T21:28:35,216   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T21:28:35,218   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T21:28:35,220   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T21:28:35,222   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2023-11-03T21:28:35,225   creating build/lib/deepspeed/model_implementations/features
2023-11-03T21:28:35,226   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2023-11-03T21:28:35,228   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2023-11-03T21:28:35,231   creating build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,232   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,234   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,236   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,238   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,239   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,241   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,242   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,244   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,245   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,247   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2023-11-03T21:28:35,249   creating build/lib/deepspeed/model_implementations/diffusers
2023-11-03T21:28:35,250   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2023-11-03T21:28:35,251   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2023-11-03T21:28:35,253   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2023-11-03T21:28:35,255   creating build/lib/deepspeed/ops/lion
2023-11-03T21:28:35,256   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2023-11-03T21:28:35,258   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2023-11-03T21:28:35,260   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2023-11-03T21:28:35,262   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2023-11-03T21:28:35,264   creating build/lib/deepspeed/ops/random_ltd
2023-11-03T21:28:35,265   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2023-11-03T21:28:35,267   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2023-11-03T21:28:35,269   creating build/lib/deepspeed/ops/deepspeed4science
2023-11-03T21:28:35,270   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2023-11-03T21:28:35,272   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2023-11-03T21:28:35,274   creating build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,275   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,277   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,279   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,280   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,282   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,284   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,285   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,287   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,289   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,290   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,292   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,294   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,296   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,298   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,299   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,301   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,302   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,304   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2023-11-03T21:28:35,306   creating build/lib/deepspeed/ops/lamb
2023-11-03T21:28:35,307   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2023-11-03T21:28:35,308   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2023-11-03T21:28:35,311   creating build/lib/deepspeed/ops/adam
2023-11-03T21:28:35,311   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2023-11-03T21:28:35,313   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2023-11-03T21:28:35,315   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2023-11-03T21:28:35,317   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2023-11-03T21:28:35,319   creating build/lib/deepspeed/ops/transformer
2023-11-03T21:28:35,320   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2023-11-03T21:28:35,321   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2023-11-03T21:28:35,324   creating build/lib/deepspeed/ops/adagrad
2023-11-03T21:28:35,325   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2023-11-03T21:28:35,327   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2023-11-03T21:28:35,329   creating build/lib/deepspeed/ops/sparse_attention
2023-11-03T21:28:35,330   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T21:28:35,332   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T21:28:35,334   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T21:28:35,336   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T21:28:35,339   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T21:28:35,341   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T21:28:35,344   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2023-11-03T21:28:35,346   creating build/lib/deepspeed/ops/quantizer
2023-11-03T21:28:35,347   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2023-11-03T21:28:35,350   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2023-11-03T21:28:35,352   creating build/lib/deepspeed/ops/aio
2023-11-03T21:28:35,353   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2023-11-03T21:28:35,355   creating build/lib/deepspeed/ops/op_builder/npu
2023-11-03T21:28:35,356   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2023-11-03T21:28:35,358   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2023-11-03T21:28:35,360   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2023-11-03T21:28:35,361   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2023-11-03T21:28:35,363   creating build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:35,364   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:35,366   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:35,368   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:35,369   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:35,370   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:35,372   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:35,374   creating build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,375   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,377   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,379   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,381   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,382   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,384   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,386   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,389   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,391   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,393   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2023-11-03T21:28:35,396   creating build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,397   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,398   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,400   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,402   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,404   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,407   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,409   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,411   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,413   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,415   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:35,417   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,418   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,420   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,422   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,423   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,425   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,426   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,428   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,429   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,431   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,433   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:35,435   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2023-11-03T21:28:35,436   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-11-03T21:28:35,439   creating build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,439   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,441   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,443   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,445   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,446   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,449   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,451   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,453   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,455   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,457   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,459   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,461   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,464   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,465   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,467   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,469   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,471   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,474   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,476   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2023-11-03T21:28:35,478   creating build/lib/deepspeed/module_inject/containers/features
2023-11-03T21:28:35,479   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T21:28:35,481   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T21:28:35,483   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T21:28:35,485   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T21:28:35,487   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T21:28:35,488   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T21:28:35,490   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2023-11-03T21:28:35,493   creating build/lib/deepspeed/runtime/data_pipeline
2023-11-03T21:28:35,493   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2023-11-03T21:28:35,496   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2023-11-03T21:28:35,497   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2023-11-03T21:28:35,499   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2023-11-03T21:28:35,502   creating build/lib/deepspeed/runtime/compression
2023-11-03T21:28:35,502   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2023-11-03T21:28:35,504   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2023-11-03T21:28:35,507   creating build/lib/deepspeed/runtime/checkpoint_engine
2023-11-03T21:28:35,507   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-11-03T21:28:35,509   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-11-03T21:28:35,511   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-11-03T21:28:35,513   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2023-11-03T21:28:35,516   creating build/lib/deepspeed/runtime/swap_tensor
2023-11-03T21:28:35,517   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T21:28:35,519   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T21:28:35,520   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T21:28:35,523   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T21:28:35,525   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T21:28:35,527   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T21:28:35,529   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T21:28:35,531   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T21:28:35,533   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2023-11-03T21:28:35,535   creating build/lib/deepspeed/runtime/activation_checkpointing
2023-11-03T21:28:35,536   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2023-11-03T21:28:35,538   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2023-11-03T21:28:35,541   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2023-11-03T21:28:35,543   creating build/lib/deepspeed/runtime/comm
2023-11-03T21:28:35,544   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2023-11-03T21:28:35,546   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2023-11-03T21:28:35,548   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2023-11-03T21:28:35,550   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2023-11-03T21:28:35,552   creating build/lib/deepspeed/runtime/fp16
2023-11-03T21:28:35,553   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2023-11-03T21:28:35,555   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2023-11-03T21:28:35,558   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2023-11-03T21:28:35,560   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2023-11-03T21:28:35,563   creating build/lib/deepspeed/runtime/pipe
2023-11-03T21:28:35,564   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T21:28:35,565   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T21:28:35,568   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T21:28:35,570   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T21:28:35,572   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T21:28:35,575   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2023-11-03T21:28:35,578   creating build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,579   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,581   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,584   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,586   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,589   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,591   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,593   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,596   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,599   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,601   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,604   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,607   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,609   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,611   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,613   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,615   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2023-11-03T21:28:35,617   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:35,618   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:35,620   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:35,621   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:35,624   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:35,625   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:35,627   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:35,628   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:35,630   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:35,632   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:35,634   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:35,636   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:35,639   creating build/lib/deepspeed/runtime/fp16/onebit
2023-11-03T21:28:35,640   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-11-03T21:28:35,641   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-11-03T21:28:35,644   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-11-03T21:28:35,646   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2023-11-03T21:28:35,649   creating build/lib/deepspeed/profiling/flops_profiler
2023-11-03T21:28:35,650   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2023-11-03T21:28:35,651   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2023-11-03T21:28:35,654   running egg_info
2023-11-03T21:28:35,702   writing deepspeed.egg-info/PKG-INFO
2023-11-03T21:28:35,732   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2023-11-03T21:28:35,734   writing entry points to deepspeed.egg-info/entry_points.txt
2023-11-03T21:28:35,748   writing requirements to deepspeed.egg-info/requires.txt
2023-11-03T21:28:35,749   writing top-level names to deepspeed.egg-info/top_level.txt
2023-11-03T21:28:35,829   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2023-11-03T21:28:35,864   reading manifest template 'MANIFEST.in'
2023-11-03T21:28:36,513   warning: no files found matching '*.hip' under directory 'deepspeed'
2023-11-03T21:28:37,031   warning: no files found matching '*.cc' under directory 'deepspeed'
2023-11-03T21:28:37,422   warning: no files found matching '*.tr' under directory 'csrc'
2023-11-03T21:28:37,777   warning: no files found matching '*.cc' under directory 'csrc'
2023-11-03T21:28:37,811   warning: no files found matching '*.py' under directory 'benchmarks'
2023-11-03T21:28:37,859   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2023-11-03T21:28:37,869   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2023-11-03T21:28:37,870   !!

2023-11-03T21:28:37,871           ********************************************************************************
2023-11-03T21:28:37,872           ############################
2023-11-03T21:28:37,873           # Package would be ignored #
2023-11-03T21:28:37,873           ############################
2023-11-03T21:28:37,874           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2023-11-03T21:28:37,875           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:37,876           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:37,877           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2023-11-03T21:28:37,877           to the `packages` configuration field.

2023-11-03T21:28:37,879           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:37,879           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:37,880           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:37,881           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:37,882           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:37,883           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2023-11-03T21:28:37,884           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2023-11-03T21:28:37,884           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:37,885           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:37,885           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:37,887           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:37,888           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:37,889           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:37,890                 even if it does not contain any `.py` files.
2023-11-03T21:28:37,890                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:37,891                 directory, all directories are treated like packages.
2023-11-03T21:28:37,892           ********************************************************************************

2023-11-03T21:28:37,893   !!
2023-11-03T21:28:37,893     check.warn(importable)
2023-11-03T21:28:37,894   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2023-11-03T21:28:37,895   !!

2023-11-03T21:28:37,896           ********************************************************************************
2023-11-03T21:28:37,897           ############################
2023-11-03T21:28:37,897           # Package would be ignored #
2023-11-03T21:28:37,898           ############################
2023-11-03T21:28:37,898           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2023-11-03T21:28:37,899           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:37,900           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:37,901           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2023-11-03T21:28:37,901           to the `packages` configuration field.

2023-11-03T21:28:37,902           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:37,903           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:37,903           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:37,904           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:37,905           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:37,906           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2023-11-03T21:28:37,907           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2023-11-03T21:28:37,908           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:37,908           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:37,909           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:37,910           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:37,910           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:37,911           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:37,912                 even if it does not contain any `.py` files.
2023-11-03T21:28:37,912                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:37,913                 directory, all directories are treated like packages.
2023-11-03T21:28:37,913           ********************************************************************************

2023-11-03T21:28:37,914   !!
2023-11-03T21:28:37,914     check.warn(importable)
2023-11-03T21:28:37,914   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2023-11-03T21:28:37,915   !!

2023-11-03T21:28:37,915           ********************************************************************************
2023-11-03T21:28:37,916           ############################
2023-11-03T21:28:37,916           # Package would be ignored #
2023-11-03T21:28:37,917           ############################
2023-11-03T21:28:37,917           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2023-11-03T21:28:37,917           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:37,918           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:37,918           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2023-11-03T21:28:37,919           to the `packages` configuration field.

2023-11-03T21:28:37,920           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:37,920           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:37,921           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:37,922           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:37,922           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:37,923           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2023-11-03T21:28:37,924           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2023-11-03T21:28:37,924           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:37,925           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:37,925           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:37,926           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:37,927           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:37,928           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:37,928                 even if it does not contain any `.py` files.
2023-11-03T21:28:37,929                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:37,929                 directory, all directories are treated like packages.
2023-11-03T21:28:37,930           ********************************************************************************

2023-11-03T21:28:37,931   !!
2023-11-03T21:28:37,931     check.warn(importable)
2023-11-03T21:28:37,932   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2023-11-03T21:28:37,932   !!

2023-11-03T21:28:37,933           ********************************************************************************
2023-11-03T21:28:37,934           ############################
2023-11-03T21:28:37,934           # Package would be ignored #
2023-11-03T21:28:37,935           ############################
2023-11-03T21:28:37,935           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2023-11-03T21:28:37,935           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:37,936           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:37,936           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2023-11-03T21:28:37,936           to the `packages` configuration field.

2023-11-03T21:28:37,937           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:37,937           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:37,938           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:37,939           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:37,939           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:37,940           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2023-11-03T21:28:37,940           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2023-11-03T21:28:37,941           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:37,941           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:37,942           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:37,942           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:37,943           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:37,945           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:37,945                 even if it does not contain any `.py` files.
2023-11-03T21:28:37,945                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:37,946                 directory, all directories are treated like packages.
2023-11-03T21:28:37,946           ********************************************************************************

2023-11-03T21:28:37,947   !!
2023-11-03T21:28:37,948     check.warn(importable)
2023-11-03T21:28:37,948   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2023-11-03T21:28:37,949   !!

2023-11-03T21:28:37,949           ********************************************************************************
2023-11-03T21:28:37,950           ############################
2023-11-03T21:28:37,950           # Package would be ignored #
2023-11-03T21:28:37,951           ############################
2023-11-03T21:28:37,951           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2023-11-03T21:28:37,952           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:37,953           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:37,953           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2023-11-03T21:28:37,954           to the `packages` configuration field.

2023-11-03T21:28:37,955           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:37,955           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:37,956           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:37,957           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:37,958           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:37,959           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2023-11-03T21:28:37,960           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2023-11-03T21:28:37,960           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:37,960           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:37,961           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:37,961           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:37,962           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:37,964           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:37,964                 even if it does not contain any `.py` files.
2023-11-03T21:28:37,964                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:37,965                 directory, all directories are treated like packages.
2023-11-03T21:28:37,965           ********************************************************************************

2023-11-03T21:28:37,966   !!
2023-11-03T21:28:37,967     check.warn(importable)
2023-11-03T21:28:37,967   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2023-11-03T21:28:37,968   !!

2023-11-03T21:28:37,969           ********************************************************************************
2023-11-03T21:28:37,969           ############################
2023-11-03T21:28:37,970           # Package would be ignored #
2023-11-03T21:28:37,970           ############################
2023-11-03T21:28:37,971           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2023-11-03T21:28:37,971           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:37,972           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:37,973           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2023-11-03T21:28:37,973           to the `packages` configuration field.

2023-11-03T21:28:37,974           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:37,975           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:37,975           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:37,976           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:37,977           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:37,978           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2023-11-03T21:28:37,979           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2023-11-03T21:28:37,979           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:37,980           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:37,980           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:37,981           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:37,982           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:37,984           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:37,984                 even if it does not contain any `.py` files.
2023-11-03T21:28:37,985                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:37,985                 directory, all directories are treated like packages.
2023-11-03T21:28:37,986           ********************************************************************************

2023-11-03T21:28:37,987   !!
2023-11-03T21:28:37,987     check.warn(importable)
2023-11-03T21:28:37,987   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration.
2023-11-03T21:28:37,988   !!

2023-11-03T21:28:37,989           ********************************************************************************
2023-11-03T21:28:37,989           ############################
2023-11-03T21:28:37,989           # Package would be ignored #
2023-11-03T21:28:37,990           ############################
2023-11-03T21:28:37,990           Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1],
2023-11-03T21:28:37,990           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:37,992           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:37,992           package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added
2023-11-03T21:28:37,993           to the `packages` configuration field.

2023-11-03T21:28:37,993           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:37,994           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:37,994           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:37,995           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:37,996           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:37,997           If you don't want 'deepspeed.ops.csrc.common' to be distributed and are
2023-11-03T21:28:37,997           already explicitly excluding 'deepspeed.ops.csrc.common' via
2023-11-03T21:28:37,998           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:37,998           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:37,999           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:37,999           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,000           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,002           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,002                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,003                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,003                 directory, all directories are treated like packages.
2023-11-03T21:28:38,003           ********************************************************************************

2023-11-03T21:28:38,004   !!
2023-11-03T21:28:38,005     check.warn(importable)
2023-11-03T21:28:38,005   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2023-11-03T21:28:38,006   !!

2023-11-03T21:28:38,007           ********************************************************************************
2023-11-03T21:28:38,007           ############################
2023-11-03T21:28:38,007           # Package would be ignored #
2023-11-03T21:28:38,008           ############################
2023-11-03T21:28:38,008           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2023-11-03T21:28:38,011           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,012           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,012           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2023-11-03T21:28:38,013           to the `packages` configuration field.

2023-11-03T21:28:38,014           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,014           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,015           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,016           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,017           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,017           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2023-11-03T21:28:38,018           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2023-11-03T21:28:38,018           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,018           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,019           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,019           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,020           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,021           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,022                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,022                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,022                 directory, all directories are treated like packages.
2023-11-03T21:28:38,023           ********************************************************************************

2023-11-03T21:28:38,024   !!
2023-11-03T21:28:38,024     check.warn(importable)
2023-11-03T21:28:38,025   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2023-11-03T21:28:38,025   !!

2023-11-03T21:28:38,026           ********************************************************************************
2023-11-03T21:28:38,027           ############################
2023-11-03T21:28:38,027           # Package would be ignored #
2023-11-03T21:28:38,027           ############################
2023-11-03T21:28:38,028           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2023-11-03T21:28:38,029           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,029           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,030           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2023-11-03T21:28:38,030           to the `packages` configuration field.

2023-11-03T21:28:38,031           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,032           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,032           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,033           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,034           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,035           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2023-11-03T21:28:38,035           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2023-11-03T21:28:38,036           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,036           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,037           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,038           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,039           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,040           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,041                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,041                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,042                 directory, all directories are treated like packages.
2023-11-03T21:28:38,042           ********************************************************************************

2023-11-03T21:28:38,043   !!
2023-11-03T21:28:38,044     check.warn(importable)
2023-11-03T21:28:38,044   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2023-11-03T21:28:38,045   !!

2023-11-03T21:28:38,046           ********************************************************************************
2023-11-03T21:28:38,046           ############################
2023-11-03T21:28:38,046           # Package would be ignored #
2023-11-03T21:28:38,047           ############################
2023-11-03T21:28:38,047           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2023-11-03T21:28:38,048           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,049           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,049           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2023-11-03T21:28:38,049           to the `packages` configuration field.

2023-11-03T21:28:38,050           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,051           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,051           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,052           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,053           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,055           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2023-11-03T21:28:38,055           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2023-11-03T21:28:38,056           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,056           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,057           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,058           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,059           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,061           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,062                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,062                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,063                 directory, all directories are treated like packages.
2023-11-03T21:28:38,063           ********************************************************************************

2023-11-03T21:28:38,065   !!
2023-11-03T21:28:38,065     check.warn(importable)
2023-11-03T21:28:38,066   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2023-11-03T21:28:38,066   !!

2023-11-03T21:28:38,067           ********************************************************************************
2023-11-03T21:28:38,068           ############################
2023-11-03T21:28:38,069           # Package would be ignored #
2023-11-03T21:28:38,069           ############################
2023-11-03T21:28:38,070           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2023-11-03T21:28:38,071           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,072           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,072           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2023-11-03T21:28:38,073           to the `packages` configuration field.

2023-11-03T21:28:38,074           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,074           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,075           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,076           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,077           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,078           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2023-11-03T21:28:38,079           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2023-11-03T21:28:38,079           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,080           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,080           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,081           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,083           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,084           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,085                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,086                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,086                 directory, all directories are treated like packages.
2023-11-03T21:28:38,087           ********************************************************************************

2023-11-03T21:28:38,088   !!
2023-11-03T21:28:38,088     check.warn(importable)
2023-11-03T21:28:38,089   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2023-11-03T21:28:38,089   !!

2023-11-03T21:28:38,091           ********************************************************************************
2023-11-03T21:28:38,091           ############################
2023-11-03T21:28:38,091           # Package would be ignored #
2023-11-03T21:28:38,092           ############################
2023-11-03T21:28:38,093           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2023-11-03T21:28:38,093           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,094           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,095           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2023-11-03T21:28:38,095           to the `packages` configuration field.

2023-11-03T21:28:38,097           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,097           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,098           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,099           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,100           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,101           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2023-11-03T21:28:38,101           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2023-11-03T21:28:38,102           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,102           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,103           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,104           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,104           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,105           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,106                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,106                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,107                 directory, all directories are treated like packages.
2023-11-03T21:28:38,107           ********************************************************************************

2023-11-03T21:28:38,108   !!
2023-11-03T21:28:38,108     check.warn(importable)
2023-11-03T21:28:38,109   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2023-11-03T21:28:38,109   !!

2023-11-03T21:28:38,110           ********************************************************************************
2023-11-03T21:28:38,111           ############################
2023-11-03T21:28:38,111           # Package would be ignored #
2023-11-03T21:28:38,111           ############################
2023-11-03T21:28:38,112           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2023-11-03T21:28:38,112           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,113           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,114           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2023-11-03T21:28:38,114           to the `packages` configuration field.

2023-11-03T21:28:38,115           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,116           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,116           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,117           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,118           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,119           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2023-11-03T21:28:38,119           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2023-11-03T21:28:38,120           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,121           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,121           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,122           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,123           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,125           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,125                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,126                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,126                 directory, all directories are treated like packages.
2023-11-03T21:28:38,127           ********************************************************************************

2023-11-03T21:28:38,128   !!
2023-11-03T21:28:38,128     check.warn(importable)
2023-11-03T21:28:38,129   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2023-11-03T21:28:38,129   !!

2023-11-03T21:28:38,130           ********************************************************************************
2023-11-03T21:28:38,130           ############################
2023-11-03T21:28:38,131           # Package would be ignored #
2023-11-03T21:28:38,131           ############################
2023-11-03T21:28:38,132           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2023-11-03T21:28:38,132           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,133           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,133           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2023-11-03T21:28:38,134           to the `packages` configuration field.

2023-11-03T21:28:38,135           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,135           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,135           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,136           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,137           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,138           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2023-11-03T21:28:38,139           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2023-11-03T21:28:38,139           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,140           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,140           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,141           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,142           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,143           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,144                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,144                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,145                 directory, all directories are treated like packages.
2023-11-03T21:28:38,145           ********************************************************************************

2023-11-03T21:28:38,146   !!
2023-11-03T21:28:38,147     check.warn(importable)
2023-11-03T21:28:38,147   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2023-11-03T21:28:38,148   !!

2023-11-03T21:28:38,149           ********************************************************************************
2023-11-03T21:28:38,150           ############################
2023-11-03T21:28:38,150           # Package would be ignored #
2023-11-03T21:28:38,151           ############################
2023-11-03T21:28:38,151           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2023-11-03T21:28:38,152           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,153           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,154           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2023-11-03T21:28:38,155           to the `packages` configuration field.

2023-11-03T21:28:38,156           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,156           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,157           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,158           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,159           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,160           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2023-11-03T21:28:38,161           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2023-11-03T21:28:38,161           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,161           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,162           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,163           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,164           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,167           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,168                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,169                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,170                 directory, all directories are treated like packages.
2023-11-03T21:28:38,171           ********************************************************************************

2023-11-03T21:28:38,172   !!
2023-11-03T21:28:38,172     check.warn(importable)
2023-11-03T21:28:38,173   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2023-11-03T21:28:38,174   !!

2023-11-03T21:28:38,175           ********************************************************************************
2023-11-03T21:28:38,176           ############################
2023-11-03T21:28:38,177           # Package would be ignored #
2023-11-03T21:28:38,178           ############################
2023-11-03T21:28:38,179           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2023-11-03T21:28:38,180           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,181           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,182           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2023-11-03T21:28:38,183           to the `packages` configuration field.

2023-11-03T21:28:38,184           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,185           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,185           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,186           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,187           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,188           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2023-11-03T21:28:38,189           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2023-11-03T21:28:38,189           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,190           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,190           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,191           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,192           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,193           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,194                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,194                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,194                 directory, all directories are treated like packages.
2023-11-03T21:28:38,195           ********************************************************************************

2023-11-03T21:28:38,196   !!
2023-11-03T21:28:38,196     check.warn(importable)
2023-11-03T21:28:38,197   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2023-11-03T21:28:38,197   !!

2023-11-03T21:28:38,198           ********************************************************************************
2023-11-03T21:28:38,198           ############################
2023-11-03T21:28:38,199           # Package would be ignored #
2023-11-03T21:28:38,199           ############################
2023-11-03T21:28:38,200           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2023-11-03T21:28:38,200           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,201           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,202           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2023-11-03T21:28:38,203           to the `packages` configuration field.

2023-11-03T21:28:38,204           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,205           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,205           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,206           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,207           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,209           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2023-11-03T21:28:38,209           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2023-11-03T21:28:38,210           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,210           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,211           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,212           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,213           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,214           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,215                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,215                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,216                 directory, all directories are treated like packages.
2023-11-03T21:28:38,216           ********************************************************************************

2023-11-03T21:28:38,217   !!
2023-11-03T21:28:38,218     check.warn(importable)
2023-11-03T21:28:38,219   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2023-11-03T21:28:38,219   !!

2023-11-03T21:28:38,220           ********************************************************************************
2023-11-03T21:28:38,221           ############################
2023-11-03T21:28:38,222           # Package would be ignored #
2023-11-03T21:28:38,222           ############################
2023-11-03T21:28:38,223           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2023-11-03T21:28:38,223           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,224           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,224           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2023-11-03T21:28:38,225           to the `packages` configuration field.

2023-11-03T21:28:38,226           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,227           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,227           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,228           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,229           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,230           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2023-11-03T21:28:38,231           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2023-11-03T21:28:38,231           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,232           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,232           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,233           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,235           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,236           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,237                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,238                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,238                 directory, all directories are treated like packages.
2023-11-03T21:28:38,239           ********************************************************************************

2023-11-03T21:28:38,240   !!
2023-11-03T21:28:38,240     check.warn(importable)
2023-11-03T21:28:38,241   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2023-11-03T21:28:38,241   !!

2023-11-03T21:28:38,242           ********************************************************************************
2023-11-03T21:28:38,243           ############################
2023-11-03T21:28:38,243           # Package would be ignored #
2023-11-03T21:28:38,244           ############################
2023-11-03T21:28:38,244           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2023-11-03T21:28:38,245           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,246           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,246           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2023-11-03T21:28:38,247           to the `packages` configuration field.

2023-11-03T21:28:38,248           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,248           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,249           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,250           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,251           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,252           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2023-11-03T21:28:38,252           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2023-11-03T21:28:38,253           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,253           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,253           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,254           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,255           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,256           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,257                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,257                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,257                 directory, all directories are treated like packages.
2023-11-03T21:28:38,258           ********************************************************************************

2023-11-03T21:28:38,259   !!
2023-11-03T21:28:38,259     check.warn(importable)
2023-11-03T21:28:38,259   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2023-11-03T21:28:38,260   !!

2023-11-03T21:28:38,261           ********************************************************************************
2023-11-03T21:28:38,261           ############################
2023-11-03T21:28:38,261           # Package would be ignored #
2023-11-03T21:28:38,262           ############################
2023-11-03T21:28:38,262           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2023-11-03T21:28:38,263           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,264           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,265           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2023-11-03T21:28:38,265           to the `packages` configuration field.

2023-11-03T21:28:38,266           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,267           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,267           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,268           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,269           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,270           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2023-11-03T21:28:38,271           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2023-11-03T21:28:38,271           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,271           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,272           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,273           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,274           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,276           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,276                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,277                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,277                 directory, all directories are treated like packages.
2023-11-03T21:28:38,278           ********************************************************************************

2023-11-03T21:28:38,279   !!
2023-11-03T21:28:38,279     check.warn(importable)
2023-11-03T21:28:38,280   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2023-11-03T21:28:38,280   !!

2023-11-03T21:28:38,281           ********************************************************************************
2023-11-03T21:28:38,281           ############################
2023-11-03T21:28:38,282           # Package would be ignored #
2023-11-03T21:28:38,282           ############################
2023-11-03T21:28:38,283           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2023-11-03T21:28:38,283           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,284           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,284           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2023-11-03T21:28:38,285           to the `packages` configuration field.

2023-11-03T21:28:38,286           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,286           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,286           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,287           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,288           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,289           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2023-11-03T21:28:38,290           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2023-11-03T21:28:38,290           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,291           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,291           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,292           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,293           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,295           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,295                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,296                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,296                 directory, all directories are treated like packages.
2023-11-03T21:28:38,297           ********************************************************************************

2023-11-03T21:28:38,298   !!
2023-11-03T21:28:38,298     check.warn(importable)
2023-11-03T21:28:38,299   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2023-11-03T21:28:38,299   !!

2023-11-03T21:28:38,300           ********************************************************************************
2023-11-03T21:28:38,301           ############################
2023-11-03T21:28:38,301           # Package would be ignored #
2023-11-03T21:28:38,302           ############################
2023-11-03T21:28:38,302           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2023-11-03T21:28:38,303           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,304           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,305           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2023-11-03T21:28:38,305           to the `packages` configuration field.

2023-11-03T21:28:38,307           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,307           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,307           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,308           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,309           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,310           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2023-11-03T21:28:38,310           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2023-11-03T21:28:38,311           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,311           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,312           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,313           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,314           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,315           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,316                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,316                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,317                 directory, all directories are treated like packages.
2023-11-03T21:28:38,317           ********************************************************************************

2023-11-03T21:28:38,318   !!
2023-11-03T21:28:38,319     check.warn(importable)
2023-11-03T21:28:38,319   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2023-11-03T21:28:38,320   !!

2023-11-03T21:28:38,321           ********************************************************************************
2023-11-03T21:28:38,321           ############################
2023-11-03T21:28:38,322           # Package would be ignored #
2023-11-03T21:28:38,322           ############################
2023-11-03T21:28:38,323           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2023-11-03T21:28:38,323           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,324           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,325           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2023-11-03T21:28:38,325           to the `packages` configuration field.

2023-11-03T21:28:38,326           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,327           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,327           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,328           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,329           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,330           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2023-11-03T21:28:38,331           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2023-11-03T21:28:38,331           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,332           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,332           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,333           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,334           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,336           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,336                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,336                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,337                 directory, all directories are treated like packages.
2023-11-03T21:28:38,337           ********************************************************************************

2023-11-03T21:28:38,338   !!
2023-11-03T21:28:38,338     check.warn(importable)
2023-11-03T21:28:38,339   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2023-11-03T21:28:38,339   !!

2023-11-03T21:28:38,340           ********************************************************************************
2023-11-03T21:28:38,341           ############################
2023-11-03T21:28:38,341           # Package would be ignored #
2023-11-03T21:28:38,341           ############################
2023-11-03T21:28:38,342           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2023-11-03T21:28:38,342           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,343           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,344           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2023-11-03T21:28:38,344           to the `packages` configuration field.

2023-11-03T21:28:38,345           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,345           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,346           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,347           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,348           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,349           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2023-11-03T21:28:38,349           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2023-11-03T21:28:38,350           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,350           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,351           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,352           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,353           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,354           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,355                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,355                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,356                 directory, all directories are treated like packages.
2023-11-03T21:28:38,356           ********************************************************************************

2023-11-03T21:28:38,357   !!
2023-11-03T21:28:38,358     check.warn(importable)
2023-11-03T21:28:38,358   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2023-11-03T21:28:38,359   !!

2023-11-03T21:28:38,360           ********************************************************************************
2023-11-03T21:28:38,360           ############################
2023-11-03T21:28:38,361           # Package would be ignored #
2023-11-03T21:28:38,361           ############################
2023-11-03T21:28:38,362           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2023-11-03T21:28:38,363           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,364           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,364           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2023-11-03T21:28:38,364           to the `packages` configuration field.

2023-11-03T21:28:38,365           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,366           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,367           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,367           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,368           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,369           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2023-11-03T21:28:38,369           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2023-11-03T21:28:38,370           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,371           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,371           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,373           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,375           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,377           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,378                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,379                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,379                 directory, all directories are treated like packages.
2023-11-03T21:28:38,380           ********************************************************************************

2023-11-03T21:28:38,382   !!
2023-11-03T21:28:38,383     check.warn(importable)
2023-11-03T21:28:38,383   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2023-11-03T21:28:38,384   !!

2023-11-03T21:28:38,386           ********************************************************************************
2023-11-03T21:28:38,386           ############################
2023-11-03T21:28:38,387           # Package would be ignored #
2023-11-03T21:28:38,387           ############################
2023-11-03T21:28:38,388           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2023-11-03T21:28:38,388           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,390           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,390           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2023-11-03T21:28:38,391           to the `packages` configuration field.

2023-11-03T21:28:38,393           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,393           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,394           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,395           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,396           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,397           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2023-11-03T21:28:38,398           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2023-11-03T21:28:38,399           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,400           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,400           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,402           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,403           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,406           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,407                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,408                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,408                 directory, all directories are treated like packages.
2023-11-03T21:28:38,409           ********************************************************************************

2023-11-03T21:28:38,411   !!
2023-11-03T21:28:38,411     check.warn(importable)
2023-11-03T21:28:38,412   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2023-11-03T21:28:38,412   !!

2023-11-03T21:28:38,413           ********************************************************************************
2023-11-03T21:28:38,414           ############################
2023-11-03T21:28:38,415           # Package would be ignored #
2023-11-03T21:28:38,417           ############################
2023-11-03T21:28:38,417           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2023-11-03T21:28:38,418           but it is absent from setuptools' `packages` configuration.

2023-11-03T21:28:38,419           This leads to an ambiguous overall configuration. If you want to distribute this
2023-11-03T21:28:38,419           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2023-11-03T21:28:38,420           to the `packages` configuration field.

2023-11-03T21:28:38,421           Alternatively, you can also rely on setuptools' discovery methods
2023-11-03T21:28:38,421           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2023-11-03T21:28:38,422           instead of `find_packages(...)`/`find:`).

2023-11-03T21:28:38,423           You can read more about "package discovery" on setuptools documentation page:

2023-11-03T21:28:38,424           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2023-11-03T21:28:38,425           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2023-11-03T21:28:38,426           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2023-11-03T21:28:38,427           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2023-11-03T21:28:38,427           you can try to use `exclude_package_data`, or `include-package-data=False` in
2023-11-03T21:28:38,428           combination with a more fine grained `package-data` configuration.

2023-11-03T21:28:38,429           You can read more about "package data files" on setuptools documentation page:

2023-11-03T21:28:38,430           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2023-11-03T21:28:38,432           [^1]: For Python, any directory (with suitable naming) can be imported,
2023-11-03T21:28:38,433                 even if it does not contain any `.py` files.
2023-11-03T21:28:38,433                 On the other hand, currently there is no concept of package data
2023-11-03T21:28:38,434                 directory, all directories are treated like packages.
2023-11-03T21:28:38,434           ********************************************************************************

2023-11-03T21:28:38,436   !!
2023-11-03T21:28:38,436     check.warn(importable)
2023-11-03T21:28:38,437   creating build/lib/deepspeed/autotuning/config_templates
2023-11-03T21:28:38,437   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2023-11-03T21:28:38,437   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2023-11-03T21:28:38,438   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2023-11-03T21:28:38,438   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2023-11-03T21:28:38,439   creating build/lib/deepspeed/ops/csrc
2023-11-03T21:28:38,439   creating build/lib/deepspeed/ops/csrc/adagrad
2023-11-03T21:28:38,439   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2023-11-03T21:28:38,440   creating build/lib/deepspeed/ops/csrc/adam
2023-11-03T21:28:38,440   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2023-11-03T21:28:38,441   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2023-11-03T21:28:38,441   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2023-11-03T21:28:38,442   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2023-11-03T21:28:38,442   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2023-11-03T21:28:38,442   creating build/lib/deepspeed/ops/csrc/aio
2023-11-03T21:28:38,443   creating build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:38,443   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:38,444   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:38,445   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:38,445   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:38,446   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:38,446   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:38,447   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,447   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,448   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,449   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,449   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,450   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,450   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,451   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,451   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,452   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,453   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,454   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:38,454   creating build/lib/deepspeed/ops/csrc/aio/py_test
2023-11-03T21:28:38,455   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2023-11-03T21:28:38,456   creating build/lib/deepspeed/ops/csrc/common
2023-11-03T21:28:38,456   copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common
2023-11-03T21:28:38,457   creating build/lib/deepspeed/ops/csrc/cpu
2023-11-03T21:28:38,457   creating build/lib/deepspeed/ops/csrc/cpu/adam
2023-11-03T21:28:38,457   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2023-11-03T21:28:38,458   creating build/lib/deepspeed/ops/csrc/cpu/comm
2023-11-03T21:28:38,458   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2023-11-03T21:28:38,458   creating build/lib/deepspeed/ops/csrc/cpu/lion
2023-11-03T21:28:38,459   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2023-11-03T21:28:38,459   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2023-11-03T21:28:38,460   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:38,460   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:38,461   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:38,462   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:38,462   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:38,463   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:38,463   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:38,464   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T21:28:38,464   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T21:28:38,465   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T21:28:38,466   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T21:28:38,466   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T21:28:38,467   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:38,467   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:38,468   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:38,468   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:38,469   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:38,470   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:38,470   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:38,471   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:38,471   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,472   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,473   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,473   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,474   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,474   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,474   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,475   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,476   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T21:28:38,476   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T21:28:38,477   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T21:28:38,477   creating build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,478   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,478   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,479   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,479   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,480   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,480   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,481   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,481   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,482   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,482   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,483   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,483   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,484   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,485   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,485   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,486   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,487   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,487   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,488   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,488   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,489   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,489   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,489   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,490   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,490   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,491   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,491   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,492   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2023-11-03T21:28:38,492   creating build/lib/deepspeed/ops/csrc/lamb
2023-11-03T21:28:38,493   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2023-11-03T21:28:38,493   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2023-11-03T21:28:38,494   creating build/lib/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,494   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,495   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,495   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,496   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,497   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,497   creating build/lib/deepspeed/ops/csrc/quantization
2023-11-03T21:28:38,498   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T21:28:38,498   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T21:28:38,499   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T21:28:38,499   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T21:28:38,500   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T21:28:38,500   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T21:28:38,501   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2023-11-03T21:28:38,501   creating build/lib/deepspeed/ops/csrc/random_ltd
2023-11-03T21:28:38,502   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2023-11-03T21:28:38,502   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2023-11-03T21:28:38,503   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2023-11-03T21:28:38,503   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2023-11-03T21:28:38,504   creating build/lib/deepspeed/ops/csrc/sparse_attention
2023-11-03T21:28:38,505   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2023-11-03T21:28:38,505   creating build/lib/deepspeed/ops/csrc/spatial
2023-11-03T21:28:38,506   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2023-11-03T21:28:38,506   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2023-11-03T21:28:38,506   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2023-11-03T21:28:38,507   creating build/lib/deepspeed/ops/csrc/spatial/includes
2023-11-03T21:28:38,507   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2023-11-03T21:28:38,508   creating build/lib/deepspeed/ops/csrc/transformer
2023-11-03T21:28:38,508   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T21:28:38,509   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T21:28:38,509   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T21:28:38,510   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T21:28:38,510   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T21:28:38,511   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T21:28:38,511   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T21:28:38,512   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2023-11-03T21:28:38,512   creating build/lib/deepspeed/ops/csrc/transformer/inference
2023-11-03T21:28:38,513   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,513   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,514   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,514   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,515   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,515   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,516   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,516   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,517   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,517   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,518   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:38,518   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T21:28:38,519   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T21:28:38,519   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T21:28:38,520   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T21:28:38,521   creating build/lib/deepspeed/ops/csrc/utils
2023-11-03T21:28:38,521   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2023-11-03T21:28:38,522   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-11-03T21:28:38,522   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-11-03T21:28:38,523   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2023-11-03T21:28:38,523   running build_scripts
2023-11-03T21:28:38,524   creating build/scripts-3.11
2023-11-03T21:28:38,524   copying and adjusting bin/deepspeed -> build/scripts-3.11
2023-11-03T21:28:38,525   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2023-11-03T21:28:38,525   copying and adjusting bin/ds -> build/scripts-3.11
2023-11-03T21:28:38,527   copying bin/ds_ssh -> build/scripts-3.11
2023-11-03T21:28:38,529   copying and adjusting bin/ds_report -> build/scripts-3.11
2023-11-03T21:28:38,531   copying and adjusting bin/ds_bench -> build/scripts-3.11
2023-11-03T21:28:38,532   copying and adjusting bin/dsr -> build/scripts-3.11
2023-11-03T21:28:38,534   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2023-11-03T21:28:38,535   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2023-11-03T21:28:38,535   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2023-11-03T21:28:38,536   changing mode of build/scripts-3.11/ds from 644 to 755
2023-11-03T21:28:38,537   changing mode of build/scripts-3.11/ds_report from 644 to 755
2023-11-03T21:28:38,537   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2023-11-03T21:28:38,538   changing mode of build/scripts-3.11/dsr from 644 to 755
2023-11-03T21:28:38,538   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2023-11-03T21:28:38,561   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2023-11-03T21:28:38,562   !!

2023-11-03T21:28:38,563           ********************************************************************************
2023-11-03T21:28:38,564           Please avoid running ``setup.py`` directly.
2023-11-03T21:28:38,564           Instead, use pypa/build, pypa/installer or other
2023-11-03T21:28:38,565           standards-based tools.

2023-11-03T21:28:38,566           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2023-11-03T21:28:38,567           ********************************************************************************

2023-11-03T21:28:38,568   !!
2023-11-03T21:28:38,569     self.initialize_options()
2023-11-03T21:28:38,586   installing to build/bdist.linux-armv7l/wheel
2023-11-03T21:28:38,587   running install
2023-11-03T21:28:38,610   running install_lib
2023-11-03T21:28:38,634   creating build/bdist.linux-armv7l
2023-11-03T21:28:38,635   creating build/bdist.linux-armv7l/wheel
2023-11-03T21:28:38,637   creating build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T21:28:38,638   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T21:28:38,640   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T21:28:38,642   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-11-03T21:28:38,643   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-11-03T21:28:38,645   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-11-03T21:28:38,649   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T21:28:38,650   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T21:28:38,652   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T21:28:38,654   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T21:28:38,656   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T21:28:38,658   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2023-11-03T21:28:38,660   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2023-11-03T21:28:38,662   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T21:28:38,664   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T21:28:38,665   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T21:28:38,666   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T21:28:38,668   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T21:28:38,670   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T21:28:38,671   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T21:28:38,673   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T21:28:38,675   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor
2023-11-03T21:28:38,677   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T21:28:38,678   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T21:28:38,679   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T21:28:38,681   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T21:28:38,683   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T21:28:38,686   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T21:28:38,688   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe
2023-11-03T21:28:38,690   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2023-11-03T21:28:38,691   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2023-11-03T21:28:38,693   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence
2023-11-03T21:28:38,695   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T21:28:38,696   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T21:28:38,698   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T21:28:38,700   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T21:28:38,703   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T21:28:38,705   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T21:28:38,708   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T21:28:38,709   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T21:28:38,711   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T21:28:38,713   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T21:28:38,715   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T21:28:38,716   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T21:28:38,718   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2023-11-03T21:28:38,720   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2023-11-03T21:28:38,723   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-11-03T21:28:38,723   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-11-03T21:28:38,725   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-11-03T21:28:38,727   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-11-03T21:28:38,728   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2023-11-03T21:28:38,730   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T21:28:38,731   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T21:28:38,733   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T21:28:38,735   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T21:28:38,737   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T21:28:38,740   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2023-11-03T21:28:38,742   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,743   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,745   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,747   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,749   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,751   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,753   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,755   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,757   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,759   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,763   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2023-11-03T21:28:38,767   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T21:28:38,768   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T21:28:38,772   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T21:28:38,774   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T21:28:38,776   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T21:28:38,778   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T21:28:38,781   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T21:28:38,783   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T21:28:38,786   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression
2023-11-03T21:28:38,788   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T21:28:38,791   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T21:28:38,791   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T21:28:38,793   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T21:28:38,795   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T21:28:38,797   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T21:28:38,799   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T21:28:38,802   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T21:28:38,804   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2023-11-03T21:28:38,806   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T21:28:38,808   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2023-11-03T21:28:38,809   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2023-11-03T21:28:38,811   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2023-11-03T21:28:38,812   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2023-11-03T21:28:38,814   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2023-11-03T21:28:38,816   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,817   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,820   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,823   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,825   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,826   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,828   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,830   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,831   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,833   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,835   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2023-11-03T21:28:38,837   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-11-03T21:28:38,838   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-11-03T21:28:38,840   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-11-03T21:28:38,841   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2023-11-03T21:28:38,844   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,845   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,847   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,848   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,850   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,853   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,854   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,856   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,859   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,861   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,863   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,865   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,867   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,869   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,871   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2023-11-03T21:28:38,873   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2023-11-03T21:28:38,875   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-11-03T21:28:38,876   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-11-03T21:28:38,878   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-11-03T21:28:38,879   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-11-03T21:28:38,881   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2023-11-03T21:28:38,883   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2023-11-03T21:28:38,886   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2023-11-03T21:28:38,887   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2023-11-03T21:28:38,888   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2023-11-03T21:28:38,891   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2023-11-03T21:28:38,892   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2023-11-03T21:28:38,893   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2023-11-03T21:28:38,896   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,896   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,898   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,900   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,901   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,903   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-11-03T21:28:38,904   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-11-03T21:28:38,906   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-11-03T21:28:38,908   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-11-03T21:28:38,909   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2023-11-03T21:28:38,911   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,913   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,915   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:38,916   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:38,918   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:38,919   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:38,921   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:38,923   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:38,924   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2023-11-03T21:28:38,926   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,929   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,931   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,933   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,935   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,938   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,941   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,943   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,945   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,946   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,948   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,950   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2023-11-03T21:28:38,952   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2023-11-03T21:28:38,953   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2023-11-03T21:28:38,955   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2023-11-03T21:28:38,957   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2023-11-03T21:28:38,959   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,959   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,962   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,963   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,965   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,967   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2023-11-03T21:28:38,970   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-11-03T21:28:38,970   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-11-03T21:28:38,973   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-11-03T21:28:38,975   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-11-03T21:28:38,977   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2023-11-03T21:28:38,980   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2023-11-03T21:28:38,981   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:38,982   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:38,984   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:38,987   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,988   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,990   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,993   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,997   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:38,999   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:39,002   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:39,004   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2023-11-03T21:28:39,007   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T21:28:39,008   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T21:28:39,010   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T21:28:39,012   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T21:28:39,015   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2023-11-03T21:28:39,017   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:39,018   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:39,020   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:39,023   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:39,025   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:39,027   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:39,031   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:39,034   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2023-11-03T21:28:39,036   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:39,038   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:39,041   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T21:28:39,042   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T21:28:39,044   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2023-11-03T21:28:39,046   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:39,049   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2023-11-03T21:28:39,052   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2023-11-03T21:28:39,053   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2023-11-03T21:28:39,055   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2023-11-03T21:28:39,058   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,059   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,061   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,063   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,064   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,066   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,068   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,070   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,072   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,074   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,077   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,079   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,081   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,083   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,085   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,087   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,089   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,091   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,093   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,095   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,097   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,100   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,101   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,103   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,105   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,107   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,109   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,111   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,113   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2023-11-03T21:28:39,116   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2023-11-03T21:28:39,118   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2023-11-03T21:28:39,119   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2023-11-03T21:28:39,121   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2023-11-03T21:28:39,122   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2023-11-03T21:28:39,124   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2023-11-03T21:28:39,125   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2023-11-03T21:28:39,128   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2023-11-03T21:28:39,130   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2023-11-03T21:28:39,131   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2023-11-03T21:28:39,133   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2023-11-03T21:28:39,135   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2023-11-03T21:28:39,137   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2023-11-03T21:28:39,139   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T21:28:39,140   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T21:28:39,143   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T21:28:39,145   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T21:28:39,146   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T21:28:39,149   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2023-11-03T21:28:39,152   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T21:28:39,153   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2023-11-03T21:28:39,155   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T21:28:39,156   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T21:28:39,158   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T21:28:39,160   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2023-11-03T21:28:39,163   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,164   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,167   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,170   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,176   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,178   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,179   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,182   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,185   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,188   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,191   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2023-11-03T21:28:39,193   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T21:28:39,196   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T21:28:39,199   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T21:28:39,201   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T21:28:39,204   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T21:28:39,206   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T21:28:39,209   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T21:28:39,211   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2023-11-03T21:28:39,215   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T21:28:39,216   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T21:28:39,218   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T21:28:39,221   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T21:28:39,223   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T21:28:39,225   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T21:28:39,227   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T21:28:39,230   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2023-11-03T21:28:39,232   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2023-11-03T21:28:39,233   copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common
2023-11-03T21:28:39,235   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2023-11-03T21:28:39,236   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2023-11-03T21:28:39,238   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2023-11-03T21:28:39,239   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2023-11-03T21:28:39,241   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2023-11-03T21:28:39,242   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2023-11-03T21:28:39,244   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2023-11-03T21:28:39,246   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,247   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,249   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,250   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,252   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,254   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,256   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,258   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,259   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,262   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,263   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,265   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2023-11-03T21:28:39,267   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:39,268   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:39,270   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:39,271   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:39,273   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:39,275   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:39,277   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2023-11-03T21:28:39,279   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2023-11-03T21:28:39,280   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2023-11-03T21:28:39,282   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-11-03T21:28:39,283   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-11-03T21:28:39,285   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-11-03T21:28:39,288   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-11-03T21:28:39,289   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2023-11-03T21:28:39,292   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2023-11-03T21:28:39,293   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2023-11-03T21:28:39,295   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,296   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,298   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,300   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,301   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,303   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,305   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,307   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,309   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,311   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,314   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,316   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,318   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,320   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2023-11-03T21:28:39,322   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,324   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,325   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,327   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,329   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,332   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,334   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,336   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,337   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,339   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,341   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,343   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,345   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,346   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,348   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,350   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,352   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,354   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2023-11-03T21:28:39,356   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2023-11-03T21:28:39,358   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2023-11-03T21:28:39,361   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2023-11-03T21:28:39,362   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2023-11-03T21:28:39,364   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2023-11-03T21:28:39,366   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T21:28:39,367   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T21:28:39,369   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T21:28:39,370   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T21:28:39,373   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-11-03T21:28:39,374   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-11-03T21:28:39,375   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-11-03T21:28:39,378   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-11-03T21:28:39,379   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2023-11-03T21:28:39,381   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T21:28:39,383   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T21:28:39,386   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T21:28:39,388   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2023-11-03T21:28:39,391   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2023-11-03T21:28:39,392   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2023-11-03T21:28:39,394   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2023-11-03T21:28:39,396   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2023-11-03T21:28:39,396   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2023-11-03T21:28:39,398   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2023-11-03T21:28:39,400   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T21:28:39,401   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T21:28:39,403   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T21:28:39,406   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T21:28:39,407   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T21:28:39,409   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T21:28:39,411   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T21:28:39,413   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T21:28:39,415   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T21:28:39,417   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm
2023-11-03T21:28:39,419   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,420   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,422   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,424   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,426   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,428   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,429   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,432   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,434   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,435   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,437   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,439   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T21:28:39,440   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T21:28:39,442   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T21:28:39,443   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T21:28:39,446   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T21:28:39,448   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T21:28:39,449   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T21:28:39,452   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2023-11-03T21:28:39,454   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,456   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,458   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,460   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,462   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,464   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,466   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,469   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,471   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,474   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,476   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,478   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,479   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,482   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,483   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,486   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,488   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2023-11-03T21:28:39,489   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,491   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,493   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,495   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,497   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,499   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2023-11-03T21:28:39,502   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2023-11-03T21:28:39,503   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2023-11-03T21:28:39,506   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,507   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,510   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,512   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,515   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,516   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,518   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,521   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-11-03T21:28:39,522   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-11-03T21:28:39,524   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-11-03T21:28:39,526   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:39,527   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:39,529   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:39,530   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:39,533   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:39,535   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2023-11-03T21:28:39,536   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-11-03T21:28:39,539   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:39,540   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:39,542   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:39,544   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:39,546   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:39,548   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2023-11-03T21:28:39,551   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2023-11-03T21:28:39,553   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,556   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,558   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,561   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2023-11-03T21:28:39,562   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2023-11-03T21:28:39,564   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2023-11-03T21:28:39,566   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,568   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,574   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,576   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,579   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,581   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-11-03T21:28:39,582   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-11-03T21:28:39,584   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-11-03T21:28:39,586   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-11-03T21:28:39,587   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2023-11-03T21:28:39,590   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T21:28:39,591   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T21:28:39,593   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T21:28:39,594   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T21:28:39,597   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T21:28:39,599   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T21:28:39,601   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T21:28:39,603   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T21:28:39,605   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T21:28:39,607   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2023-11-03T21:28:39,609   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,612   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-11-03T21:28:39,613   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-11-03T21:28:39,615   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-11-03T21:28:39,617   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2023-11-03T21:28:39,620   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-11-03T21:28:39,621   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-11-03T21:28:39,623   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-11-03T21:28:39,625   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-11-03T21:28:39,627   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2023-11-03T21:28:39,629   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-11-03T21:28:39,630   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-11-03T21:28:39,632   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-11-03T21:28:39,636   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-11-03T21:28:39,637   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-11-03T21:28:39,639   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-11-03T21:28:39,643   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-11-03T21:28:39,645   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2023-11-03T21:28:39,648   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-11-03T21:28:39,650   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2023-11-03T21:28:39,653   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T21:28:39,654   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T21:28:39,656   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T21:28:39,659   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T21:28:39,661   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T21:28:39,663   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T21:28:39,667   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2023-11-03T21:28:39,669   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2023-11-03T21:28:39,671   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,672   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,674   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,677   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,679   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,682   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,684   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,686   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,690   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,692   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,694   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,698   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,700   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,702   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,705   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,706   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,709   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2023-11-03T21:28:39,711   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T21:28:39,712   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T21:28:39,714   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T21:28:39,715   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T21:28:39,717   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T21:28:39,720   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T21:28:39,722   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2023-11-03T21:28:39,725   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-11-03T21:28:39,725   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-11-03T21:28:39,727   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-11-03T21:28:39,729   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2023-11-03T21:28:39,730   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2023-11-03T21:28:39,732   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2023-11-03T21:28:39,735   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2023-11-03T21:28:39,737   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-11-03T21:28:39,738   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-11-03T21:28:39,740   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-11-03T21:28:39,741   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula
2023-11-03T21:28:39,743   running install_egg_info
2023-11-03T21:28:39,775   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.11.2-py3.11.egg-info
2023-11-03T21:28:39,788   running install_scripts
2023-11-03T21:28:39,789   creating build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data
2023-11-03T21:28:39,790   creating build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts
2023-11-03T21:28:39,791   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts
2023-11-03T21:28:39,793   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts
2023-11-03T21:28:39,794   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts
2023-11-03T21:28:39,796   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts
2023-11-03T21:28:39,798   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts
2023-11-03T21:28:39,800   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts
2023-11-03T21:28:39,801   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts
2023-11-03T21:28:39,803   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts
2023-11-03T21:28:39,805   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts/dsr to 755
2023-11-03T21:28:39,805   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts/ds_ssh to 755
2023-11-03T21:28:39,806   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts/ds_bench to 755
2023-11-03T21:28:39,806   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts/deepspeed.pt to 755
2023-11-03T21:28:39,807   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts/deepspeed to 755
2023-11-03T21:28:39,807   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts/ds to 755
2023-11-03T21:28:39,808   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts/ds_report to 755
2023-11-03T21:28:39,808   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.data/scripts/ds_elastic to 755
2023-11-03T21:28:39,849   creating build/bdist.linux-armv7l/wheel/deepspeed-0.11.2.dist-info/WHEEL
2023-11-03T21:28:39,851   creating '/tmp/pip-wheel-evc0d1nl/deepspeed-0.11.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2023-11-03T21:28:39,855   adding 'deepspeed/__init__.py'
2023-11-03T21:28:39,856   adding 'deepspeed/constants.py'
2023-11-03T21:28:39,858   adding 'deepspeed/env_report.py'
2023-11-03T21:28:39,859   adding 'deepspeed/git_version_info.py'
2023-11-03T21:28:39,860   adding 'deepspeed/git_version_info_installed.py'
2023-11-03T21:28:39,861   adding 'deepspeed/pydantic_v1.py'
2023-11-03T21:28:39,863   adding 'deepspeed/accelerator/__init__.py'
2023-11-03T21:28:39,864   adding 'deepspeed/accelerator/abstract_accelerator.py'
2023-11-03T21:28:39,865   adding 'deepspeed/accelerator/cpu_accelerator.py'
2023-11-03T21:28:39,867   adding 'deepspeed/accelerator/cuda_accelerator.py'
2023-11-03T21:28:39,868   adding 'deepspeed/accelerator/mps_accelerator.py'
2023-11-03T21:28:39,870   adding 'deepspeed/accelerator/npu_accelerator.py'
2023-11-03T21:28:39,871   adding 'deepspeed/accelerator/real_accelerator.py'
2023-11-03T21:28:39,873   adding 'deepspeed/autotuning/__init__.py'
2023-11-03T21:28:39,878   adding 'deepspeed/autotuning/autotuner.py'
2023-11-03T21:28:39,880   adding 'deepspeed/autotuning/config.py'
2023-11-03T21:28:39,882   adding 'deepspeed/autotuning/constants.py'
2023-11-03T21:28:39,884   adding 'deepspeed/autotuning/scheduler.py'
2023-11-03T21:28:39,886   adding 'deepspeed/autotuning/utils.py'
2023-11-03T21:28:39,888   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2023-11-03T21:28:39,889   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2023-11-03T21:28:39,890   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2023-11-03T21:28:39,891   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2023-11-03T21:28:39,893   adding 'deepspeed/autotuning/tuner/__init__.py'
2023-11-03T21:28:39,894   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2023-11-03T21:28:39,895   adding 'deepspeed/autotuning/tuner/cost_model.py'
2023-11-03T21:28:39,897   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2023-11-03T21:28:39,898   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2023-11-03T21:28:39,899   adding 'deepspeed/autotuning/tuner/utils.py'
2023-11-03T21:28:39,901   adding 'deepspeed/checkpoint/__init__.py'
2023-11-03T21:28:39,903   adding 'deepspeed/checkpoint/constants.py'
2023-11-03T21:28:39,904   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2023-11-03T21:28:39,906   adding 'deepspeed/checkpoint/ds_to_universal.py'
2023-11-03T21:28:39,908   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2023-11-03T21:28:39,909   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2023-11-03T21:28:39,911   adding 'deepspeed/checkpoint/reshape_utils.py'
2023-11-03T21:28:39,912   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2023-11-03T21:28:39,914   adding 'deepspeed/checkpoint/utils.py'
2023-11-03T21:28:39,915   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2023-11-03T21:28:39,917   adding 'deepspeed/comm/__init__.py'
2023-11-03T21:28:39,918   adding 'deepspeed/comm/backend.py'
2023-11-03T21:28:39,920   adding 'deepspeed/comm/ccl.py'
2023-11-03T21:28:39,923   adding 'deepspeed/comm/comm.py'
2023-11-03T21:28:39,924   adding 'deepspeed/comm/config.py'
2023-11-03T21:28:39,925   adding 'deepspeed/comm/constants.py'
2023-11-03T21:28:39,926   adding 'deepspeed/comm/reduce_op.py'
2023-11-03T21:28:39,928   adding 'deepspeed/comm/torch.py'
2023-11-03T21:28:39,930   adding 'deepspeed/comm/utils.py'
2023-11-03T21:28:39,932   adding 'deepspeed/compression/__init__.py'
2023-11-03T21:28:39,935   adding 'deepspeed/compression/basic_layer.py'
2023-11-03T21:28:39,937   adding 'deepspeed/compression/compress.py'
2023-11-03T21:28:39,939   adding 'deepspeed/compression/config.py'
2023-11-03T21:28:39,941   adding 'deepspeed/compression/constants.py'
2023-11-03T21:28:39,943   adding 'deepspeed/compression/helper.py'
2023-11-03T21:28:39,944   adding 'deepspeed/compression/scheduler.py'
2023-11-03T21:28:39,946   adding 'deepspeed/compression/utils.py'
2023-11-03T21:28:39,948   adding 'deepspeed/elasticity/__init__.py'
2023-11-03T21:28:39,949   adding 'deepspeed/elasticity/config.py'
2023-11-03T21:28:39,951   adding 'deepspeed/elasticity/constants.py'
2023-11-03T21:28:39,952   adding 'deepspeed/elasticity/elastic_agent.py'
2023-11-03T21:28:39,954   adding 'deepspeed/elasticity/elasticity.py'
2023-11-03T21:28:39,956   adding 'deepspeed/elasticity/utils.py'
2023-11-03T21:28:39,957   adding 'deepspeed/inference/__init__.py'
2023-11-03T21:28:39,959   adding 'deepspeed/inference/config.py'
2023-11-03T21:28:39,962   adding 'deepspeed/inference/engine.py'
2023-11-03T21:28:39,964   adding 'deepspeed/inference/quantization/__init__.py'
2023-11-03T21:28:39,965   adding 'deepspeed/inference/quantization/layers.py'
2023-11-03T21:28:39,967   adding 'deepspeed/inference/quantization/quantization.py'
2023-11-03T21:28:39,968   adding 'deepspeed/inference/quantization/quantization_context.py'
2023-11-03T21:28:39,970   adding 'deepspeed/inference/quantization/utils.py'
2023-11-03T21:28:39,971   adding 'deepspeed/launcher/__init__.py'
2023-11-03T21:28:39,972   adding 'deepspeed/launcher/constants.py'
2023-11-03T21:28:39,975   adding 'deepspeed/launcher/launch.py'
2023-11-03T21:28:39,977   adding 'deepspeed/launcher/multinode_runner.py'
2023-11-03T21:28:39,980   adding 'deepspeed/launcher/runner.py'
2023-11-03T21:28:39,981   adding 'deepspeed/model_implementations/__init__.py'
2023-11-03T21:28:39,983   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2023-11-03T21:28:39,984   adding 'deepspeed/model_implementations/diffusers/unet.py'
2023-11-03T21:28:39,985   adding 'deepspeed/model_implementations/diffusers/vae.py'
2023-11-03T21:28:39,987   adding 'deepspeed/model_implementations/features/__init__.py'
2023-11-03T21:28:39,988   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2023-11-03T21:28:39,990   adding 'deepspeed/model_implementations/transformers/__init__.py'
2023-11-03T21:28:39,991   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2023-11-03T21:28:39,992   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2023-11-03T21:28:39,993   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2023-11-03T21:28:39,995   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2023-11-03T21:28:39,996   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2023-11-03T21:28:39,997   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2023-11-03T21:28:39,998   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2023-11-03T21:28:39,999   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2023-11-03T21:28:40,001   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2023-11-03T21:28:40,003   adding 'deepspeed/module_inject/__init__.py'
2023-11-03T21:28:40,006   adding 'deepspeed/module_inject/auto_tp.py'
2023-11-03T21:28:40,007   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2023-11-03T21:28:40,009   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2023-11-03T21:28:40,010   adding 'deepspeed/module_inject/inject.py'
2023-11-03T21:28:40,011   adding 'deepspeed/module_inject/layers.py'
2023-11-03T21:28:40,013   adding 'deepspeed/module_inject/load_checkpoint.py'
2023-11-03T21:28:40,015   adding 'deepspeed/module_inject/module_quantize.py'
2023-11-03T21:28:40,016   adding 'deepspeed/module_inject/policy.py'
2023-11-03T21:28:40,020   adding 'deepspeed/module_inject/replace_module.py'
2023-11-03T21:28:40,021   adding 'deepspeed/module_inject/replace_policy.py'
2023-11-03T21:28:40,022   adding 'deepspeed/module_inject/tp_shard.py'
2023-11-03T21:28:40,024   adding 'deepspeed/module_inject/utils.py'
2023-11-03T21:28:40,026   adding 'deepspeed/module_inject/containers/__init__.py'
2023-11-03T21:28:40,028   adding 'deepspeed/module_inject/containers/base.py'
2023-11-03T21:28:40,029   adding 'deepspeed/module_inject/containers/base_moe.py'
2023-11-03T21:28:40,031   adding 'deepspeed/module_inject/containers/bert.py'
2023-11-03T21:28:40,032   adding 'deepspeed/module_inject/containers/bloom.py'
2023-11-03T21:28:40,034   adding 'deepspeed/module_inject/containers/clip.py'
2023-11-03T21:28:40,035   adding 'deepspeed/module_inject/containers/distil_bert.py'
2023-11-03T21:28:40,037   adding 'deepspeed/module_inject/containers/gpt2.py'
2023-11-03T21:28:40,038   adding 'deepspeed/module_inject/containers/gptj.py'
2023-11-03T21:28:40,040   adding 'deepspeed/module_inject/containers/gptneo.py'
2023-11-03T21:28:40,041   adding 'deepspeed/module_inject/containers/gptneox.py'
2023-11-03T21:28:40,043   adding 'deepspeed/module_inject/containers/internlm.py'
2023-11-03T21:28:40,044   adding 'deepspeed/module_inject/containers/llama.py'
2023-11-03T21:28:40,046   adding 'deepspeed/module_inject/containers/llama2.py'
2023-11-03T21:28:40,047   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2023-11-03T21:28:40,049   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2023-11-03T21:28:40,050   adding 'deepspeed/module_inject/containers/opt.py'
2023-11-03T21:28:40,052   adding 'deepspeed/module_inject/containers/unet.py'
2023-11-03T21:28:40,053   adding 'deepspeed/module_inject/containers/vae.py'
2023-11-03T21:28:40,055   adding 'deepspeed/module_inject/containers/features/__init__.py'
2023-11-03T21:28:40,057   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2023-11-03T21:28:40,058   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2023-11-03T21:28:40,060   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2023-11-03T21:28:40,061   adding 'deepspeed/module_inject/containers/features/megatron.py'
2023-11-03T21:28:40,062   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2023-11-03T21:28:40,063   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2023-11-03T21:28:40,065   adding 'deepspeed/moe/__init__.py'
2023-11-03T21:28:40,066   adding 'deepspeed/moe/experts.py'
2023-11-03T21:28:40,068   adding 'deepspeed/moe/layer.py'
2023-11-03T21:28:40,069   adding 'deepspeed/moe/mappings.py'
2023-11-03T21:28:40,072   adding 'deepspeed/moe/sharded_moe.py'
2023-11-03T21:28:40,074   adding 'deepspeed/moe/utils.py'
2023-11-03T21:28:40,075   adding 'deepspeed/monitor/__init__.py'
2023-11-03T21:28:40,077   adding 'deepspeed/monitor/config.py'
2023-11-03T21:28:40,078   adding 'deepspeed/monitor/csv_monitor.py'
2023-11-03T21:28:40,079   adding 'deepspeed/monitor/monitor.py'
2023-11-03T21:28:40,080   adding 'deepspeed/monitor/tensorboard.py'
2023-11-03T21:28:40,082   adding 'deepspeed/monitor/utils.py'
2023-11-03T21:28:40,083   adding 'deepspeed/monitor/wandb.py'
2023-11-03T21:28:40,084   adding 'deepspeed/nebula/__init__.py'
2023-11-03T21:28:40,086   adding 'deepspeed/nebula/config.py'
2023-11-03T21:28:40,087   adding 'deepspeed/nebula/constants.py'
2023-11-03T21:28:40,089   adding 'deepspeed/ops/__init__.py'
2023-11-03T21:28:40,090   adding 'deepspeed/ops/adagrad/__init__.py'
2023-11-03T21:28:40,092   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2023-11-03T21:28:40,093   adding 'deepspeed/ops/adam/__init__.py'
2023-11-03T21:28:40,095   adding 'deepspeed/ops/adam/cpu_adam.py'
2023-11-03T21:28:40,097   adding 'deepspeed/ops/adam/fused_adam.py'
2023-11-03T21:28:40,098   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2023-11-03T21:28:40,100   adding 'deepspeed/ops/aio/__init__.py'
2023-11-03T21:28:40,103   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2023-11-03T21:28:40,105   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2023-11-03T21:28:40,106   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2023-11-03T21:28:40,108   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2023-11-03T21:28:40,109   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2023-11-03T21:28:40,110   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2023-11-03T21:28:40,113   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2023-11-03T21:28:40,115   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2023-11-03T21:28:40,116   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2023-11-03T21:28:40,117   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2023-11-03T21:28:40,119   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2023-11-03T21:28:40,120   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2023-11-03T21:28:40,122   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2023-11-03T21:28:40,123   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2023-11-03T21:28:40,124   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2023-11-03T21:28:40,125   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2023-11-03T21:28:40,126   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2023-11-03T21:28:40,127   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2023-11-03T21:28:40,129   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2023-11-03T21:28:40,130   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2023-11-03T21:28:40,132   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2023-11-03T21:28:40,133   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2023-11-03T21:28:40,134   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2023-11-03T21:28:40,135   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2023-11-03T21:28:40,137   adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu'
2023-11-03T21:28:40,139   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2023-11-03T21:28:40,142   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2023-11-03T21:28:40,144   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2023-11-03T21:28:40,146   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2023-11-03T21:28:40,148   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2023-11-03T21:28:40,149   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2023-11-03T21:28:40,151   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2023-11-03T21:28:40,159   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2023-11-03T21:28:40,164   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2023-11-03T21:28:40,167   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2023-11-03T21:28:40,169   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2023-11-03T21:28:40,171   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2023-11-03T21:28:40,173   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2023-11-03T21:28:40,175   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2023-11-03T21:28:40,176   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2023-11-03T21:28:40,179   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2023-11-03T21:28:40,182   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2023-11-03T21:28:40,184   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2023-11-03T21:28:40,186   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2023-11-03T21:28:40,193   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2023-11-03T21:28:40,197   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2023-11-03T21:28:40,198   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2023-11-03T21:28:40,202   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2023-11-03T21:28:40,206   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2023-11-03T21:28:40,209   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2023-11-03T21:28:40,211   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2023-11-03T21:28:40,213   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2023-11-03T21:28:40,215   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2023-11-03T21:28:40,216   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2023-11-03T21:28:40,218   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2023-11-03T21:28:40,219   adding 'deepspeed/ops/csrc/includes/Timer.h'
2023-11-03T21:28:40,221   adding 'deepspeed/ops/csrc/includes/compat.h'
2023-11-03T21:28:40,222   adding 'deepspeed/ops/csrc/includes/context.h'
2023-11-03T21:28:40,224   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2023-11-03T21:28:40,225   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2023-11-03T21:28:40,227   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2023-11-03T21:28:40,228   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2023-11-03T21:28:40,229   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2023-11-03T21:28:40,231   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2023-11-03T21:28:40,233   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2023-11-03T21:28:40,234   adding 'deepspeed/ops/csrc/includes/dropout.h'
2023-11-03T21:28:40,235   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2023-11-03T21:28:40,236   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2023-11-03T21:28:40,237   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2023-11-03T21:28:40,239   adding 'deepspeed/ops/csrc/includes/gelu.h'
2023-11-03T21:28:40,240   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2023-11-03T21:28:40,241   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2023-11-03T21:28:40,244   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2023-11-03T21:28:40,245   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2023-11-03T21:28:40,247   adding 'deepspeed/ops/csrc/includes/quantization.h'
2023-11-03T21:28:40,249   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2023-11-03T21:28:40,250   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2023-11-03T21:28:40,252   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2023-11-03T21:28:40,254   adding 'deepspeed/ops/csrc/includes/simd.h'
2023-11-03T21:28:40,255   adding 'deepspeed/ops/csrc/includes/softmax.h'
2023-11-03T21:28:40,256   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2023-11-03T21:28:40,258   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2023-11-03T21:28:40,260   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2023-11-03T21:28:40,262   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2023-11-03T21:28:40,264   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2023-11-03T21:28:40,265   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2023-11-03T21:28:40,266   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2023-11-03T21:28:40,268   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2023-11-03T21:28:40,269   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2023-11-03T21:28:40,271   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2023-11-03T21:28:40,274   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2023-11-03T21:28:40,276   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2023-11-03T21:28:40,278   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2023-11-03T21:28:40,280   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2023-11-03T21:28:40,281   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2023-11-03T21:28:40,283   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2023-11-03T21:28:40,285   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2023-11-03T21:28:40,286   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2023-11-03T21:28:40,288   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2023-11-03T21:28:40,289   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2023-11-03T21:28:40,291   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2023-11-03T21:28:40,294   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2023-11-03T21:28:40,295   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2023-11-03T21:28:40,297   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2023-11-03T21:28:40,299   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2023-11-03T21:28:40,301   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2023-11-03T21:28:40,305   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2023-11-03T21:28:40,307   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2023-11-03T21:28:40,309   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2023-11-03T21:28:40,313   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2023-11-03T21:28:40,316   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2023-11-03T21:28:40,318   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2023-11-03T21:28:40,321   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2023-11-03T21:28:40,322   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2023-11-03T21:28:40,325   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2023-11-03T21:28:40,327   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2023-11-03T21:28:40,329   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2023-11-03T21:28:40,334   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2023-11-03T21:28:40,336   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2023-11-03T21:28:40,338   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2023-11-03T21:28:40,340   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2023-11-03T21:28:40,343   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2023-11-03T21:28:40,345   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2023-11-03T21:28:40,347   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2023-11-03T21:28:40,349   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2023-11-03T21:28:40,350   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2023-11-03T21:28:40,352   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2023-11-03T21:28:40,354   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2023-11-03T21:28:40,355   adding 'deepspeed/ops/lamb/__init__.py'
2023-11-03T21:28:40,357   adding 'deepspeed/ops/lamb/fused_lamb.py'
2023-11-03T21:28:40,359   adding 'deepspeed/ops/lion/__init__.py'
2023-11-03T21:28:40,360   adding 'deepspeed/ops/lion/cpu_lion.py'
2023-11-03T21:28:40,362   adding 'deepspeed/ops/lion/fused_lion.py'
2023-11-03T21:28:40,363   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2023-11-03T21:28:40,365   adding 'deepspeed/ops/op_builder/__init__.py'
2023-11-03T21:28:40,366   adding 'deepspeed/ops/op_builder/all_ops.py'
2023-11-03T21:28:40,367   adding 'deepspeed/ops/op_builder/async_io.py'
2023-11-03T21:28:40,371   adding 'deepspeed/ops/op_builder/builder.py'
2023-11-03T21:28:40,372   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2023-11-03T21:28:40,373   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2023-11-03T21:28:40,375   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2023-11-03T21:28:40,376   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2023-11-03T21:28:40,377   adding 'deepspeed/ops/op_builder/fused_adam.py'
2023-11-03T21:28:40,378   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2023-11-03T21:28:40,380   adding 'deepspeed/ops/op_builder/fused_lion.py'
2023-11-03T21:28:40,381   adding 'deepspeed/ops/op_builder/quantizer.py'
2023-11-03T21:28:40,382   adding 'deepspeed/ops/op_builder/random_ltd.py'
2023-11-03T21:28:40,383   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2023-11-03T21:28:40,385   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2023-11-03T21:28:40,386   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2023-11-03T21:28:40,387   adding 'deepspeed/ops/op_builder/transformer.py'
2023-11-03T21:28:40,388   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2023-11-03T21:28:40,390   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2023-11-03T21:28:40,391   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2023-11-03T21:28:40,392   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2023-11-03T21:28:40,393   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2023-11-03T21:28:40,394   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2023-11-03T21:28:40,395   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2023-11-03T21:28:40,397   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2023-11-03T21:28:40,398   adding 'deepspeed/ops/op_builder/npu/builder.py'
2023-11-03T21:28:40,399   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2023-11-03T21:28:40,400   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2023-11-03T21:28:40,402   adding 'deepspeed/ops/quantizer/__init__.py'
2023-11-03T21:28:40,403   adding 'deepspeed/ops/quantizer/quantizer.py'
2023-11-03T21:28:40,405   adding 'deepspeed/ops/random_ltd/__init__.py'
2023-11-03T21:28:40,406   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2023-11-03T21:28:40,408   adding 'deepspeed/ops/sparse_attention/__init__.py'
2023-11-03T21:28:40,409   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2023-11-03T21:28:40,413   adding 'deepspeed/ops/sparse_attention/matmul.py'
2023-11-03T21:28:40,415   adding 'deepspeed/ops/sparse_attention/softmax.py'
2023-11-03T21:28:40,417   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2023-11-03T21:28:40,418   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2023-11-03T21:28:40,422   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2023-11-03T21:28:40,424   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2023-11-03T21:28:40,425   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2023-11-03T21:28:40,426   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2023-11-03T21:28:40,428   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2023-11-03T21:28:40,429   adding 'deepspeed/ops/transformer/__init__.py'
2023-11-03T21:28:40,432   adding 'deepspeed/ops/transformer/transformer.py'
2023-11-03T21:28:40,434   adding 'deepspeed/ops/transformer/inference/__init__.py'
2023-11-03T21:28:40,435   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2023-11-03T21:28:40,436   adding 'deepspeed/ops/transformer/inference/config.py'
2023-11-03T21:28:40,438   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2023-11-03T21:28:40,439   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2023-11-03T21:28:40,441   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2023-11-03T21:28:40,443   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2023-11-03T21:28:40,444   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2023-11-03T21:28:40,447   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2023-11-03T21:28:40,448   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2023-11-03T21:28:40,450   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2023-11-03T21:28:40,451   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2023-11-03T21:28:40,453   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2023-11-03T21:28:40,454   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2023-11-03T21:28:40,455   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2023-11-03T21:28:40,457   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2023-11-03T21:28:40,458   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2023-11-03T21:28:40,459   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2023-11-03T21:28:40,461   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2023-11-03T21:28:40,462   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2023-11-03T21:28:40,464   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2023-11-03T21:28:40,466   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2023-11-03T21:28:40,467   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2023-11-03T21:28:40,468   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2023-11-03T21:28:40,470   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2023-11-03T21:28:40,471   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2023-11-03T21:28:40,473   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2023-11-03T21:28:40,474   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2023-11-03T21:28:40,475   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2023-11-03T21:28:40,477   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2023-11-03T21:28:40,479   adding 'deepspeed/pipe/__init__.py'
2023-11-03T21:28:40,480   adding 'deepspeed/profiling/__init__.py'
2023-11-03T21:28:40,481   adding 'deepspeed/profiling/config.py'
2023-11-03T21:28:40,482   adding 'deepspeed/profiling/constants.py'
2023-11-03T21:28:40,484   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2023-11-03T21:28:40,489   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2023-11-03T21:28:40,492   adding 'deepspeed/runtime/__init__.py'
2023-11-03T21:28:40,494   adding 'deepspeed/runtime/bf16_optimizer.py'
2023-11-03T21:28:40,498   adding 'deepspeed/runtime/config.py'
2023-11-03T21:28:40,500   adding 'deepspeed/runtime/config_utils.py'
2023-11-03T21:28:40,502   adding 'deepspeed/runtime/constants.py'
2023-11-03T21:28:40,503   adding 'deepspeed/runtime/dataloader.py'
2023-11-03T21:28:40,505   adding 'deepspeed/runtime/eigenvalue.py'
2023-11-03T21:28:40,522   adding 'deepspeed/runtime/engine.py'
2023-11-03T21:28:40,526   adding 'deepspeed/runtime/hybrid_engine.py'
2023-11-03T21:28:40,530   adding 'deepspeed/runtime/lr_schedules.py'
2023-11-03T21:28:40,531   adding 'deepspeed/runtime/progressive_layer_drop.py'
2023-11-03T21:28:40,533   adding 'deepspeed/runtime/quantize.py'
2023-11-03T21:28:40,534   adding 'deepspeed/runtime/sparse_tensor.py'
2023-11-03T21:28:40,536   adding 'deepspeed/runtime/state_dict_factory.py'
2023-11-03T21:28:40,541   adding 'deepspeed/runtime/utils.py'
2023-11-03T21:28:40,542   adding 'deepspeed/runtime/weight_quantizer.py'
2023-11-03T21:28:40,544   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2023-11-03T21:28:40,549   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2023-11-03T21:28:40,550   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2023-11-03T21:28:40,552   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2023-11-03T21:28:40,553   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2023-11-03T21:28:40,555   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2023-11-03T21:28:40,556   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2023-11-03T21:28:40,558   adding 'deepspeed/runtime/comm/__init__.py'
2023-11-03T21:28:40,559   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2023-11-03T21:28:40,561   adding 'deepspeed/runtime/comm/mpi.py'
2023-11-03T21:28:40,563   adding 'deepspeed/runtime/comm/nccl.py'
2023-11-03T21:28:40,564   adding 'deepspeed/runtime/compression/__init__.py'
2023-11-03T21:28:40,565   adding 'deepspeed/runtime/compression/cupy.py'
2023-11-03T21:28:40,567   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2023-11-03T21:28:40,569   adding 'deepspeed/runtime/data_pipeline/config.py'
2023-11-03T21:28:40,570   adding 'deepspeed/runtime/data_pipeline/constants.py'
2023-11-03T21:28:40,572   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2023-11-03T21:28:40,573   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2023-11-03T21:28:40,575   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2023-11-03T21:28:40,576   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2023-11-03T21:28:40,577   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2023-11-03T21:28:40,579   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2023-11-03T21:28:40,580   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2023-11-03T21:28:40,583   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2023-11-03T21:28:40,585   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2023-11-03T21:28:40,587   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2023-11-03T21:28:40,589   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2023-11-03T21:28:40,590   adding 'deepspeed/runtime/fp16/__init__.py'
2023-11-03T21:28:40,593   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2023-11-03T21:28:40,595   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2023-11-03T21:28:40,597   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2023-11-03T21:28:40,599   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2023-11-03T21:28:40,601   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2023-11-03T21:28:40,604   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2023-11-03T21:28:40,606   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2023-11-03T21:28:40,608   adding 'deepspeed/runtime/pipe/__init__.py'
2023-11-03T21:28:40,614   adding 'deepspeed/runtime/pipe/engine.py'
2023-11-03T21:28:40,618   adding 'deepspeed/runtime/pipe/module.py'
2023-11-03T21:28:40,619   adding 'deepspeed/runtime/pipe/p2p.py'
2023-11-03T21:28:40,621   adding 'deepspeed/runtime/pipe/schedule.py'
2023-11-03T21:28:40,624   adding 'deepspeed/runtime/pipe/topology.py'
2023-11-03T21:28:40,626   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2023-11-03T21:28:40,627   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2023-11-03T21:28:40,628   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2023-11-03T21:28:40,630   adding 'deepspeed/runtime/swap_tensor/constants.py'
2023-11-03T21:28:40,632   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2023-11-03T21:28:40,634   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2023-11-03T21:28:40,636   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2023-11-03T21:28:40,638   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2023-11-03T21:28:40,640   adding 'deepspeed/runtime/swap_tensor/utils.py'
2023-11-03T21:28:40,642   adding 'deepspeed/runtime/zero/__init__.py'
2023-11-03T21:28:40,643   adding 'deepspeed/runtime/zero/config.py'
2023-11-03T21:28:40,645   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2023-11-03T21:28:40,647   adding 'deepspeed/runtime/zero/linear.py'
2023-11-03T21:28:40,650   adding 'deepspeed/runtime/zero/mics.py'
2023-11-03T21:28:40,651   adding 'deepspeed/runtime/zero/mics_utils.py'
2023-11-03T21:28:40,653   adding 'deepspeed/runtime/zero/offload_config.py'
2023-11-03T21:28:40,656   adding 'deepspeed/runtime/zero/parameter_offload.py'
2023-11-03T21:28:40,667   adding 'deepspeed/runtime/zero/partition_parameters.py'
2023-11-03T21:28:40,670   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2023-11-03T21:28:40,672   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2023-11-03T21:28:40,685   adding 'deepspeed/runtime/zero/stage3.py'
2023-11-03T21:28:40,699   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2023-11-03T21:28:40,701   adding 'deepspeed/runtime/zero/test.py'
2023-11-03T21:28:40,703   adding 'deepspeed/runtime/zero/tiling.py'
2023-11-03T21:28:40,705   adding 'deepspeed/runtime/zero/utils.py'
2023-11-03T21:28:40,706   adding 'deepspeed/sequence/__init__.py'
2023-11-03T21:28:40,708   adding 'deepspeed/sequence/layer.py'
2023-11-03T21:28:40,710   adding 'deepspeed/utils/__init__.py'
2023-11-03T21:28:40,711   adding 'deepspeed/utils/comms_logging.py'
2023-11-03T21:28:40,713   adding 'deepspeed/utils/debug.py'
2023-11-03T21:28:40,714   adding 'deepspeed/utils/exceptions.py'
2023-11-03T21:28:40,716   adding 'deepspeed/utils/groups.py'
2023-11-03T21:28:40,718   adding 'deepspeed/utils/init_on_device.py'
2023-11-03T21:28:40,719   adding 'deepspeed/utils/logging.py'
2023-11-03T21:28:40,720   adding 'deepspeed/utils/mixed_precision_linkage.py'
2023-11-03T21:28:40,722   adding 'deepspeed/utils/numa.py'
2023-11-03T21:28:40,723   adding 'deepspeed/utils/nvtx.py'
2023-11-03T21:28:40,724   adding 'deepspeed/utils/tensor_fragment.py'
2023-11-03T21:28:40,726   adding 'deepspeed/utils/timer.py'
2023-11-03T21:28:40,727   adding 'deepspeed/utils/types.py'
2023-11-03T21:28:40,730   adding 'deepspeed/utils/zero_to_fp32.py'
2023-11-03T21:28:40,732   adding 'deepspeed-0.11.2.data/scripts/deepspeed'
2023-11-03T21:28:40,733   adding 'deepspeed-0.11.2.data/scripts/deepspeed.pt'
2023-11-03T21:28:40,734   adding 'deepspeed-0.11.2.data/scripts/ds'
2023-11-03T21:28:40,735   adding 'deepspeed-0.11.2.data/scripts/ds_bench'
2023-11-03T21:28:40,736   adding 'deepspeed-0.11.2.data/scripts/ds_elastic'
2023-11-03T21:28:40,737   adding 'deepspeed-0.11.2.data/scripts/ds_report'
2023-11-03T21:28:40,738   adding 'deepspeed-0.11.2.data/scripts/ds_ssh'
2023-11-03T21:28:40,740   adding 'deepspeed-0.11.2.data/scripts/dsr'
2023-11-03T21:28:40,745   adding 'deepspeed-0.11.2.dist-info/METADATA'
2023-11-03T21:28:40,746   adding 'deepspeed-0.11.2.dist-info/WHEEL'
2023-11-03T21:28:40,747   adding 'deepspeed-0.11.2.dist-info/entry_points.txt'
2023-11-03T21:28:40,748   adding 'deepspeed-0.11.2.dist-info/top_level.txt'
2023-11-03T21:28:40,756   adding 'deepspeed-0.11.2.dist-info/RECORD'
2023-11-03T21:28:40,781   removing build/bdist.linux-armv7l/wheel
2023-11-03T21:28:40,900   deepspeed build time = 6.7586774826049805 secs
2023-11-03T21:28:41,019   Building wheel for deepspeed (setup.py): finished with status 'done'
2023-11-03T21:28:41,034   Created wheel for deepspeed: filename=deepspeed-0.11.2-py3-none-any.whl size=1056227 sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c
2023-11-03T21:28:41,035   Stored in directory: /tmp/pip-ephem-wheel-cache-wyfm4b_u/wheels/52/68/4b/ec7d6812fc10cdae0e43adb5115b6d46683692703dbf729b59
2023-11-03T21:28:41,067 Successfully built deepspeed
2023-11-03T21:28:41,098 Removed build tracker: '/tmp/pip-build-tracker-66zhs6wy'