2023-11-04T04:55:23,506 Created temporary directory: /tmp/pip-build-tracker-rd2imcf5 2023-11-04T04:55:23,507 Initialized build tracking at /tmp/pip-build-tracker-rd2imcf5 2023-11-04T04:55:23,508 Created build tracker: /tmp/pip-build-tracker-rd2imcf5 2023-11-04T04:55:23,508 Entered build tracker: /tmp/pip-build-tracker-rd2imcf5 2023-11-04T04:55:23,509 Created temporary directory: /tmp/pip-wheel-dbqussy7 2023-11-04T04:55:23,512 Created temporary directory: /tmp/pip-ephem-wheel-cache-9usx_nbt 2023-11-04T04:55:23,534 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-11-04T04:55:23,538 2 location(s) to search for versions of deepspeed: 2023-11-04T04:55:23,538 * https://pypi.org/simple/deepspeed/ 2023-11-04T04:55:23,538 * https://www.piwheels.org/simple/deepspeed/ 2023-11-04T04:55:23,539 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-11-04T04:55:23,539 Getting page https://pypi.org/simple/deepspeed/ 2023-11-04T04:55:23,541 Found index url https://pypi.org/simple/ 2023-11-04T04:55:23,684 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-11-04T04:55:23,698 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-04T04:55:23,699 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-11-04T04:55:23,700 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-04T04:55:23,700 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-11-04T04:55:23,701 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-04T04:55:23,702 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-11-04T04:55:23,702 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-04T04:55:23,703 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-11-04T04:55:23,703 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-04T04:55:23,704 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-11-04T04:55:23,705 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-11-04T04:55:23,705 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-11-04T04:55:23,706 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-11-04T04:55:23,707 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-11-04T04:55:23,708 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-11-04T04:55:23,708 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-11-04T04:55:23,709 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-11-04T04:55:23,710 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-11-04T04:55:23,710 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-11-04T04:55:23,711 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-11-04T04:55:23,711 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-11-04T04:55:23,712 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-11-04T04:55:23,713 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-11-04T04:55:23,713 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-11-04T04:55:23,714 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-11-04T04:55:23,715 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-11-04T04:55:23,715 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-11-04T04:55:23,716 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-11-04T04:55:23,717 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-11-04T04:55:23,717 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-11-04T04:55:23,718 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-11-04T04:55:23,719 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-11-04T04:55:23,720 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-11-04T04:55:23,720 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-11-04T04:55:23,721 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-11-04T04:55:23,721 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-11-04T04:55:23,722 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-11-04T04:55:23,722 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-11-04T04:55:23,723 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-11-04T04:55:23,724 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-11-04T04:55:23,724 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-11-04T04:55:23,725 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-11-04T04:55:23,725 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-11-04T04:55:23,726 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-11-04T04:55:23,727 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-11-04T04:55:23,727 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-11-04T04:55:23,728 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-11-04T04:55:23,729 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-11-04T04:55:23,729 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-11-04T04:55:23,730 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-11-04T04:55:23,731 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-11-04T04:55:23,732 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-11-04T04:55:23,732 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-11-04T04:55:23,733 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-11-04T04:55:23,733 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-11-04T04:55:23,734 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-11-04T04:55:23,734 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-11-04T04:55:23,735 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-11-04T04:55:23,736 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-11-04T04:55:23,736 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-11-04T04:55:23,737 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-11-04T04:55:23,737 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-11-04T04:55:23,738 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-11-04T04:55:23,739 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-11-04T04:55:23,739 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-11-04T04:55:23,740 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-11-04T04:55:23,741 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-11-04T04:55:23,741 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-11-04T04:55:23,742 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2023-11-04T04:55:23,743 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2023-11-04T04:55:23,743 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2023-11-04T04:55:23,744 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2023-11-04T04:55:23,744 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2023-11-04T04:55:23,745 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2023-11-04T04:55:23,745 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2023-11-04T04:55:23,746 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2023-11-04T04:55:23,747 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2023-11-04T04:55:23,747 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2023-11-04T04:55:23,748 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2023-11-04T04:55:23,748 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2023-11-04T04:55:23,749 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2023-11-04T04:55:23,750 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-11-04T04:55:23,750 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-11-04T04:55:23,752 Found index url https://www.piwheels.org/simple/ 2023-11-04T04:55:23,912 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-11-04T04:55:23,926 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,927 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,927 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,928 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,929 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,929 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,930 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,930 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,931 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,931 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,932 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,932 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,933 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,933 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,934 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,934 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,935 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,936 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,936 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,937 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,937 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,938 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,939 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,939 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,940 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,940 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,941 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,941 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,942 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,942 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,943 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,943 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,944 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,945 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,945 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,946 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,946 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,946 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,947 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,947 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,948 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,948 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,949 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,950 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,950 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,951 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,951 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,952 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,952 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,953 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,953 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-11-04T04:55:23,954 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-11-04T04:55:23,954 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-11-04T04:55:23,982 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-11-04T04:55:24,002 Collecting deepspeed==0.12.2 2023-11-04T04:55:24,005 Created temporary directory: /tmp/pip-unpack-mmuxwie7 2023-11-04T04:55:24,226 Downloading deepspeed-0.12.2.tar.gz (1.2 MB) 2023-11-04T04:55:26,198 Added deepspeed==0.12.2 from https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz to build tracker '/tmp/pip-build-tracker-rd2imcf5' 2023-11-04T04:55:26,200 Running setup.py (path:/tmp/pip-wheel-dbqussy7/deepspeed_d42af4abc62744d7aeb0e0e2b815c724/setup.py) egg_info for package deepspeed 2023-11-04T04:55:26,201 Created temporary directory: /tmp/pip-pip-egg-info-q2yabvqb 2023-11-04T04:55:26,201 Preparing metadata (setup.py): started 2023-11-04T04:55:26,202 Running command python setup.py egg_info 2023-11-04T04:55:27,083 fatal: not a git repository (or any of the parent directories): .git 2023-11-04T04:55:27,749 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-11-04T04:55:27,750  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-11-04T04:55:27,750 DS_BUILD_OPS=0 2023-11-04T04:55:27,751  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-11-04T04:55:27,751  [WARNING]  async_io: please install the libaio-dev package with apt 2023-11-04T04:55:27,752  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-11-04T04:55:27,752  [WARNING]  Please install torch if trying to pre-compile kernels 2023-11-04T04:55:27,753  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:27,754  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:27,754  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:27,755  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:27,755  [WARNING]  unable to import torch, please install it first 2023-11-04T04:55:27,756  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:27,757  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:27,757 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-11-04T04:55:27,758 version=0.12.2, git_hash=unknown, git_branch=unknown 2023-11-04T04:55:27,758 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2023-11-04T04:55:27,759 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-11-04T04:55:27,759 ext_modules=[] 2023-11-04T04:55:27,759 running egg_info 2023-11-04T04:55:27,760 creating /tmp/pip-pip-egg-info-q2yabvqb/deepspeed.egg-info 2023-11-04T04:55:27,777 writing /tmp/pip-pip-egg-info-q2yabvqb/deepspeed.egg-info/PKG-INFO 2023-11-04T04:55:27,807 writing dependency_links to /tmp/pip-pip-egg-info-q2yabvqb/deepspeed.egg-info/dependency_links.txt 2023-11-04T04:55:27,809 writing entry points to /tmp/pip-pip-egg-info-q2yabvqb/deepspeed.egg-info/entry_points.txt 2023-11-04T04:55:27,824 writing requirements to /tmp/pip-pip-egg-info-q2yabvqb/deepspeed.egg-info/requires.txt 2023-11-04T04:55:27,825 writing top-level names to /tmp/pip-pip-egg-info-q2yabvqb/deepspeed.egg-info/top_level.txt 2023-11-04T04:55:27,827 writing manifest file '/tmp/pip-pip-egg-info-q2yabvqb/deepspeed.egg-info/SOURCES.txt' 2023-11-04T04:55:27,987 reading manifest file '/tmp/pip-pip-egg-info-q2yabvqb/deepspeed.egg-info/SOURCES.txt' 2023-11-04T04:55:27,988 reading manifest template 'MANIFEST.in' 2023-11-04T04:55:27,990 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2023-11-04T04:55:27,990 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2023-11-04T04:55:28,987 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-11-04T04:55:30,008 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-11-04T04:55:30,464 warning: no files found matching '*.tr' under directory 'csrc' 2023-11-04T04:55:30,562 warning: no files found matching '*.cc' under directory 'csrc' 2023-11-04T04:55:30,584 warning: no files found matching '*.py' under directory 'benchmarks' 2023-11-04T04:55:30,616 writing manifest file '/tmp/pip-pip-egg-info-q2yabvqb/deepspeed.egg-info/SOURCES.txt' 2023-11-04T04:55:30,618 deepspeed build time = 3.5306897163391113 secs 2023-11-04T04:55:30,734 Preparing metadata (setup.py): finished with status 'done' 2023-11-04T04:55:30,739 Source in /tmp/pip-wheel-dbqussy7/deepspeed_d42af4abc62744d7aeb0e0e2b815c724 has version 0.12.2, which satisfies requirement deepspeed==0.12.2 from https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz 2023-11-04T04:55:30,740 Removed deepspeed==0.12.2 from https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz from build tracker '/tmp/pip-build-tracker-rd2imcf5' 2023-11-04T04:55:30,749 Created temporary directory: /tmp/pip-unpack-lmw0e1j3 2023-11-04T04:55:30,750 Created temporary directory: /tmp/pip-unpack-0ihazrxb 2023-11-04T04:55:30,995 Building wheels for collected packages: deepspeed 2023-11-04T04:55:30,999 Created temporary directory: /tmp/pip-wheel-9lrwfl93 2023-11-04T04:55:31,000 Building wheel for deepspeed (setup.py): started 2023-11-04T04:55:31,001 Destination directory: /tmp/pip-wheel-9lrwfl93 2023-11-04T04:55:31,002 Running command python setup.py bdist_wheel 2023-11-04T04:55:31,423 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-11-04T04:55:31,430  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-11-04T04:55:31,485 DS_BUILD_OPS=0 2023-11-04T04:55:31,601  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-11-04T04:55:31,660  [WARNING]  async_io: please install the libaio-dev package with apt 2023-11-04T04:55:31,660  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-11-04T04:55:31,661  [WARNING]  Please install torch if trying to pre-compile kernels 2023-11-04T04:55:31,661  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:31,662  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:31,662  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:31,663  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:31,663  [WARNING]  unable to import torch, please install it first 2023-11-04T04:55:31,664  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:31,664  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-04T04:55:31,665 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-11-04T04:55:31,673 fatal: not a git repository (or any of the parent directories): .git 2023-11-04T04:55:31,675 version=0.12.2, git_hash=unknown, git_branch=unknown 2023-11-04T04:55:31,676 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2023-11-04T04:55:31,677 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-11-04T04:55:31,678 ext_modules=[] 2023-11-04T04:55:32,318 running bdist_wheel 2023-11-04T04:55:32,441 running build 2023-11-04T04:55:32,441 running build_py 2023-11-04T04:55:32,469 creating build 2023-11-04T04:55:32,470 creating build/lib 2023-11-04T04:55:32,470 creating build/lib/deepspeed 2023-11-04T04:55:32,472 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-11-04T04:55:32,474 copying deepspeed/constants.py -> build/lib/deepspeed 2023-11-04T04:55:32,476 copying deepspeed/pydantic_v1.py -> build/lib/deepspeed 2023-11-04T04:55:32,477 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-11-04T04:55:32,479 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-11-04T04:55:32,481 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-11-04T04:55:32,484 creating build/lib/deepspeed/compression 2023-11-04T04:55:32,485 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-11-04T04:55:32,487 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-11-04T04:55:32,489 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-11-04T04:55:32,492 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-11-04T04:55:32,495 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-11-04T04:55:32,497 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-11-04T04:55:32,498 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-11-04T04:55:32,501 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-11-04T04:55:32,503 creating build/lib/deepspeed/ops 2023-11-04T04:55:32,504 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-11-04T04:55:32,507 creating build/lib/deepspeed/comm 2023-11-04T04:55:32,507 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-11-04T04:55:32,509 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2023-11-04T04:55:32,511 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-11-04T04:55:32,513 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-11-04T04:55:32,515 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-11-04T04:55:32,517 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2023-11-04T04:55:32,518 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-11-04T04:55:32,521 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-11-04T04:55:32,522 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-11-04T04:55:32,525 creating build/lib/deepspeed/runtime 2023-11-04T04:55:32,526 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,529 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,531 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,533 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,535 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,537 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,540 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,542 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,544 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,547 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,549 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,551 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,555 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,557 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,560 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,561 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-11-04T04:55:32,564 creating build/lib/deepspeed/accelerator 2023-11-04T04:55:32,565 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:55:32,568 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:55:32,570 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:55:32,572 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-11-04T04:55:32,574 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:55:32,576 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:55:32,578 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-04T04:55:32,580 creating build/lib/deepspeed/pipe 2023-11-04T04:55:32,581 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-11-04T04:55:32,583 creating build/lib/deepspeed/profiling 2023-11-04T04:55:32,584 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-11-04T04:55:32,586 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-11-04T04:55:32,587 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-11-04T04:55:32,589 creating build/lib/deepspeed/autotuning 2023-11-04T04:55:32,590 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-11-04T04:55:32,593 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-11-04T04:55:32,595 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-11-04T04:55:32,597 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-11-04T04:55:32,599 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-11-04T04:55:32,601 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-11-04T04:55:32,604 creating build/lib/deepspeed/utils 2023-11-04T04:55:32,605 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,606 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,608 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,610 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,612 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,614 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,616 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,619 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,620 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,622 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,624 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,626 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,627 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,629 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-11-04T04:55:32,632 creating build/lib/deepspeed/monitor 2023-11-04T04:55:32,634 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-11-04T04:55:32,636 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-11-04T04:55:32,638 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-11-04T04:55:32,640 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-11-04T04:55:32,642 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-11-04T04:55:32,644 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-11-04T04:55:32,645 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-11-04T04:55:32,648 creating build/lib/deepspeed/elasticity 2023-11-04T04:55:32,649 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-11-04T04:55:32,650 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-11-04T04:55:32,652 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-11-04T04:55:32,654 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-11-04T04:55:32,656 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-11-04T04:55:32,658 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-11-04T04:55:32,661 creating build/lib/deepspeed/sequence 2023-11-04T04:55:32,662 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2023-11-04T04:55:32,663 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2023-11-04T04:55:32,665 creating build/lib/deepspeed/launcher 2023-11-04T04:55:32,666 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-11-04T04:55:32,668 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-11-04T04:55:32,670 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-11-04T04:55:32,672 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-11-04T04:55:32,675 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-11-04T04:55:32,676 creating build/lib/deepspeed/model_implementations 2023-11-04T04:55:32,677 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-11-04T04:55:32,679 creating build/lib/deepspeed/nebula 2023-11-04T04:55:32,680 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-11-04T04:55:32,682 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-11-04T04:55:32,684 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-11-04T04:55:32,686 creating build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,687 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,691 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,693 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,694 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,696 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,699 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,701 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,703 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,705 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,707 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-11-04T04:55:32,709 creating build/lib/deepspeed/inference 2023-11-04T04:55:32,710 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-11-04T04:55:32,712 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-11-04T04:55:32,714 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-11-04T04:55:32,717 creating build/lib/deepspeed/module_inject 2023-11-04T04:55:32,718 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,720 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,722 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,724 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,726 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,728 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,730 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,732 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,734 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,736 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,738 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,740 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,743 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-11-04T04:55:32,745 creating build/lib/deepspeed/moe 2023-11-04T04:55:32,746 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-11-04T04:55:32,748 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-11-04T04:55:32,751 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-11-04T04:55:32,753 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-11-04T04:55:32,754 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-11-04T04:55:32,756 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-11-04T04:55:32,758 creating build/lib/deepspeed/ops/aio 2023-11-04T04:55:32,759 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-11-04T04:55:32,761 creating build/lib/deepspeed/ops/lamb 2023-11-04T04:55:32,762 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-11-04T04:55:32,764 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-11-04T04:55:32,766 creating build/lib/deepspeed/ops/adagrad 2023-11-04T04:55:32,767 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-11-04T04:55:32,769 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-11-04T04:55:32,771 creating build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,772 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,774 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,775 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,777 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,779 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,780 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,783 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,784 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,786 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,787 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,789 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,791 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,793 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,795 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,796 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,798 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,800 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,802 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,804 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,805 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,807 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,809 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-11-04T04:55:32,811 creating build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:55:32,813 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:55:32,814 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:55:32,817 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:55:32,819 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:55:32,822 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:55:32,824 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:55:32,826 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-04T04:55:32,828 creating build/lib/deepspeed/ops/transformer 2023-11-04T04:55:32,829 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-11-04T04:55:32,831 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-11-04T04:55:32,834 creating build/lib/deepspeed/ops/deepspeed4science 2023-11-04T04:55:32,835 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2023-11-04T04:55:32,837 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2023-11-04T04:55:32,839 creating build/lib/deepspeed/ops/quantizer 2023-11-04T04:55:32,840 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-11-04T04:55:32,841 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-11-04T04:55:32,843 creating build/lib/deepspeed/ops/random_ltd 2023-11-04T04:55:32,844 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-11-04T04:55:32,847 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-11-04T04:55:32,849 creating build/lib/deepspeed/ops/lion 2023-11-04T04:55:32,849 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2023-11-04T04:55:32,852 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2023-11-04T04:55:32,853 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2023-11-04T04:55:32,855 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2023-11-04T04:55:32,857 creating build/lib/deepspeed/ops/adam 2023-11-04T04:55:32,858 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-11-04T04:55:32,861 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-11-04T04:55:32,862 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-11-04T04:55:32,864 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-11-04T04:55:32,867 creating build/lib/deepspeed/ops/op_builder/npu 2023-11-04T04:55:32,868 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-04T04:55:32,869 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-04T04:55:32,871 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-04T04:55:32,873 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-04T04:55:32,875 creating build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:32,876 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:32,878 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:32,880 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:32,882 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:32,884 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:32,885 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:32,887 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:55:32,888 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:55:32,890 creating build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,891 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,894 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,896 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,898 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,900 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,902 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,904 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,906 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,908 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,910 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-04T04:55:32,912 creating build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,913 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,915 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,917 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,919 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,921 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,923 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,925 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,928 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,930 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,932 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:32,935 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,936 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,938 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,940 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,942 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,943 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,945 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,947 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,949 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,951 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,953 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:32,955 creating build/lib/deepspeed/runtime/compression 2023-11-04T04:55:32,956 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-11-04T04:55:32,958 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-11-04T04:55:32,960 creating build/lib/deepspeed/runtime/comm 2023-11-04T04:55:32,960 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-11-04T04:55:32,962 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-11-04T04:55:32,964 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-11-04T04:55:32,966 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-11-04T04:55:32,969 creating build/lib/deepspeed/runtime/pipe 2023-11-04T04:55:32,970 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:55:32,973 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:55:32,975 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:55:32,978 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:55:32,980 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:55:32,981 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-11-04T04:55:32,985 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-11-04T04:55:32,985 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-04T04:55:32,988 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-04T04:55:32,989 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-04T04:55:32,991 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-04T04:55:32,994 creating build/lib/deepspeed/runtime/zero 2023-11-04T04:55:32,995 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:32,997 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:32,999 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,001 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,006 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,008 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,011 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,013 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,015 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,018 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,020 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,022 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,026 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,027 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,030 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,031 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-11-04T04:55:33,034 creating build/lib/deepspeed/runtime/fp16 2023-11-04T04:55:33,035 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-11-04T04:55:33,037 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-11-04T04:55:33,040 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-11-04T04:55:33,042 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-11-04T04:55:33,044 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-11-04T04:55:33,045 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-11-04T04:55:33,048 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-11-04T04:55:33,049 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-11-04T04:55:33,052 creating build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:55:33,053 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:55:33,055 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:55:33,058 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:55:33,059 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:55:33,061 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:55:33,063 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:55:33,065 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:55:33,067 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:55:33,070 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-04T04:55:33,072 creating build/lib/deepspeed/runtime/data_pipeline 2023-11-04T04:55:33,074 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-04T04:55:33,076 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-04T04:55:33,078 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-04T04:55:33,080 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-04T04:55:33,083 creating build/lib/deepspeed/runtime/fp16/onebit 2023-11-04T04:55:33,084 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-04T04:55:33,087 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-04T04:55:33,089 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-04T04:55:33,092 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-04T04:55:33,095 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:33,095 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:33,097 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:33,099 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:33,101 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:33,103 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:33,106 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:33,106 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:33,108 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:33,111 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:33,113 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:33,115 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:33,118 creating build/lib/deepspeed/profiling/flops_profiler 2023-11-04T04:55:33,119 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-11-04T04:55:33,122 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-11-04T04:55:33,124 creating build/lib/deepspeed/autotuning/tuner 2023-11-04T04:55:33,125 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:55:33,127 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:55:33,128 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:55:33,130 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:55:33,132 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:55:33,135 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-11-04T04:55:33,138 creating build/lib/deepspeed/model_implementations/diffusers 2023-11-04T04:55:33,139 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-11-04T04:55:33,141 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-11-04T04:55:33,143 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-11-04T04:55:33,145 creating build/lib/deepspeed/model_implementations/features 2023-11-04T04:55:33,146 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-11-04T04:55:33,148 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-11-04T04:55:33,150 creating build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,151 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,154 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,156 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,157 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,159 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,161 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,162 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,164 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,166 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,168 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-04T04:55:33,170 creating build/lib/deepspeed/inference/quantization 2023-11-04T04:55:33,171 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2023-11-04T04:55:33,173 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2023-11-04T04:55:33,175 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2023-11-04T04:55:33,177 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2023-11-04T04:55:33,179 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2023-11-04T04:55:33,181 creating build/lib/deepspeed/inference/v2 2023-11-04T04:55:33,182 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:55:33,184 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:55:33,185 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:55:33,187 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:55:33,189 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:55:33,191 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:55:33,193 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:55:33,194 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2023-11-04T04:55:33,197 creating build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:55:33,198 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:55:33,200 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:55:33,202 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:55:33,205 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:55:33,207 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:55:33,209 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:55:33,211 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-04T04:55:33,214 creating build/lib/deepspeed/inference/v2/kernels 2023-11-04T04:55:33,215 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2023-11-04T04:55:33,217 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2023-11-04T04:55:33,219 creating build/lib/deepspeed/inference/v2/modules 2023-11-04T04:55:33,220 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2023-11-04T04:55:33,223 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2023-11-04T04:55:33,225 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2023-11-04T04:55:33,226 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2023-11-04T04:55:33,229 creating build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:33,230 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:33,233 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:33,235 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:33,238 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:33,239 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:33,241 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:33,244 creating build/lib/deepspeed/inference/v2/checkpoint 2023-11-04T04:55:33,245 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-04T04:55:33,247 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-04T04:55:33,249 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-04T04:55:33,251 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-04T04:55:33,255 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:55:33,255 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:55:33,258 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:55:33,259 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:55:33,262 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:55:33,263 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:55:33,266 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:33,267 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:33,269 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:33,271 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:33,273 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:33,275 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:33,277 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:33,278 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:33,280 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:33,282 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:33,284 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:33,286 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:33,287 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:33,289 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:33,290 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:33,292 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:33,294 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:33,296 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:55:33,297 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:55:33,299 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:55:33,301 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:33,303 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:33,305 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:33,307 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:33,308 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:33,310 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:33,312 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:33,314 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:33,317 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:33,318 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:33,320 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:33,322 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:33,323 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:33,325 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:33,328 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:55:33,329 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:55:33,331 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:55:33,334 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:33,335 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:33,338 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:33,340 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:33,342 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:33,345 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:33,347 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:33,349 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:33,351 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:33,354 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:33,356 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:33,358 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:33,361 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:33,362 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:33,365 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:33,367 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:33,370 creating build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:33,372 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:33,374 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:33,376 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:33,379 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:33,381 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:33,384 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:33,386 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:33,389 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:33,392 creating build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:33,394 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:33,396 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:33,398 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:33,400 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:33,403 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:33,405 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:33,407 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:33,410 creating build/lib/deepspeed/inference/v2/modules/implementations 2023-11-04T04:55:33,412 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2023-11-04T04:55:33,416 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:55:33,417 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:55:33,420 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:55:33,423 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:55:33,424 copying deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:55:33,427 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:55:33,429 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:55:33,431 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:55:33,432 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:55:33,434 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:55:33,437 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:55:33,438 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:55:33,440 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:55:33,442 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:55:33,444 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:55:33,445 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:55:33,448 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:55:33,450 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:55:33,451 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:55:33,453 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:55:33,456 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:55:33,457 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:55:33,459 copying deepspeed/inference/v2/modules/implementations/moe/gate_fn.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:55:33,461 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:55:33,462 copying deepspeed/inference/v2/modules/implementations/moe/test.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:55:33,465 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:33,466 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:33,468 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:33,470 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:33,472 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:33,474 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:33,475 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:33,477 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:33,479 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:33,481 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:33,483 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:55:33,484 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:55:33,487 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:55:33,489 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:55:33,491 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:55:33,493 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:55:33,494 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:55:33,496 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:55:33,499 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:55:33,501 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:55:33,503 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:33,505 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:33,507 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:33,509 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:33,511 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:33,513 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:33,515 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:33,517 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:33,519 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:33,521 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:33,523 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:55:33,524 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:55:33,527 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:55:33,529 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:55:33,531 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:55:33,534 creating build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,535 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,537 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,539 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,542 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,544 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,546 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,548 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,550 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,553 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,555 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,557 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,559 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,561 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,563 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,565 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,567 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,569 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,572 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,574 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-11-04T04:55:33,576 creating build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:55:33,577 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:55:33,579 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:55:33,581 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:55:33,583 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:55:33,585 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:55:33,586 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:55:33,588 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-04T04:55:33,591 running egg_info 2023-11-04T04:55:33,617 writing deepspeed.egg-info/PKG-INFO 2023-11-04T04:55:33,648 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-11-04T04:55:33,650 writing entry points to deepspeed.egg-info/entry_points.txt 2023-11-04T04:55:33,665 writing requirements to deepspeed.egg-info/requires.txt 2023-11-04T04:55:33,666 writing top-level names to deepspeed.egg-info/top_level.txt 2023-11-04T04:55:33,743 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-11-04T04:55:33,787 reading manifest template 'MANIFEST.in' 2023-11-04T04:55:33,789 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2023-11-04T04:55:33,790 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2023-11-04T04:55:34,758 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-11-04T04:55:35,520 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-11-04T04:55:35,968 warning: no files found matching '*.tr' under directory 'csrc' 2023-11-04T04:55:36,060 warning: no files found matching '*.cc' under directory 'csrc' 2023-11-04T04:55:36,082 warning: no files found matching '*.py' under directory 'benchmarks' 2023-11-04T04:55:36,124 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-11-04T04:55:36,131 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-11-04T04:55:36,132 !! 2023-11-04T04:55:36,133 ******************************************************************************** 2023-11-04T04:55:36,134 ############################ 2023-11-04T04:55:36,135 # Package would be ignored # 2023-11-04T04:55:36,136 ############################ 2023-11-04T04:55:36,136 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-11-04T04:55:36,137 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,137 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,138 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-11-04T04:55:36,138 to the `packages` configuration field. 2023-11-04T04:55:36,139 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,139 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,140 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,141 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,142 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,143 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-11-04T04:55:36,143 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-11-04T04:55:36,143 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,144 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,144 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,145 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,146 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,148 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,148 even if it does not contain any `.py` files. 2023-11-04T04:55:36,149 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,149 directory, all directories are treated like packages. 2023-11-04T04:55:36,150 ******************************************************************************** 2023-11-04T04:55:36,151 !! 2023-11-04T04:55:36,151 check.warn(importable) 2023-11-04T04:55:36,152 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2023-11-04T04:55:36,152 !! 2023-11-04T04:55:36,154 ******************************************************************************** 2023-11-04T04:55:36,154 ############################ 2023-11-04T04:55:36,155 # Package would be ignored # 2023-11-04T04:55:36,155 ############################ 2023-11-04T04:55:36,156 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2023-11-04T04:55:36,156 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,157 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,158 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2023-11-04T04:55:36,158 to the `packages` configuration field. 2023-11-04T04:55:36,159 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,160 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,160 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,161 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,162 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,164 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2023-11-04T04:55:36,164 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2023-11-04T04:55:36,164 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,165 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,165 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,166 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,166 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,167 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,168 even if it does not contain any `.py` files. 2023-11-04T04:55:36,168 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,169 directory, all directories are treated like packages. 2023-11-04T04:55:36,169 ******************************************************************************** 2023-11-04T04:55:36,170 !! 2023-11-04T04:55:36,170 check.warn(importable) 2023-11-04T04:55:36,170 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2023-11-04T04:55:36,171 !! 2023-11-04T04:55:36,172 ******************************************************************************** 2023-11-04T04:55:36,172 ############################ 2023-11-04T04:55:36,172 # Package would be ignored # 2023-11-04T04:55:36,173 ############################ 2023-11-04T04:55:36,173 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2023-11-04T04:55:36,174 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,175 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,175 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2023-11-04T04:55:36,176 to the `packages` configuration field. 2023-11-04T04:55:36,177 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,178 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,178 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,179 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,180 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,181 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2023-11-04T04:55:36,181 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2023-11-04T04:55:36,182 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,182 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,183 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,184 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,185 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,186 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,187 even if it does not contain any `.py` files. 2023-11-04T04:55:36,187 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,188 directory, all directories are treated like packages. 2023-11-04T04:55:36,188 ******************************************************************************** 2023-11-04T04:55:36,189 !! 2023-11-04T04:55:36,189 check.warn(importable) 2023-11-04T04:55:36,190 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2023-11-04T04:55:36,190 !! 2023-11-04T04:55:36,191 ******************************************************************************** 2023-11-04T04:55:36,191 ############################ 2023-11-04T04:55:36,191 # Package would be ignored # 2023-11-04T04:55:36,192 ############################ 2023-11-04T04:55:36,192 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2023-11-04T04:55:36,192 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,193 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,194 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2023-11-04T04:55:36,194 to the `packages` configuration field. 2023-11-04T04:55:36,195 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,195 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,195 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,196 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,197 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,198 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2023-11-04T04:55:36,199 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2023-11-04T04:55:36,199 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,200 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,200 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,201 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,202 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,204 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,204 even if it does not contain any `.py` files. 2023-11-04T04:55:36,204 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,205 directory, all directories are treated like packages. 2023-11-04T04:55:36,205 ******************************************************************************** 2023-11-04T04:55:36,206 !! 2023-11-04T04:55:36,207 check.warn(importable) 2023-11-04T04:55:36,207 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2023-11-04T04:55:36,207 !! 2023-11-04T04:55:36,208 ******************************************************************************** 2023-11-04T04:55:36,209 ############################ 2023-11-04T04:55:36,209 # Package would be ignored # 2023-11-04T04:55:36,210 ############################ 2023-11-04T04:55:36,210 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2023-11-04T04:55:36,211 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,212 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,213 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2023-11-04T04:55:36,213 to the `packages` configuration field. 2023-11-04T04:55:36,214 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,214 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,215 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,215 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,216 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,217 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2023-11-04T04:55:36,217 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2023-11-04T04:55:36,217 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,218 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,218 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,219 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,220 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,221 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,222 even if it does not contain any `.py` files. 2023-11-04T04:55:36,222 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,223 directory, all directories are treated like packages. 2023-11-04T04:55:36,223 ******************************************************************************** 2023-11-04T04:55:36,224 !! 2023-11-04T04:55:36,224 check.warn(importable) 2023-11-04T04:55:36,225 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-11-04T04:55:36,225 !! 2023-11-04T04:55:36,227 ******************************************************************************** 2023-11-04T04:55:36,227 ############################ 2023-11-04T04:55:36,228 # Package would be ignored # 2023-11-04T04:55:36,228 ############################ 2023-11-04T04:55:36,229 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-11-04T04:55:36,230 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,231 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,231 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-11-04T04:55:36,232 to the `packages` configuration field. 2023-11-04T04:55:36,232 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,233 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,233 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,234 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,235 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,236 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-11-04T04:55:36,236 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-11-04T04:55:36,237 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,238 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,238 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,239 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,240 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,241 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,241 even if it does not contain any `.py` files. 2023-11-04T04:55:36,241 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,242 directory, all directories are treated like packages. 2023-11-04T04:55:36,242 ******************************************************************************** 2023-11-04T04:55:36,243 !! 2023-11-04T04:55:36,243 check.warn(importable) 2023-11-04T04:55:36,243 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-11-04T04:55:36,244 !! 2023-11-04T04:55:36,244 ******************************************************************************** 2023-11-04T04:55:36,245 ############################ 2023-11-04T04:55:36,245 # Package would be ignored # 2023-11-04T04:55:36,246 ############################ 2023-11-04T04:55:36,246 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-11-04T04:55:36,247 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,247 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,248 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-11-04T04:55:36,248 to the `packages` configuration field. 2023-11-04T04:55:36,249 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,249 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,250 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,251 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,252 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,253 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-11-04T04:55:36,253 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-11-04T04:55:36,253 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,254 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,254 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,255 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,256 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,257 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,258 even if it does not contain any `.py` files. 2023-11-04T04:55:36,258 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,259 directory, all directories are treated like packages. 2023-11-04T04:55:36,259 ******************************************************************************** 2023-11-04T04:55:36,260 !! 2023-11-04T04:55:36,260 check.warn(importable) 2023-11-04T04:55:36,261 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-11-04T04:55:36,261 !! 2023-11-04T04:55:36,262 ******************************************************************************** 2023-11-04T04:55:36,263 ############################ 2023-11-04T04:55:36,263 # Package would be ignored # 2023-11-04T04:55:36,264 ############################ 2023-11-04T04:55:36,264 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-11-04T04:55:36,265 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,265 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,266 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-11-04T04:55:36,266 to the `packages` configuration field. 2023-11-04T04:55:36,267 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,267 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,268 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,268 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,269 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,270 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-11-04T04:55:36,270 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-11-04T04:55:36,270 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,271 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,271 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,272 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,273 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,274 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,275 even if it does not contain any `.py` files. 2023-11-04T04:55:36,275 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,276 directory, all directories are treated like packages. 2023-11-04T04:55:36,276 ******************************************************************************** 2023-11-04T04:55:36,277 !! 2023-11-04T04:55:36,277 check.warn(importable) 2023-11-04T04:55:36,278 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-11-04T04:55:36,278 !! 2023-11-04T04:55:36,279 ******************************************************************************** 2023-11-04T04:55:36,279 ############################ 2023-11-04T04:55:36,280 # Package would be ignored # 2023-11-04T04:55:36,280 ############################ 2023-11-04T04:55:36,281 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-11-04T04:55:36,281 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,282 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,282 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-11-04T04:55:36,283 to the `packages` configuration field. 2023-11-04T04:55:36,284 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,284 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,285 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,285 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,286 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,287 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-11-04T04:55:36,287 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-11-04T04:55:36,288 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,290 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,291 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,291 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,292 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,293 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,293 even if it does not contain any `.py` files. 2023-11-04T04:55:36,294 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,294 directory, all directories are treated like packages. 2023-11-04T04:55:36,294 ******************************************************************************** 2023-11-04T04:55:36,295 !! 2023-11-04T04:55:36,296 check.warn(importable) 2023-11-04T04:55:36,296 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-11-04T04:55:36,296 !! 2023-11-04T04:55:36,297 ******************************************************************************** 2023-11-04T04:55:36,298 ############################ 2023-11-04T04:55:36,298 # Package would be ignored # 2023-11-04T04:55:36,298 ############################ 2023-11-04T04:55:36,299 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-11-04T04:55:36,299 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,300 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,300 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-11-04T04:55:36,301 to the `packages` configuration field. 2023-11-04T04:55:36,302 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,302 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,303 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,303 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,304 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,305 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-11-04T04:55:36,306 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-11-04T04:55:36,306 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,306 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,307 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,308 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,309 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,310 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,310 even if it does not contain any `.py` files. 2023-11-04T04:55:36,311 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,311 directory, all directories are treated like packages. 2023-11-04T04:55:36,312 ******************************************************************************** 2023-11-04T04:55:36,313 !! 2023-11-04T04:55:36,313 check.warn(importable) 2023-11-04T04:55:36,313 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-11-04T04:55:36,314 !! 2023-11-04T04:55:36,314 ******************************************************************************** 2023-11-04T04:55:36,315 ############################ 2023-11-04T04:55:36,315 # Package would be ignored # 2023-11-04T04:55:36,315 ############################ 2023-11-04T04:55:36,316 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-11-04T04:55:36,316 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,317 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,317 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-11-04T04:55:36,318 to the `packages` configuration field. 2023-11-04T04:55:36,318 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,319 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,319 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,320 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,321 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,321 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-11-04T04:55:36,322 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-11-04T04:55:36,322 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,322 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,323 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,324 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,325 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,326 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,326 even if it does not contain any `.py` files. 2023-11-04T04:55:36,327 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,327 directory, all directories are treated like packages. 2023-11-04T04:55:36,328 ******************************************************************************** 2023-11-04T04:55:36,329 !! 2023-11-04T04:55:36,329 check.warn(importable) 2023-11-04T04:55:36,330 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2023-11-04T04:55:36,330 !! 2023-11-04T04:55:36,331 ******************************************************************************** 2023-11-04T04:55:36,331 ############################ 2023-11-04T04:55:36,332 # Package would be ignored # 2023-11-04T04:55:36,332 ############################ 2023-11-04T04:55:36,333 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2023-11-04T04:55:36,333 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,334 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,335 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2023-11-04T04:55:36,335 to the `packages` configuration field. 2023-11-04T04:55:36,336 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,336 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,337 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,338 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,338 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,339 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2023-11-04T04:55:36,339 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2023-11-04T04:55:36,340 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,340 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,340 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,341 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,342 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,343 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,343 even if it does not contain any `.py` files. 2023-11-04T04:55:36,344 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,344 directory, all directories are treated like packages. 2023-11-04T04:55:36,344 ******************************************************************************** 2023-11-04T04:55:36,345 !! 2023-11-04T04:55:36,346 check.warn(importable) 2023-11-04T04:55:36,346 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2023-11-04T04:55:36,346 !! 2023-11-04T04:55:36,347 ******************************************************************************** 2023-11-04T04:55:36,348 ############################ 2023-11-04T04:55:36,348 # Package would be ignored # 2023-11-04T04:55:36,349 ############################ 2023-11-04T04:55:36,349 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2023-11-04T04:55:36,350 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,350 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,351 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2023-11-04T04:55:36,352 to the `packages` configuration field. 2023-11-04T04:55:36,353 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,353 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,354 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,355 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,355 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,356 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2023-11-04T04:55:36,361 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2023-11-04T04:55:36,362 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,362 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,363 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,364 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,365 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,367 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,368 even if it does not contain any `.py` files. 2023-11-04T04:55:36,368 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,369 directory, all directories are treated like packages. 2023-11-04T04:55:36,369 ******************************************************************************** 2023-11-04T04:55:36,370 !! 2023-11-04T04:55:36,370 check.warn(importable) 2023-11-04T04:55:36,371 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2023-11-04T04:55:36,371 !! 2023-11-04T04:55:36,372 ******************************************************************************** 2023-11-04T04:55:36,372 ############################ 2023-11-04T04:55:36,373 # Package would be ignored # 2023-11-04T04:55:36,373 ############################ 2023-11-04T04:55:36,374 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2023-11-04T04:55:36,374 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,375 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,376 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2023-11-04T04:55:36,376 to the `packages` configuration field. 2023-11-04T04:55:36,377 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,378 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,378 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,380 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,381 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,382 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2023-11-04T04:55:36,383 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2023-11-04T04:55:36,383 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,384 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,384 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,385 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,386 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,388 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,388 even if it does not contain any `.py` files. 2023-11-04T04:55:36,389 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,389 directory, all directories are treated like packages. 2023-11-04T04:55:36,390 ******************************************************************************** 2023-11-04T04:55:36,391 !! 2023-11-04T04:55:36,392 check.warn(importable) 2023-11-04T04:55:36,392 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2023-11-04T04:55:36,393 !! 2023-11-04T04:55:36,394 ******************************************************************************** 2023-11-04T04:55:36,394 ############################ 2023-11-04T04:55:36,395 # Package would be ignored # 2023-11-04T04:55:36,395 ############################ 2023-11-04T04:55:36,396 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2023-11-04T04:55:36,397 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,398 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,399 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2023-11-04T04:55:36,399 to the `packages` configuration field. 2023-11-04T04:55:36,400 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,400 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,401 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,402 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,403 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,404 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2023-11-04T04:55:36,405 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2023-11-04T04:55:36,405 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,406 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,406 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,407 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,408 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,410 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,410 even if it does not contain any `.py` files. 2023-11-04T04:55:36,411 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,412 directory, all directories are treated like packages. 2023-11-04T04:55:36,412 ******************************************************************************** 2023-11-04T04:55:36,413 !! 2023-11-04T04:55:36,414 check.warn(importable) 2023-11-04T04:55:36,414 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2023-11-04T04:55:36,415 !! 2023-11-04T04:55:36,416 ******************************************************************************** 2023-11-04T04:55:36,416 ############################ 2023-11-04T04:55:36,417 # Package would be ignored # 2023-11-04T04:55:36,417 ############################ 2023-11-04T04:55:36,418 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2023-11-04T04:55:36,419 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,420 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,421 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2023-11-04T04:55:36,421 to the `packages` configuration field. 2023-11-04T04:55:36,422 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,423 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,423 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,424 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,426 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,427 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2023-11-04T04:55:36,428 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2023-11-04T04:55:36,428 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,429 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,429 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,431 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,432 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,433 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,434 even if it does not contain any `.py` files. 2023-11-04T04:55:36,434 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,434 directory, all directories are treated like packages. 2023-11-04T04:55:36,435 ******************************************************************************** 2023-11-04T04:55:36,436 !! 2023-11-04T04:55:36,436 check.warn(importable) 2023-11-04T04:55:36,437 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2023-11-04T04:55:36,437 !! 2023-11-04T04:55:36,438 ******************************************************************************** 2023-11-04T04:55:36,439 ############################ 2023-11-04T04:55:36,439 # Package would be ignored # 2023-11-04T04:55:36,440 ############################ 2023-11-04T04:55:36,440 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2023-11-04T04:55:36,441 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,442 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,442 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2023-11-04T04:55:36,443 to the `packages` configuration field. 2023-11-04T04:55:36,444 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,445 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,445 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,446 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,448 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,449 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2023-11-04T04:55:36,449 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2023-11-04T04:55:36,450 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,450 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,451 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,453 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,454 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,456 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,457 even if it does not contain any `.py` files. 2023-11-04T04:55:36,457 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,458 directory, all directories are treated like packages. 2023-11-04T04:55:36,459 ******************************************************************************** 2023-11-04T04:55:36,461 !! 2023-11-04T04:55:36,461 check.warn(importable) 2023-11-04T04:55:36,462 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2023-11-04T04:55:36,462 !! 2023-11-04T04:55:36,463 ******************************************************************************** 2023-11-04T04:55:36,464 ############################ 2023-11-04T04:55:36,465 # Package would be ignored # 2023-11-04T04:55:36,465 ############################ 2023-11-04T04:55:36,466 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2023-11-04T04:55:36,467 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,468 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,469 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2023-11-04T04:55:36,469 to the `packages` configuration field. 2023-11-04T04:55:36,471 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,471 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,472 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,473 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,475 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,476 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2023-11-04T04:55:36,477 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2023-11-04T04:55:36,477 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,478 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,480 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,482 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,483 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,485 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,486 even if it does not contain any `.py` files. 2023-11-04T04:55:36,486 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,487 directory, all directories are treated like packages. 2023-11-04T04:55:36,488 ******************************************************************************** 2023-11-04T04:55:36,489 !! 2023-11-04T04:55:36,490 check.warn(importable) 2023-11-04T04:55:36,491 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2023-11-04T04:55:36,491 !! 2023-11-04T04:55:36,493 ******************************************************************************** 2023-11-04T04:55:36,493 ############################ 2023-11-04T04:55:36,494 # Package would be ignored # 2023-11-04T04:55:36,495 ############################ 2023-11-04T04:55:36,495 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2023-11-04T04:55:36,496 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,497 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,498 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2023-11-04T04:55:36,499 to the `packages` configuration field. 2023-11-04T04:55:36,500 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,501 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,502 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,503 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,504 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,505 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2023-11-04T04:55:36,506 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2023-11-04T04:55:36,506 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,507 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,508 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,509 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,511 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,513 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,513 even if it does not contain any `.py` files. 2023-11-04T04:55:36,514 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,515 directory, all directories are treated like packages. 2023-11-04T04:55:36,515 ******************************************************************************** 2023-11-04T04:55:36,517 !! 2023-11-04T04:55:36,517 check.warn(importable) 2023-11-04T04:55:36,518 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-11-04T04:55:36,519 !! 2023-11-04T04:55:36,520 ******************************************************************************** 2023-11-04T04:55:36,521 ############################ 2023-11-04T04:55:36,521 # Package would be ignored # 2023-11-04T04:55:36,522 ############################ 2023-11-04T04:55:36,523 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-11-04T04:55:36,523 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,525 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,525 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-11-04T04:55:36,526 to the `packages` configuration field. 2023-11-04T04:55:36,528 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,528 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,529 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,530 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,532 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,534 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-11-04T04:55:36,535 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-11-04T04:55:36,535 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,536 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,537 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,539 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,540 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,542 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,543 even if it does not contain any `.py` files. 2023-11-04T04:55:36,543 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,544 directory, all directories are treated like packages. 2023-11-04T04:55:36,544 ******************************************************************************** 2023-11-04T04:55:36,546 !! 2023-11-04T04:55:36,546 check.warn(importable) 2023-11-04T04:55:36,547 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-11-04T04:55:36,548 !! 2023-11-04T04:55:36,549 ******************************************************************************** 2023-11-04T04:55:36,550 ############################ 2023-11-04T04:55:36,551 # Package would be ignored # 2023-11-04T04:55:36,551 ############################ 2023-11-04T04:55:36,552 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-11-04T04:55:36,552 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,553 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,554 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-11-04T04:55:36,554 to the `packages` configuration field. 2023-11-04T04:55:36,555 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,556 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,556 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,558 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,559 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,560 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-11-04T04:55:36,561 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-11-04T04:55:36,561 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,562 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,562 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,563 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,564 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,566 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,567 even if it does not contain any `.py` files. 2023-11-04T04:55:36,567 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,568 directory, all directories are treated like packages. 2023-11-04T04:55:36,568 ******************************************************************************** 2023-11-04T04:55:36,569 !! 2023-11-04T04:55:36,570 check.warn(importable) 2023-11-04T04:55:36,570 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2023-11-04T04:55:36,571 !! 2023-11-04T04:55:36,572 ******************************************************************************** 2023-11-04T04:55:36,573 ############################ 2023-11-04T04:55:36,573 # Package would be ignored # 2023-11-04T04:55:36,574 ############################ 2023-11-04T04:55:36,574 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2023-11-04T04:55:36,575 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,575 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,576 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2023-11-04T04:55:36,576 to the `packages` configuration field. 2023-11-04T04:55:36,577 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,578 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,578 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,579 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,580 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,581 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2023-11-04T04:55:36,581 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2023-11-04T04:55:36,582 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,582 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,582 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,583 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,585 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,586 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,587 even if it does not contain any `.py` files. 2023-11-04T04:55:36,587 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,588 directory, all directories are treated like packages. 2023-11-04T04:55:36,588 ******************************************************************************** 2023-11-04T04:55:36,589 !! 2023-11-04T04:55:36,590 check.warn(importable) 2023-11-04T04:55:36,590 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-11-04T04:55:36,591 !! 2023-11-04T04:55:36,592 ******************************************************************************** 2023-11-04T04:55:36,592 ############################ 2023-11-04T04:55:36,593 # Package would be ignored # 2023-11-04T04:55:36,593 ############################ 2023-11-04T04:55:36,594 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-11-04T04:55:36,594 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,596 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,596 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-11-04T04:55:36,597 to the `packages` configuration field. 2023-11-04T04:55:36,598 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,598 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,599 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,600 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,601 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,602 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-11-04T04:55:36,603 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-11-04T04:55:36,603 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,604 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,604 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,605 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,606 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,608 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,608 even if it does not contain any `.py` files. 2023-11-04T04:55:36,609 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,609 directory, all directories are treated like packages. 2023-11-04T04:55:36,610 ******************************************************************************** 2023-11-04T04:55:36,611 !! 2023-11-04T04:55:36,611 check.warn(importable) 2023-11-04T04:55:36,612 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-11-04T04:55:36,612 !! 2023-11-04T04:55:36,613 ******************************************************************************** 2023-11-04T04:55:36,614 ############################ 2023-11-04T04:55:36,614 # Package would be ignored # 2023-11-04T04:55:36,615 ############################ 2023-11-04T04:55:36,615 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-11-04T04:55:36,616 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,617 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,617 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-11-04T04:55:36,618 to the `packages` configuration field. 2023-11-04T04:55:36,619 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,619 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,620 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,621 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,622 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,623 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-11-04T04:55:36,623 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-11-04T04:55:36,624 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,624 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,625 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,626 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,627 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,629 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,629 even if it does not contain any `.py` files. 2023-11-04T04:55:36,630 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,630 directory, all directories are treated like packages. 2023-11-04T04:55:36,631 ******************************************************************************** 2023-11-04T04:55:36,632 !! 2023-11-04T04:55:36,633 check.warn(importable) 2023-11-04T04:55:36,633 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-11-04T04:55:36,634 !! 2023-11-04T04:55:36,635 ******************************************************************************** 2023-11-04T04:55:36,635 ############################ 2023-11-04T04:55:36,636 # Package would be ignored # 2023-11-04T04:55:36,636 ############################ 2023-11-04T04:55:36,637 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-11-04T04:55:36,637 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,638 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,638 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-11-04T04:55:36,639 to the `packages` configuration field. 2023-11-04T04:55:36,640 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,640 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,641 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,642 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,643 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,644 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-11-04T04:55:36,644 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-11-04T04:55:36,645 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,645 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,646 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,647 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,648 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,650 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,650 even if it does not contain any `.py` files. 2023-11-04T04:55:36,651 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,651 directory, all directories are treated like packages. 2023-11-04T04:55:36,652 ******************************************************************************** 2023-11-04T04:55:36,653 !! 2023-11-04T04:55:36,653 check.warn(importable) 2023-11-04T04:55:36,654 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-11-04T04:55:36,654 !! 2023-11-04T04:55:36,656 ******************************************************************************** 2023-11-04T04:55:36,656 ############################ 2023-11-04T04:55:36,657 # Package would be ignored # 2023-11-04T04:55:36,657 ############################ 2023-11-04T04:55:36,658 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-11-04T04:55:36,658 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,660 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,660 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-11-04T04:55:36,661 to the `packages` configuration field. 2023-11-04T04:55:36,662 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,663 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,664 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,665 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,666 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,667 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-11-04T04:55:36,667 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-11-04T04:55:36,668 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,668 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,669 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,670 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,671 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,673 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,673 even if it does not contain any `.py` files. 2023-11-04T04:55:36,674 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,674 directory, all directories are treated like packages. 2023-11-04T04:55:36,675 ******************************************************************************** 2023-11-04T04:55:36,676 !! 2023-11-04T04:55:36,676 check.warn(importable) 2023-11-04T04:55:36,677 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-11-04T04:55:36,678 !! 2023-11-04T04:55:36,679 ******************************************************************************** 2023-11-04T04:55:36,680 ############################ 2023-11-04T04:55:36,680 # Package would be ignored # 2023-11-04T04:55:36,681 ############################ 2023-11-04T04:55:36,681 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-11-04T04:55:36,682 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,683 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,683 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-11-04T04:55:36,684 to the `packages` configuration field. 2023-11-04T04:55:36,685 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,686 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,686 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,687 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,688 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,689 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-11-04T04:55:36,690 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-11-04T04:55:36,691 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,691 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,692 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,693 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,694 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,697 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,697 even if it does not contain any `.py` files. 2023-11-04T04:55:36,698 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,698 directory, all directories are treated like packages. 2023-11-04T04:55:36,699 ******************************************************************************** 2023-11-04T04:55:36,700 !! 2023-11-04T04:55:36,700 check.warn(importable) 2023-11-04T04:55:36,701 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-11-04T04:55:36,701 !! 2023-11-04T04:55:36,702 ******************************************************************************** 2023-11-04T04:55:36,702 ############################ 2023-11-04T04:55:36,703 # Package would be ignored # 2023-11-04T04:55:36,703 ############################ 2023-11-04T04:55:36,704 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-11-04T04:55:36,704 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,705 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,706 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-11-04T04:55:36,706 to the `packages` configuration field. 2023-11-04T04:55:36,707 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,708 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,708 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,710 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,711 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,712 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-11-04T04:55:36,713 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-11-04T04:55:36,713 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,714 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,714 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,716 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,717 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,719 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,720 even if it does not contain any `.py` files. 2023-11-04T04:55:36,720 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,721 directory, all directories are treated like packages. 2023-11-04T04:55:36,721 ******************************************************************************** 2023-11-04T04:55:36,723 !! 2023-11-04T04:55:36,723 check.warn(importable) 2023-11-04T04:55:36,724 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-11-04T04:55:36,725 !! 2023-11-04T04:55:36,726 ******************************************************************************** 2023-11-04T04:55:36,727 ############################ 2023-11-04T04:55:36,727 # Package would be ignored # 2023-11-04T04:55:36,728 ############################ 2023-11-04T04:55:36,729 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-11-04T04:55:36,729 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,731 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,732 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-11-04T04:55:36,732 to the `packages` configuration field. 2023-11-04T04:55:36,733 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,733 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,734 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,735 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,736 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,737 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-11-04T04:55:36,738 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-11-04T04:55:36,738 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,739 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,739 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,740 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,742 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,743 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,744 even if it does not contain any `.py` files. 2023-11-04T04:55:36,744 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,745 directory, all directories are treated like packages. 2023-11-04T04:55:36,746 ******************************************************************************** 2023-11-04T04:55:36,747 !! 2023-11-04T04:55:36,748 check.warn(importable) 2023-11-04T04:55:36,748 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-11-04T04:55:36,748 !! 2023-11-04T04:55:36,749 ******************************************************************************** 2023-11-04T04:55:36,750 ############################ 2023-11-04T04:55:36,750 # Package would be ignored # 2023-11-04T04:55:36,751 ############################ 2023-11-04T04:55:36,751 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-11-04T04:55:36,752 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,753 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,753 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-11-04T04:55:36,754 to the `packages` configuration field. 2023-11-04T04:55:36,755 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,755 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,756 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,757 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,758 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,759 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-11-04T04:55:36,760 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-11-04T04:55:36,760 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,761 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,761 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,762 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,763 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,764 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,765 even if it does not contain any `.py` files. 2023-11-04T04:55:36,765 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,766 directory, all directories are treated like packages. 2023-11-04T04:55:36,766 ******************************************************************************** 2023-11-04T04:55:36,767 !! 2023-11-04T04:55:36,768 check.warn(importable) 2023-11-04T04:55:36,768 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-11-04T04:55:36,769 !! 2023-11-04T04:55:36,770 ******************************************************************************** 2023-11-04T04:55:36,770 ############################ 2023-11-04T04:55:36,771 # Package would be ignored # 2023-11-04T04:55:36,771 ############################ 2023-11-04T04:55:36,772 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-11-04T04:55:36,773 but it is absent from setuptools' `packages` configuration. 2023-11-04T04:55:36,774 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-04T04:55:36,775 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-11-04T04:55:36,775 to the `packages` configuration field. 2023-11-04T04:55:36,776 Alternatively, you can also rely on setuptools' discovery methods 2023-11-04T04:55:36,777 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-04T04:55:36,777 instead of `find_packages(...)`/`find:`). 2023-11-04T04:55:36,778 You can read more about "package discovery" on setuptools documentation page: 2023-11-04T04:55:36,779 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-04T04:55:36,780 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-11-04T04:55:36,781 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-11-04T04:55:36,781 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-04T04:55:36,782 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-04T04:55:36,782 combination with a more fine grained `package-data` configuration. 2023-11-04T04:55:36,783 You can read more about "package data files" on setuptools documentation page: 2023-11-04T04:55:36,784 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-04T04:55:36,786 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-04T04:55:36,786 even if it does not contain any `.py` files. 2023-11-04T04:55:36,787 On the other hand, currently there is no concept of package data 2023-11-04T04:55:36,787 directory, all directories are treated like packages. 2023-11-04T04:55:36,788 ******************************************************************************** 2023-11-04T04:55:36,789 !! 2023-11-04T04:55:36,790 check.warn(importable) 2023-11-04T04:55:36,790 creating build/lib/deepspeed/ops/csrc 2023-11-04T04:55:36,791 creating build/lib/deepspeed/ops/csrc/adagrad 2023-11-04T04:55:36,791 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-11-04T04:55:36,792 creating build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:55:36,792 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:55:36,793 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:55:36,793 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:55:36,794 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:55:36,794 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-11-04T04:55:36,795 creating build/lib/deepspeed/ops/csrc/aio 2023-11-04T04:55:36,795 creating build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:36,795 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:36,796 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:36,796 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:36,797 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:36,797 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:36,798 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:36,798 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,799 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,799 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,800 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,800 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,801 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,801 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,802 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,802 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,803 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,803 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,804 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:36,804 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-11-04T04:55:36,805 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-11-04T04:55:36,805 creating build/lib/deepspeed/ops/csrc/common 2023-11-04T04:55:36,806 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-11-04T04:55:36,806 creating build/lib/deepspeed/ops/csrc/cpu 2023-11-04T04:55:36,807 creating build/lib/deepspeed/ops/csrc/cpu/adam 2023-11-04T04:55:36,807 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2023-11-04T04:55:36,808 creating build/lib/deepspeed/ops/csrc/cpu/comm 2023-11-04T04:55:36,808 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2023-11-04T04:55:36,809 creating build/lib/deepspeed/ops/csrc/cpu/lion 2023-11-04T04:55:36,810 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2023-11-04T04:55:36,810 creating build/lib/deepspeed/ops/csrc/deepspeed4science 2023-11-04T04:55:36,810 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:36,811 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:36,811 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:36,812 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:36,812 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:36,812 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:36,813 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:36,813 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:55:36,814 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:55:36,814 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:55:36,815 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:55:36,815 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:55:36,815 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:36,816 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:36,817 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:36,817 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:36,817 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:36,818 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:36,818 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:36,819 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:36,819 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:36,820 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:36,820 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:36,821 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:36,822 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:36,822 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:36,823 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:36,823 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:36,823 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:55:36,824 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:55:36,824 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:55:36,825 creating build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,825 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,826 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,826 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,827 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,827 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,828 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,828 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,828 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,829 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,829 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,830 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,830 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,831 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,831 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,832 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,832 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,833 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,833 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,834 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,834 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,835 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,835 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,836 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,837 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,837 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,837 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,838 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,838 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,839 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-04T04:55:36,839 creating build/lib/deepspeed/ops/csrc/lamb 2023-11-04T04:55:36,839 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-11-04T04:55:36,840 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-11-04T04:55:36,840 creating build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:55:36,841 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:55:36,841 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:55:36,842 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:55:36,842 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:55:36,843 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2023-11-04T04:55:36,844 creating build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:55:36,844 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:55:36,844 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:55:36,845 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:55:36,845 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:55:36,846 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:55:36,846 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:55:36,847 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-04T04:55:36,847 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-11-04T04:55:36,848 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-04T04:55:36,848 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-04T04:55:36,849 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-04T04:55:36,849 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-04T04:55:36,850 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-11-04T04:55:36,850 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-11-04T04:55:36,851 creating build/lib/deepspeed/ops/csrc/spatial 2023-11-04T04:55:36,851 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:55:36,852 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:55:36,852 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:55:36,853 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-11-04T04:55:36,853 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-11-04T04:55:36,854 creating build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:55:36,854 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:55:36,854 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:55:36,855 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:55:36,855 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:55:36,856 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:55:36,856 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:55:36,857 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:55:36,857 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-04T04:55:36,857 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-11-04T04:55:36,858 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,858 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,859 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,859 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,860 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,860 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,861 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,861 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,862 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,862 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,862 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:36,863 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:55:36,863 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:55:36,864 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:55:36,864 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:55:36,865 creating build/lib/deepspeed/ops/csrc/utils 2023-11-04T04:55:36,865 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-11-04T04:55:36,866 creating build/lib/deepspeed/autotuning/config_templates 2023-11-04T04:55:36,866 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-04T04:55:36,867 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-04T04:55:36,867 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-04T04:55:36,868 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-04T04:55:36,868 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:55:36,869 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:55:36,869 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:55:36,870 creating build/lib/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:55:36,870 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:55:36,871 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:55:36,871 creating build/lib/deepspeed/inference/v2/ragged/includes 2023-11-04T04:55:36,872 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2023-11-04T04:55:36,872 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:55:36,873 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:55:36,873 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:55:36,874 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:55:36,874 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:55:36,875 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:55:36,875 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:55:36,876 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-04T04:55:36,876 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-04T04:55:36,877 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:36,877 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:36,878 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:36,878 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:36,879 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:36,879 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:36,880 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:36,880 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:36,881 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:36,882 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:36,882 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:36,883 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:36,885 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:55:36,887 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:55:36,889 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:36,891 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:36,893 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:36,895 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:36,897 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:36,900 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:36,902 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:36,904 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:36,906 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:36,908 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:36,910 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:36,912 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:36,914 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:36,916 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:36,918 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:36,920 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:36,922 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:55:36,924 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:55:36,926 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:36,929 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:36,931 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:36,933 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:36,934 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:36,936 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:36,939 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:36,940 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:36,942 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:36,944 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:36,946 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:36,948 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:36,950 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:36,952 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:36,954 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:36,956 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:36,959 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:36,960 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:37,006 running build_scripts 2023-11-04T04:55:37,006 creating build/scripts-3.11 2023-11-04T04:55:37,007 copying and adjusting bin/deepspeed -> build/scripts-3.11 2023-11-04T04:55:37,009 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2023-11-04T04:55:37,010 copying and adjusting bin/ds -> build/scripts-3.11 2023-11-04T04:55:37,012 copying bin/ds_ssh -> build/scripts-3.11 2023-11-04T04:55:37,014 copying and adjusting bin/ds_report -> build/scripts-3.11 2023-11-04T04:55:37,015 copying and adjusting bin/ds_bench -> build/scripts-3.11 2023-11-04T04:55:37,016 copying and adjusting bin/dsr -> build/scripts-3.11 2023-11-04T04:55:37,018 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2023-11-04T04:55:37,019 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2023-11-04T04:55:37,019 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2023-11-04T04:55:37,020 changing mode of build/scripts-3.11/ds from 644 to 755 2023-11-04T04:55:37,020 changing mode of build/scripts-3.11/ds_report from 644 to 755 2023-11-04T04:55:37,021 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2023-11-04T04:55:37,021 changing mode of build/scripts-3.11/dsr from 644 to 755 2023-11-04T04:55:37,022 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2023-11-04T04:55:37,047 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-11-04T04:55:37,048 !! 2023-11-04T04:55:37,049 ******************************************************************************** 2023-11-04T04:55:37,049 Please avoid running ``setup.py`` directly. 2023-11-04T04:55:37,050 Instead, use pypa/build, pypa/installer or other 2023-11-04T04:55:37,050 standards-based tools. 2023-11-04T04:55:37,051 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-11-04T04:55:37,051 ******************************************************************************** 2023-11-04T04:55:37,052 !! 2023-11-04T04:55:37,053 self.initialize_options() 2023-11-04T04:55:37,074 installing to build/bdist.linux-armv7l/wheel 2023-11-04T04:55:37,075 running install 2023-11-04T04:55:37,099 running install_lib 2023-11-04T04:55:37,124 creating build/bdist.linux-armv7l 2023-11-04T04:55:37,125 creating build/bdist.linux-armv7l/wheel 2023-11-04T04:55:37,127 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:55:37,127 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:55:37,130 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:55:37,131 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:55:37,133 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:55:37,135 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:55:37,138 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:55:37,140 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:55:37,143 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:55:37,145 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:55:37,147 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-04T04:55:37,150 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-11-04T04:55:37,152 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-11-04T04:55:37,153 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-11-04T04:55:37,155 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-11-04T04:55:37,157 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-11-04T04:55:37,159 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-11-04T04:55:37,162 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-11-04T04:55:37,163 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-11-04T04:55:37,165 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-11-04T04:55:37,168 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,169 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,171 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,174 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,175 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,177 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,180 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,182 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,184 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,186 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,188 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,190 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,192 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,195 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,197 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,199 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,201 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,203 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-04T04:55:37,204 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-04T04:55:37,207 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-04T04:55:37,208 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-04T04:55:37,210 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-04T04:55:37,212 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,215 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,216 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,218 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,222 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,224 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-04T04:55:37,226 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:37,227 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:37,229 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:37,231 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:37,233 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:37,235 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:37,237 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-04T04:55:37,239 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:55:37,240 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:55:37,243 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:55:37,245 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:55:37,248 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:55:37,251 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:55:37,254 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:55:37,256 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-04T04:55:37,260 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:55:37,261 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:55:37,264 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:55:37,267 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:55:37,269 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-04T04:55:37,272 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-11-04T04:55:37,273 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-11-04T04:55:37,276 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,278 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,281 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,285 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,286 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,288 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,291 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,293 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,296 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,298 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,300 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,303 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,306 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,308 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-04T04:55:37,311 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,314 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,316 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,319 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,321 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,324 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,326 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,328 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-04T04:55:37,331 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,332 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,335 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,337 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,339 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,341 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,344 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,346 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,348 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,350 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,353 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-04T04:55:37,355 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-11-04T04:55:37,358 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-11-04T04:55:37,359 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-11-04T04:55:37,362 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-11-04T04:55:37,364 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-11-04T04:55:37,365 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-11-04T04:55:37,367 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-11-04T04:55:37,369 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-11-04T04:55:37,372 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-11-04T04:55:37,373 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-11-04T04:55:37,375 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:37,376 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:37,379 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:37,381 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:37,383 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:37,386 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:37,388 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-04T04:55:37,391 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,392 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,394 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,397 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,399 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,401 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,404 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,406 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,408 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,410 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,413 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,415 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-04T04:55:37,418 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-11-04T04:55:37,419 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-11-04T04:55:37,421 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-11-04T04:55:37,422 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-11-04T04:55:37,425 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-11-04T04:55:37,428 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-11-04T04:55:37,429 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-11-04T04:55:37,432 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-11-04T04:55:37,433 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-11-04T04:55:37,436 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:55:37,437 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:55:37,442 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:55:37,444 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:55:37,448 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:55:37,451 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:55:37,454 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:55:37,457 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:55:37,459 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-04T04:55:37,463 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-11-04T04:55:37,464 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,465 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,468 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,470 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,473 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,474 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,478 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,480 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,483 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,485 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,487 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-04T04:55:37,490 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:55:37,491 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:55:37,493 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:55:37,496 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-04T04:55:37,498 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-11-04T04:55:37,499 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-11-04T04:55:37,501 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-11-04T04:55:37,502 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-11-04T04:55:37,504 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2023-11-04T04:55:37,505 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:37,507 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:37,508 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:37,511 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:37,513 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:37,515 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:37,517 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:37,521 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:37,524 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-04T04:55:37,526 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:37,528 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:37,530 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:37,532 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:37,534 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:37,537 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:37,538 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:37,540 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:37,543 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:37,545 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:37,547 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:37,551 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:37,553 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-04T04:55:37,555 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-04T04:55:37,559 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:55:37,560 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:55:37,563 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-04T04:55:37,565 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:55:37,566 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:55:37,568 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:55:37,571 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:55:37,574 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-04T04:55:37,577 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-11-04T04:55:37,578 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:55:37,579 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:55:37,581 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-11-04T04:55:37,583 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-11-04T04:55:37,584 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-11-04T04:55:37,586 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:55:37,587 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:55:37,589 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:55:37,591 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:55:37,593 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:55:37,595 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:55:37,597 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:55:37,600 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-04T04:55:37,602 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-04T04:55:37,603 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-04T04:55:37,606 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-04T04:55:37,608 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-04T04:55:37,610 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-04T04:55:37,613 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,614 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,616 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,618 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,620 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,622 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,624 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,626 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,628 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,630 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,632 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,634 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,636 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,638 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,640 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,643 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,645 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,646 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,648 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,651 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,653 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,655 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,657 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,659 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,662 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,664 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,666 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,668 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,670 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,671 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-04T04:55:37,674 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:55:37,675 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:55:37,677 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:55:37,679 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:55:37,681 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:55:37,683 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-04T04:55:37,685 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:55:37,686 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:55:37,688 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:55:37,691 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:55:37,693 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:55:37,695 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-04T04:55:37,697 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2023-11-04T04:55:37,698 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-11-04T04:55:37,699 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-11-04T04:55:37,702 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2023-11-04T04:55:37,703 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2023-11-04T04:55:37,705 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-11-04T04:55:37,706 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-11-04T04:55:37,708 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-11-04T04:55:37,709 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-11-04T04:55:37,712 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-11-04T04:55:37,714 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-04T04:55:37,715 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-04T04:55:37,717 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-04T04:55:37,719 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-04T04:55:37,720 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-04T04:55:37,723 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-04T04:55:37,724 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-04T04:55:37,726 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-04T04:55:37,728 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-04T04:55:37,730 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-04T04:55:37,733 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:55:37,734 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:55:37,735 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:55:37,738 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:55:37,740 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:55:37,742 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:55:37,744 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:55:37,746 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:55:37,749 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:55:37,750 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-04T04:55:37,753 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:37,753 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:37,757 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-11-04T04:55:37,757 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-11-04T04:55:37,759 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-11-04T04:55:37,761 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-04T04:55:37,762 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-04T04:55:37,764 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-04T04:55:37,766 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-04T04:55:37,768 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-04T04:55:37,770 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:37,773 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:37,775 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:37,777 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:55:37,778 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:55:37,781 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:55:37,784 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:55:37,786 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:55:37,788 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:55:37,790 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-04T04:55:37,794 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:37,796 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:37,799 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:37,801 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:37,803 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:37,806 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-04T04:55:37,807 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-04T04:55:37,810 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-04T04:55:37,812 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-04T04:55:37,814 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-04T04:55:37,816 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,817 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,819 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,822 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,825 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,829 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,832 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,835 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,837 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,839 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,844 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,846 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,848 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,853 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,855 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,857 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,860 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-04T04:55:37,863 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-04T04:55:37,864 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-04T04:55:37,867 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-04T04:55:37,870 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-04T04:55:38,092 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-04T04:55:38,093 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-04T04:55:38,097 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-04T04:55:38,101 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-04T04:55:38,105 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-04T04:55:38,108 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-04T04:55:38,110 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:38,119 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:38,122 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:38,138 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:38,142 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-04T04:55:38,143 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-04T04:55:38,149 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-04T04:55:38,153 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-04T04:55:38,155 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:55:38,156 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:55:38,160 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:55:38,164 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:55:38,169 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:55:38,172 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:55:38,177 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:55:38,180 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:55:38,185 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:55:38,189 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-04T04:55:38,193 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:38,198 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-04T04:55:38,200 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-04T04:55:38,205 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:38,207 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:38,210 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:38,215 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:38,219 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:38,223 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-04T04:55:38,226 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-04T04:55:39,631 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-04T04:55:39,636 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:39,638 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:39,643 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:39,649 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:39,653 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:39,658 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-04T04:55:39,663 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-04T04:55:39,667 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:39,670 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-04T04:55:39,675 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:55:39,676 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:55:39,680 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:55:39,684 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:55:39,689 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:55:39,691 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:55:39,695 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:55:39,699 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-04T04:55:39,703 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:55:39,707 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-11-04T04:55:39,708 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-11-04T04:55:39,712 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-04T04:55:39,714 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-04T04:55:39,720 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-04T04:55:39,724 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-04T04:55:39,728 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-11-04T04:55:39,729 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-11-04T04:55:39,735 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-11-04T04:55:39,740 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:55:39,741 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:55:39,747 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:55:39,748 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:55:39,752 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:55:39,756 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:55:39,758 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:55:39,761 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:55:39,763 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-04T04:55:39,765 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:55:39,769 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:55:39,772 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-04T04:55:39,773 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-04T04:55:39,776 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-04T04:55:39,778 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-04T04:55:39,780 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-04T04:55:39,782 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:55:39,787 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:55:39,789 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-04T04:55:39,793 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,794 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,796 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,799 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,802 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,804 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,808 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,812 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,815 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,817 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,821 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,823 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,826 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,829 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,832 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-04T04:55:39,836 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:55:39,837 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:55:39,839 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:55:39,841 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:55:39,843 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:55:39,845 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:55:39,847 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:55:39,849 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-04T04:55:39,852 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:55:39,853 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:55:39,855 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:55:39,857 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:55:39,859 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:55:39,862 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:55:39,865 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-04T04:55:39,868 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-11-04T04:55:39,869 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-11-04T04:55:39,871 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-11-04T04:55:39,873 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:55:39,874 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:55:39,876 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:55:39,879 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:55:39,882 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:55:39,885 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-04T04:55:39,887 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-11-04T04:55:39,889 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-04T04:55:39,890 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-04T04:55:39,893 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-04T04:55:39,895 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-04T04:55:39,897 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-11-04T04:55:39,898 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-11-04T04:55:39,900 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-11-04T04:55:39,903 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-11-04T04:55:39,905 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,906 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,909 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,911 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,912 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,914 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,916 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,918 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,920 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,922 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,924 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-04T04:55:39,926 copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:55:39,928 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-04T04:55:39,929 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-04T04:55:39,931 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-04T04:55:39,933 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-04T04:55:39,935 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:55:39,938 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,939 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,941 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,943 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,945 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,948 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,950 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,953 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,955 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,957 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,959 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-04T04:55:39,961 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:55:39,964 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-04T04:55:39,966 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-04T04:55:39,967 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-04T04:55:39,970 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:55:39,971 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:55:39,973 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:55:39,975 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:55:39,978 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:55:39,980 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-04T04:55:39,982 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-04T04:55:39,983 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-04T04:55:39,987 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:55:39,988 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:55:39,989 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:55:39,992 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:55:39,994 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:55:39,996 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:55:39,998 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:55:40,000 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:55:40,001 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:55:40,003 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-11-04T04:55:40,006 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2023-11-04T04:55:40,007 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2023-11-04T04:55:40,009 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:55:40,011 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-04T04:55:40,014 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-11-04T04:55:40,016 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:55:40,017 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:40,018 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:40,021 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:40,022 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:40,024 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:40,026 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-04T04:55:40,029 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:40,029 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:40,032 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:40,033 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:40,035 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:40,037 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-04T04:55:40,039 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:40,040 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:40,042 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:40,044 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:40,046 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:40,048 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:40,050 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:40,052 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-04T04:55:40,054 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:55:40,056 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:40,057 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:40,060 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:40,062 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:40,064 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:40,066 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:40,068 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:40,069 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:40,072 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-04T04:55:40,074 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:55:40,075 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:55:40,077 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:55:40,079 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:55:40,081 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-04T04:55:40,083 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-11-04T04:55:40,086 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:55:40,087 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:40,088 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:40,091 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:40,093 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:40,094 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:40,096 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:40,098 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-04T04:55:40,100 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:55:40,103 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:40,104 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:40,106 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:40,108 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:40,109 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:40,112 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:40,114 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:40,116 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:40,118 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-04T04:55:40,120 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:40,121 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:40,123 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:40,125 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:40,127 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:40,129 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:40,131 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-04T04:55:40,133 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:55:40,134 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:55:40,136 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:55:40,138 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-04T04:55:40,140 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:40,142 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:40,143 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:40,146 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:40,148 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:40,150 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:40,151 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-04T04:55:40,153 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-11-04T04:55:40,156 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:55:40,156 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:55:40,158 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:55:40,160 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:55:40,162 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-04T04:55:40,164 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:40,165 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:40,167 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:40,170 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:40,172 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:40,174 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:40,176 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-04T04:55:40,178 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:40,179 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:40,182 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:40,184 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:40,185 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:40,187 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:40,189 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-04T04:55:40,192 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:40,192 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:40,199 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:40,201 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:40,204 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:40,206 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:40,208 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-04T04:55:40,211 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-11-04T04:55:40,213 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-11-04T04:55:40,215 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:55:40,216 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:40,217 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:40,220 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:40,222 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:40,224 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:40,227 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-04T04:55:40,230 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:40,231 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:40,233 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:40,235 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:40,237 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:40,239 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:40,241 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-04T04:55:40,243 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:55:40,245 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-04T04:55:40,248 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-04T04:55:40,249 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-04T04:55:40,252 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:55:40,254 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:55:40,257 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-04T04:55:40,258 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-04T04:55:40,260 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-04T04:55:40,263 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:40,264 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:40,266 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:40,268 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:40,270 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:40,272 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:40,274 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:40,276 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:40,278 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-04T04:55:40,280 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-04T04:55:40,283 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:40,284 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:40,286 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:40,288 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:40,290 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:40,292 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:40,294 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:40,296 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-04T04:55:40,299 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2023-11-04T04:55:40,300 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:55:40,301 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:55:40,303 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-04T04:55:40,306 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:55:40,307 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:55:40,309 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:55:40,311 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-04T04:55:40,313 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:55:40,314 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:55:40,317 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-11-04T04:55:40,319 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:55:40,320 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:55:40,323 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:55:40,325 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-04T04:55:40,327 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:55:40,328 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:55:40,331 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-11-04T04:55:40,332 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2023-11-04T04:55:40,335 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:55:40,335 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:55:40,337 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-11-04T04:55:40,340 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:55:40,341 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:55:40,343 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/gate_fn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:55:40,345 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:55:40,347 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-04T04:55:40,349 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-04T04:55:40,351 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:55:40,353 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:55:40,355 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:55:40,358 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:40,359 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:40,362 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:40,363 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:40,365 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:40,367 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:40,369 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:40,371 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:40,373 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:40,375 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:40,376 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:40,378 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-04T04:55:40,380 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:40,382 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:55:40,383 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:55:40,385 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:55:40,387 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:55:40,389 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-04T04:55:40,391 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:40,393 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:55:40,394 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:55:40,396 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:55:40,398 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:55:40,400 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-04T04:55:40,403 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:40,403 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:40,406 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:40,408 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:40,410 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:40,412 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:40,414 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:40,415 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:40,417 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:40,419 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-04T04:55:40,421 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:40,422 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:55:40,423 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:55:40,425 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:55:40,427 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:55:40,429 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-04T04:55:40,431 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:40,433 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-04T04:55:40,435 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:55:40,437 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-04T04:55:40,438 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-04T04:55:40,440 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-04T04:55:40,442 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-04T04:55:40,444 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-04T04:55:40,446 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:55:40,447 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-04T04:55:40,450 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,451 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,453 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,455 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,458 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,460 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,462 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,464 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,467 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,469 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,471 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,474 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,477 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,479 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-04T04:55:40,482 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,483 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,486 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,488 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,491 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,493 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,496 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,498 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,501 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:55:40,502 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:55:40,505 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:55:40,507 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:55:40,510 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:55:40,512 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:55:40,514 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:55:40,517 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-04T04:55:40,520 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,523 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,525 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,528 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,530 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,532 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,534 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,537 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,539 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,542 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,544 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,547 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-04T04:55:40,549 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:55:40,550 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:55:40,553 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:55:40,556 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:55:40,559 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:55:40,561 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:55:40,563 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-04T04:55:40,565 running install_egg_info 2023-11-04T04:55:40,599 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.12.2-py3.11.egg-info 2023-11-04T04:55:40,612 running install_scripts 2023-11-04T04:55:40,613 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data 2023-11-04T04:55:40,614 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts 2023-11-04T04:55:40,615 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts 2023-11-04T04:55:40,617 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts 2023-11-04T04:55:40,618 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts 2023-11-04T04:55:40,620 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts 2023-11-04T04:55:40,622 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts 2023-11-04T04:55:40,624 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts 2023-11-04T04:55:40,626 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts 2023-11-04T04:55:40,627 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts 2023-11-04T04:55:40,629 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts/ds_report to 755 2023-11-04T04:55:40,629 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts/ds_ssh to 755 2023-11-04T04:55:40,630 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts/ds_bench to 755 2023-11-04T04:55:40,630 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts/ds_elastic to 755 2023-11-04T04:55:40,631 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts/ds to 755 2023-11-04T04:55:40,631 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts/deepspeed to 755 2023-11-04T04:55:40,632 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts/deepspeed.pt to 755 2023-11-04T04:55:40,632 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.data/scripts/dsr to 755 2023-11-04T04:55:40,673 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.2.dist-info/WHEEL 2023-11-04T04:55:40,675 creating '/tmp/pip-wheel-9lrwfl93/deepspeed-0.12.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-11-04T04:55:40,678 adding 'deepspeed/__init__.py' 2023-11-04T04:55:40,680 adding 'deepspeed/constants.py' 2023-11-04T04:55:40,682 adding 'deepspeed/env_report.py' 2023-11-04T04:55:40,683 adding 'deepspeed/git_version_info.py' 2023-11-04T04:55:40,685 adding 'deepspeed/git_version_info_installed.py' 2023-11-04T04:55:40,686 adding 'deepspeed/pydantic_v1.py' 2023-11-04T04:55:40,688 adding 'deepspeed/accelerator/__init__.py' 2023-11-04T04:55:40,689 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-11-04T04:55:40,690 adding 'deepspeed/accelerator/cpu_accelerator.py' 2023-11-04T04:55:40,692 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-11-04T04:55:40,694 adding 'deepspeed/accelerator/mps_accelerator.py' 2023-11-04T04:55:40,695 adding 'deepspeed/accelerator/npu_accelerator.py' 2023-11-04T04:55:40,697 adding 'deepspeed/accelerator/real_accelerator.py' 2023-11-04T04:55:40,699 adding 'deepspeed/autotuning/__init__.py' 2023-11-04T04:55:40,704 adding 'deepspeed/autotuning/autotuner.py' 2023-11-04T04:55:40,706 adding 'deepspeed/autotuning/config.py' 2023-11-04T04:55:40,708 adding 'deepspeed/autotuning/constants.py' 2023-11-04T04:55:40,710 adding 'deepspeed/autotuning/scheduler.py' 2023-11-04T04:55:40,712 adding 'deepspeed/autotuning/utils.py' 2023-11-04T04:55:40,714 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-11-04T04:55:40,715 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-11-04T04:55:40,716 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-11-04T04:55:40,717 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-11-04T04:55:40,719 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-11-04T04:55:40,720 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-11-04T04:55:40,722 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-11-04T04:55:40,723 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-11-04T04:55:40,725 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-11-04T04:55:40,726 adding 'deepspeed/autotuning/tuner/utils.py' 2023-11-04T04:55:40,728 adding 'deepspeed/checkpoint/__init__.py' 2023-11-04T04:55:40,729 adding 'deepspeed/checkpoint/constants.py' 2023-11-04T04:55:40,731 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-11-04T04:55:40,733 adding 'deepspeed/checkpoint/ds_to_universal.py' 2023-11-04T04:55:40,735 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-11-04T04:55:40,736 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-11-04T04:55:40,738 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-11-04T04:55:40,739 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-11-04T04:55:40,741 adding 'deepspeed/checkpoint/utils.py' 2023-11-04T04:55:40,742 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-11-04T04:55:40,744 adding 'deepspeed/comm/__init__.py' 2023-11-04T04:55:40,745 adding 'deepspeed/comm/backend.py' 2023-11-04T04:55:40,747 adding 'deepspeed/comm/ccl.py' 2023-11-04T04:55:40,750 adding 'deepspeed/comm/comm.py' 2023-11-04T04:55:40,752 adding 'deepspeed/comm/config.py' 2023-11-04T04:55:40,753 adding 'deepspeed/comm/constants.py' 2023-11-04T04:55:40,754 adding 'deepspeed/comm/reduce_op.py' 2023-11-04T04:55:40,756 adding 'deepspeed/comm/torch.py' 2023-11-04T04:55:40,758 adding 'deepspeed/comm/utils.py' 2023-11-04T04:55:40,760 adding 'deepspeed/compression/__init__.py' 2023-11-04T04:55:40,763 adding 'deepspeed/compression/basic_layer.py' 2023-11-04T04:55:40,765 adding 'deepspeed/compression/compress.py' 2023-11-04T04:55:40,767 adding 'deepspeed/compression/config.py' 2023-11-04T04:55:40,769 adding 'deepspeed/compression/constants.py' 2023-11-04T04:55:40,771 adding 'deepspeed/compression/helper.py' 2023-11-04T04:55:40,773 adding 'deepspeed/compression/scheduler.py' 2023-11-04T04:55:40,775 adding 'deepspeed/compression/utils.py' 2023-11-04T04:55:40,777 adding 'deepspeed/elasticity/__init__.py' 2023-11-04T04:55:40,778 adding 'deepspeed/elasticity/config.py' 2023-11-04T04:55:40,780 adding 'deepspeed/elasticity/constants.py' 2023-11-04T04:55:40,781 adding 'deepspeed/elasticity/elastic_agent.py' 2023-11-04T04:55:40,784 adding 'deepspeed/elasticity/elasticity.py' 2023-11-04T04:55:40,785 adding 'deepspeed/elasticity/utils.py' 2023-11-04T04:55:40,787 adding 'deepspeed/inference/__init__.py' 2023-11-04T04:55:40,788 adding 'deepspeed/inference/config.py' 2023-11-04T04:55:40,792 adding 'deepspeed/inference/engine.py' 2023-11-04T04:55:40,794 adding 'deepspeed/inference/quantization/__init__.py' 2023-11-04T04:55:40,796 adding 'deepspeed/inference/quantization/layers.py' 2023-11-04T04:55:40,797 adding 'deepspeed/inference/quantization/quantization.py' 2023-11-04T04:55:40,798 adding 'deepspeed/inference/quantization/quantization_context.py' 2023-11-04T04:55:40,800 adding 'deepspeed/inference/quantization/utils.py' 2023-11-04T04:55:40,802 adding 'deepspeed/inference/v2/__init__.py' 2023-11-04T04:55:40,803 adding 'deepspeed/inference/v2/allocator.py' 2023-11-04T04:55:40,805 adding 'deepspeed/inference/v2/config_v2.py' 2023-11-04T04:55:40,806 adding 'deepspeed/inference/v2/engine_factory.py' 2023-11-04T04:55:40,808 adding 'deepspeed/inference/v2/engine_v2.py' 2023-11-04T04:55:40,809 adding 'deepspeed/inference/v2/inference_utils.py' 2023-11-04T04:55:40,810 adding 'deepspeed/inference/v2/logging.py' 2023-11-04T04:55:40,812 adding 'deepspeed/inference/v2/scheduling_utils.py' 2023-11-04T04:55:40,813 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2023-11-04T04:55:40,815 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2023-11-04T04:55:40,816 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2023-11-04T04:55:40,817 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2023-11-04T04:55:40,819 adding 'deepspeed/inference/v2/kernels/__init__.py' 2023-11-04T04:55:40,820 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2023-11-04T04:55:40,822 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2023-11-04T04:55:40,823 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2023-11-04T04:55:40,825 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2023-11-04T04:55:40,826 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2023-11-04T04:55:40,827 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu' 2023-11-04T04:55:40,828 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2023-11-04T04:55:40,830 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2023-11-04T04:55:40,832 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2023-11-04T04:55:40,833 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2023-11-04T04:55:40,834 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2023-11-04T04:55:40,836 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2023-11-04T04:55:40,838 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2023-11-04T04:55:40,839 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2023-11-04T04:55:40,840 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2023-11-04T04:55:40,841 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2023-11-04T04:55:40,842 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2023-11-04T04:55:40,844 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2023-11-04T04:55:40,845 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu' 2023-11-04T04:55:40,847 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2023-11-04T04:55:40,848 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2023-11-04T04:55:40,850 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2023-11-04T04:55:40,851 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu' 2023-11-04T04:55:40,853 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2023-11-04T04:55:40,854 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2023-11-04T04:55:40,855 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2023-11-04T04:55:40,856 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2023-11-04T04:55:40,858 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2023-11-04T04:55:40,859 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2023-11-04T04:55:40,861 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2023-11-04T04:55:40,862 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu' 2023-11-04T04:55:40,864 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2023-11-04T04:55:40,865 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2023-11-04T04:55:40,867 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2023-11-04T04:55:40,868 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2023-11-04T04:55:40,870 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2023-11-04T04:55:40,871 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2023-11-04T04:55:40,873 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2023-11-04T04:55:40,874 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2023-11-04T04:55:40,876 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2023-11-04T04:55:40,877 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2023-11-04T04:55:40,878 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2023-11-04T04:55:40,880 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2023-11-04T04:55:40,881 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2023-11-04T04:55:40,882 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2023-11-04T04:55:40,884 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2023-11-04T04:55:40,886 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2023-11-04T04:55:40,887 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2023-11-04T04:55:40,889 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2023-11-04T04:55:40,890 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2023-11-04T04:55:40,891 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2023-11-04T04:55:40,893 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2023-11-04T04:55:40,895 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2023-11-04T04:55:40,896 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2023-11-04T04:55:40,897 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2023-11-04T04:55:40,898 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2023-11-04T04:55:40,900 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2023-11-04T04:55:40,901 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2023-11-04T04:55:40,902 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2023-11-04T04:55:40,904 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2023-11-04T04:55:40,905 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu' 2023-11-04T04:55:40,906 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2023-11-04T04:55:40,907 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2023-11-04T04:55:40,909 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2023-11-04T04:55:40,910 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2023-11-04T04:55:40,912 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2023-11-04T04:55:40,914 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu' 2023-11-04T04:55:40,915 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2023-11-04T04:55:40,916 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2023-11-04T04:55:40,917 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2023-11-04T04:55:40,919 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2023-11-04T04:55:40,920 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2023-11-04T04:55:40,922 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2023-11-04T04:55:40,923 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2023-11-04T04:55:40,924 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu' 2023-11-04T04:55:40,925 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2023-11-04T04:55:40,927 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2023-11-04T04:55:40,928 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2023-11-04T04:55:40,930 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2023-11-04T04:55:40,931 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2023-11-04T04:55:40,932 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu' 2023-11-04T04:55:40,934 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2023-11-04T04:55:40,935 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2023-11-04T04:55:40,936 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2023-11-04T04:55:40,938 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2023-11-04T04:55:40,939 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2023-11-04T04:55:40,941 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu' 2023-11-04T04:55:40,942 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2023-11-04T04:55:40,943 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2023-11-04T04:55:40,944 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2023-11-04T04:55:40,946 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2023-11-04T04:55:40,947 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2023-11-04T04:55:40,948 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2023-11-04T04:55:40,950 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py' 2023-11-04T04:55:40,951 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp' 2023-11-04T04:55:40,953 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu' 2023-11-04T04:55:40,954 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh' 2023-11-04T04:55:40,955 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h' 2023-11-04T04:55:40,956 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py' 2023-11-04T04:55:40,958 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2023-11-04T04:55:40,960 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2023-11-04T04:55:40,961 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2023-11-04T04:55:40,964 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2023-11-04T04:55:40,966 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2023-11-04T04:55:40,968 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2023-11-04T04:55:40,969 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2023-11-04T04:55:40,971 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2023-11-04T04:55:40,972 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2023-11-04T04:55:40,973 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2023-11-04T04:55:40,974 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2023-11-04T04:55:40,976 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2023-11-04T04:55:40,977 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2023-11-04T04:55:40,978 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2023-11-04T04:55:40,979 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2023-11-04T04:55:40,981 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2023-11-04T04:55:40,983 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py' 2023-11-04T04:55:40,992 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py' 2023-11-04T04:55:40,993 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py' 2023-11-04T04:55:40,995 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2023-11-04T04:55:40,996 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2023-11-04T04:55:40,998 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2023-11-04T04:55:40,999 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2023-11-04T04:55:41,001 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2023-11-04T04:55:41,002 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2023-11-04T04:55:41,003 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2023-11-04T04:55:41,005 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2023-11-04T04:55:41,007 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2023-11-04T04:55:41,008 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2023-11-04T04:55:41,009 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2023-11-04T04:55:41,011 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2023-11-04T04:55:41,012 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2023-11-04T04:55:41,014 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2023-11-04T04:55:41,015 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2023-11-04T04:55:41,016 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2023-11-04T04:55:41,017 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2023-11-04T04:55:41,019 adding 'deepspeed/inference/v2/modules/__init__.py' 2023-11-04T04:55:41,020 adding 'deepspeed/inference/v2/modules/ds_module.py' 2023-11-04T04:55:41,022 adding 'deepspeed/inference/v2/modules/heuristics.py' 2023-11-04T04:55:41,023 adding 'deepspeed/inference/v2/modules/module_registry.py' 2023-11-04T04:55:41,024 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2023-11-04T04:55:41,026 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2023-11-04T04:55:41,027 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2023-11-04T04:55:41,028 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2023-11-04T04:55:41,029 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2023-11-04T04:55:41,031 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2023-11-04T04:55:41,032 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2023-11-04T04:55:41,034 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2023-11-04T04:55:41,035 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2023-11-04T04:55:41,037 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2023-11-04T04:55:41,038 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2023-11-04T04:55:41,040 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2023-11-04T04:55:41,041 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2023-11-04T04:55:41,043 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2023-11-04T04:55:41,044 adding 'deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py' 2023-11-04T04:55:41,046 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2023-11-04T04:55:41,047 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2023-11-04T04:55:41,049 adding 'deepspeed/inference/v2/modules/implementations/moe/gate_fn.py' 2023-11-04T04:55:41,050 adding 'deepspeed/inference/v2/modules/implementations/moe/test.py' 2023-11-04T04:55:41,052 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2023-11-04T04:55:41,053 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2023-11-04T04:55:41,055 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2023-11-04T04:55:41,056 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2023-11-04T04:55:41,058 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2023-11-04T04:55:41,059 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2023-11-04T04:55:41,061 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2023-11-04T04:55:41,063 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2023-11-04T04:55:41,064 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2023-11-04T04:55:41,065 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2023-11-04T04:55:41,067 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2023-11-04T04:55:41,068 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2023-11-04T04:55:41,069 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2023-11-04T04:55:41,071 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2023-11-04T04:55:41,072 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2023-11-04T04:55:41,074 adding 'deepspeed/inference/v2/ragged/__init__.py' 2023-11-04T04:55:41,075 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2023-11-04T04:55:41,077 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2023-11-04T04:55:41,079 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2023-11-04T04:55:41,080 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2023-11-04T04:55:41,082 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2023-11-04T04:55:41,083 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2023-11-04T04:55:41,085 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2023-11-04T04:55:41,086 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2023-11-04T04:55:41,088 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2023-11-04T04:55:41,089 adding 'deepspeed/launcher/__init__.py' 2023-11-04T04:55:41,090 adding 'deepspeed/launcher/constants.py' 2023-11-04T04:55:41,092 adding 'deepspeed/launcher/launch.py' 2023-11-04T04:55:41,094 adding 'deepspeed/launcher/multinode_runner.py' 2023-11-04T04:55:41,097 adding 'deepspeed/launcher/runner.py' 2023-11-04T04:55:41,099 adding 'deepspeed/model_implementations/__init__.py' 2023-11-04T04:55:41,101 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-11-04T04:55:41,102 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-11-04T04:55:41,104 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-11-04T04:55:41,105 adding 'deepspeed/model_implementations/features/__init__.py' 2023-11-04T04:55:41,107 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-11-04T04:55:41,108 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-11-04T04:55:41,110 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-11-04T04:55:41,111 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-11-04T04:55:41,112 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-11-04T04:55:41,113 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-11-04T04:55:41,114 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-11-04T04:55:41,116 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2023-11-04T04:55:41,117 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-11-04T04:55:41,118 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-11-04T04:55:41,120 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-11-04T04:55:41,121 adding 'deepspeed/module_inject/__init__.py' 2023-11-04T04:55:41,124 adding 'deepspeed/module_inject/auto_tp.py' 2023-11-04T04:55:41,126 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2023-11-04T04:55:41,127 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2023-11-04T04:55:41,129 adding 'deepspeed/module_inject/inject.py' 2023-11-04T04:55:41,130 adding 'deepspeed/module_inject/layers.py' 2023-11-04T04:55:41,132 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-11-04T04:55:41,134 adding 'deepspeed/module_inject/module_quantize.py' 2023-11-04T04:55:41,135 adding 'deepspeed/module_inject/policy.py' 2023-11-04T04:55:41,139 adding 'deepspeed/module_inject/replace_module.py' 2023-11-04T04:55:41,140 adding 'deepspeed/module_inject/replace_policy.py' 2023-11-04T04:55:41,141 adding 'deepspeed/module_inject/tp_shard.py' 2023-11-04T04:55:41,142 adding 'deepspeed/module_inject/utils.py' 2023-11-04T04:55:41,144 adding 'deepspeed/module_inject/containers/__init__.py' 2023-11-04T04:55:41,146 adding 'deepspeed/module_inject/containers/base.py' 2023-11-04T04:55:41,148 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-11-04T04:55:41,149 adding 'deepspeed/module_inject/containers/bert.py' 2023-11-04T04:55:41,151 adding 'deepspeed/module_inject/containers/bloom.py' 2023-11-04T04:55:41,152 adding 'deepspeed/module_inject/containers/clip.py' 2023-11-04T04:55:41,154 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-11-04T04:55:41,155 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-11-04T04:55:41,156 adding 'deepspeed/module_inject/containers/gptj.py' 2023-11-04T04:55:41,158 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-11-04T04:55:41,159 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-11-04T04:55:41,161 adding 'deepspeed/module_inject/containers/internlm.py' 2023-11-04T04:55:41,162 adding 'deepspeed/module_inject/containers/llama.py' 2023-11-04T04:55:41,164 adding 'deepspeed/module_inject/containers/llama2.py' 2023-11-04T04:55:41,166 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-11-04T04:55:41,167 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-11-04T04:55:41,168 adding 'deepspeed/module_inject/containers/opt.py' 2023-11-04T04:55:41,170 adding 'deepspeed/module_inject/containers/unet.py' 2023-11-04T04:55:41,171 adding 'deepspeed/module_inject/containers/vae.py' 2023-11-04T04:55:41,172 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-11-04T04:55:41,174 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2023-11-04T04:55:41,175 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2023-11-04T04:55:41,177 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2023-11-04T04:55:41,178 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-11-04T04:55:41,179 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-11-04T04:55:41,181 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2023-11-04T04:55:41,183 adding 'deepspeed/moe/__init__.py' 2023-11-04T04:55:41,184 adding 'deepspeed/moe/experts.py' 2023-11-04T04:55:41,185 adding 'deepspeed/moe/layer.py' 2023-11-04T04:55:41,187 adding 'deepspeed/moe/mappings.py' 2023-11-04T04:55:41,189 adding 'deepspeed/moe/sharded_moe.py' 2023-11-04T04:55:41,191 adding 'deepspeed/moe/utils.py' 2023-11-04T04:55:41,193 adding 'deepspeed/monitor/__init__.py' 2023-11-04T04:55:41,194 adding 'deepspeed/monitor/config.py' 2023-11-04T04:55:41,196 adding 'deepspeed/monitor/csv_monitor.py' 2023-11-04T04:55:41,197 adding 'deepspeed/monitor/monitor.py' 2023-11-04T04:55:41,198 adding 'deepspeed/monitor/tensorboard.py' 2023-11-04T04:55:41,200 adding 'deepspeed/monitor/utils.py' 2023-11-04T04:55:41,201 adding 'deepspeed/monitor/wandb.py' 2023-11-04T04:55:41,203 adding 'deepspeed/nebula/__init__.py' 2023-11-04T04:55:41,204 adding 'deepspeed/nebula/config.py' 2023-11-04T04:55:41,205 adding 'deepspeed/nebula/constants.py' 2023-11-04T04:55:41,207 adding 'deepspeed/ops/__init__.py' 2023-11-04T04:55:41,209 adding 'deepspeed/ops/adagrad/__init__.py' 2023-11-04T04:55:41,210 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-11-04T04:55:41,212 adding 'deepspeed/ops/adam/__init__.py' 2023-11-04T04:55:41,214 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-11-04T04:55:41,215 adding 'deepspeed/ops/adam/fused_adam.py' 2023-11-04T04:55:41,217 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-11-04T04:55:41,218 adding 'deepspeed/ops/aio/__init__.py' 2023-11-04T04:55:41,221 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-11-04T04:55:41,223 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-11-04T04:55:41,224 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2023-11-04T04:55:41,225 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-11-04T04:55:41,227 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-11-04T04:55:41,228 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-11-04T04:55:41,232 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-11-04T04:55:41,233 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-11-04T04:55:41,234 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-11-04T04:55:41,235 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-11-04T04:55:41,236 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-11-04T04:55:41,238 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-11-04T04:55:41,240 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-11-04T04:55:41,241 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-11-04T04:55:41,242 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-11-04T04:55:41,243 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-11-04T04:55:41,244 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-11-04T04:55:41,245 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-11-04T04:55:41,247 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-11-04T04:55:41,248 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-11-04T04:55:41,249 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-11-04T04:55:41,251 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-11-04T04:55:41,252 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-11-04T04:55:41,253 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-11-04T04:55:41,255 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-11-04T04:55:41,257 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2023-11-04T04:55:41,260 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2023-11-04T04:55:41,262 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2023-11-04T04:55:41,264 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2023-11-04T04:55:41,266 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2023-11-04T04:55:41,268 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2023-11-04T04:55:41,270 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2023-11-04T04:55:41,278 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2023-11-04T04:55:41,283 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2023-11-04T04:55:41,286 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2023-11-04T04:55:41,288 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2023-11-04T04:55:41,290 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2023-11-04T04:55:41,292 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2023-11-04T04:55:41,294 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2023-11-04T04:55:41,296 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2023-11-04T04:55:41,299 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2023-11-04T04:55:41,301 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2023-11-04T04:55:41,303 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2023-11-04T04:55:41,305 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2023-11-04T04:55:41,312 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2023-11-04T04:55:41,316 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2023-11-04T04:55:41,317 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2023-11-04T04:55:41,321 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2023-11-04T04:55:41,325 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2023-11-04T04:55:41,329 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2023-11-04T04:55:41,331 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2023-11-04T04:55:41,332 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2023-11-04T04:55:41,334 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2023-11-04T04:55:41,336 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2023-11-04T04:55:41,338 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-11-04T04:55:41,339 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-11-04T04:55:41,340 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2023-11-04T04:55:41,341 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-11-04T04:55:41,343 adding 'deepspeed/ops/csrc/includes/context.h' 2023-11-04T04:55:41,344 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-11-04T04:55:41,346 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-11-04T04:55:41,348 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-11-04T04:55:41,349 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2023-11-04T04:55:41,351 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-11-04T04:55:41,352 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-11-04T04:55:41,354 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-11-04T04:55:41,355 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-11-04T04:55:41,357 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-11-04T04:55:41,358 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-11-04T04:55:41,359 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-11-04T04:55:41,361 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-11-04T04:55:41,362 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-11-04T04:55:41,363 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-11-04T04:55:41,366 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-11-04T04:55:41,367 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-11-04T04:55:41,369 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-11-04T04:55:41,371 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-11-04T04:55:41,372 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-11-04T04:55:41,375 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-11-04T04:55:41,376 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-11-04T04:55:41,377 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-11-04T04:55:41,379 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-11-04T04:55:41,380 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-11-04T04:55:41,382 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-11-04T04:55:41,384 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-11-04T04:55:41,386 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2023-11-04T04:55:41,387 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2023-11-04T04:55:41,389 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2023-11-04T04:55:41,390 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2023-11-04T04:55:41,392 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2023-11-04T04:55:41,394 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-11-04T04:55:41,396 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-11-04T04:55:41,398 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-11-04T04:55:41,400 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2023-11-04T04:55:41,402 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-11-04T04:55:41,404 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2023-11-04T04:55:41,405 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2023-11-04T04:55:41,408 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-11-04T04:55:41,409 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-11-04T04:55:41,411 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-11-04T04:55:41,413 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-11-04T04:55:41,414 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-11-04T04:55:41,417 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-11-04T04:55:41,418 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-11-04T04:55:41,420 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-11-04T04:55:41,422 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-11-04T04:55:41,425 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-11-04T04:55:41,429 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-11-04T04:55:41,431 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-11-04T04:55:41,432 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-11-04T04:55:41,437 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-11-04T04:55:41,439 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-11-04T04:55:41,442 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-11-04T04:55:41,445 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-11-04T04:55:41,447 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-11-04T04:55:41,450 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-11-04T04:55:41,452 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-11-04T04:55:41,454 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2023-11-04T04:55:41,460 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-11-04T04:55:41,462 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-11-04T04:55:41,463 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2023-11-04T04:55:41,466 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-11-04T04:55:41,469 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-11-04T04:55:41,471 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-11-04T04:55:41,473 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-11-04T04:55:41,475 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-11-04T04:55:41,476 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-11-04T04:55:41,478 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2023-11-04T04:55:41,480 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2023-11-04T04:55:41,481 adding 'deepspeed/ops/lamb/__init__.py' 2023-11-04T04:55:41,483 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-11-04T04:55:41,485 adding 'deepspeed/ops/lion/__init__.py' 2023-11-04T04:55:41,486 adding 'deepspeed/ops/lion/cpu_lion.py' 2023-11-04T04:55:41,488 adding 'deepspeed/ops/lion/fused_lion.py' 2023-11-04T04:55:41,489 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2023-11-04T04:55:41,492 adding 'deepspeed/ops/op_builder/__init__.py' 2023-11-04T04:55:41,493 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-11-04T04:55:41,495 adding 'deepspeed/ops/op_builder/async_io.py' 2023-11-04T04:55:41,499 adding 'deepspeed/ops/op_builder/builder.py' 2023-11-04T04:55:41,500 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-11-04T04:55:41,501 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-11-04T04:55:41,503 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2023-11-04T04:55:41,504 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2023-11-04T04:55:41,505 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-11-04T04:55:41,506 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-11-04T04:55:41,508 adding 'deepspeed/ops/op_builder/fused_lion.py' 2023-11-04T04:55:41,509 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2023-11-04T04:55:41,510 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2023-11-04T04:55:41,511 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-11-04T04:55:41,513 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2023-11-04T04:55:41,514 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2023-11-04T04:55:41,515 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-11-04T04:55:41,516 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-11-04T04:55:41,517 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-11-04T04:55:41,518 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-11-04T04:55:41,520 adding 'deepspeed/ops/op_builder/transformer.py' 2023-11-04T04:55:41,521 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-11-04T04:55:41,522 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2023-11-04T04:55:41,524 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2023-11-04T04:55:41,525 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2023-11-04T04:55:41,526 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2023-11-04T04:55:41,527 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2023-11-04T04:55:41,528 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2023-11-04T04:55:41,530 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2023-11-04T04:55:41,531 adding 'deepspeed/ops/op_builder/npu/builder.py' 2023-11-04T04:55:41,532 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2023-11-04T04:55:41,533 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2023-11-04T04:55:41,534 adding 'deepspeed/ops/quantizer/__init__.py' 2023-11-04T04:55:41,536 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-11-04T04:55:41,537 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-11-04T04:55:41,539 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-11-04T04:55:41,540 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-11-04T04:55:41,542 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-11-04T04:55:41,546 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-11-04T04:55:41,548 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-11-04T04:55:41,550 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-11-04T04:55:41,551 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-11-04T04:55:41,554 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-11-04T04:55:41,556 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-11-04T04:55:41,558 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-11-04T04:55:41,559 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-11-04T04:55:41,560 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-11-04T04:55:41,562 adding 'deepspeed/ops/transformer/__init__.py' 2023-11-04T04:55:41,565 adding 'deepspeed/ops/transformer/transformer.py' 2023-11-04T04:55:41,566 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-11-04T04:55:41,568 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-11-04T04:55:41,569 adding 'deepspeed/ops/transformer/inference/config.py' 2023-11-04T04:55:41,570 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-11-04T04:55:41,572 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-11-04T04:55:41,573 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-11-04T04:55:41,575 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-11-04T04:55:41,577 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-11-04T04:55:41,579 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-11-04T04:55:41,581 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-11-04T04:55:41,583 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-11-04T04:55:41,584 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-11-04T04:55:41,585 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-11-04T04:55:41,587 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-11-04T04:55:41,588 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-11-04T04:55:41,589 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-11-04T04:55:41,590 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-11-04T04:55:41,592 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-11-04T04:55:41,593 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-11-04T04:55:41,594 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-11-04T04:55:41,596 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2023-11-04T04:55:41,598 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2023-11-04T04:55:41,599 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2023-11-04T04:55:41,601 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2023-11-04T04:55:41,602 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2023-11-04T04:55:41,604 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2023-11-04T04:55:41,605 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2023-11-04T04:55:41,606 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2023-11-04T04:55:41,608 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2023-11-04T04:55:41,610 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2023-11-04T04:55:41,611 adding 'deepspeed/pipe/__init__.py' 2023-11-04T04:55:41,613 adding 'deepspeed/profiling/__init__.py' 2023-11-04T04:55:41,614 adding 'deepspeed/profiling/config.py' 2023-11-04T04:55:41,615 adding 'deepspeed/profiling/constants.py' 2023-11-04T04:55:41,617 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-11-04T04:55:41,622 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-11-04T04:55:41,624 adding 'deepspeed/runtime/__init__.py' 2023-11-04T04:55:41,627 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-11-04T04:55:41,631 adding 'deepspeed/runtime/config.py' 2023-11-04T04:55:41,633 adding 'deepspeed/runtime/config_utils.py' 2023-11-04T04:55:41,634 adding 'deepspeed/runtime/constants.py' 2023-11-04T04:55:41,636 adding 'deepspeed/runtime/dataloader.py' 2023-11-04T04:55:41,638 adding 'deepspeed/runtime/eigenvalue.py' 2023-11-04T04:55:41,655 adding 'deepspeed/runtime/engine.py' 2023-11-04T04:55:41,659 adding 'deepspeed/runtime/hybrid_engine.py' 2023-11-04T04:55:41,662 adding 'deepspeed/runtime/lr_schedules.py' 2023-11-04T04:55:41,664 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-11-04T04:55:41,665 adding 'deepspeed/runtime/quantize.py' 2023-11-04T04:55:41,667 adding 'deepspeed/runtime/sparse_tensor.py' 2023-11-04T04:55:41,669 adding 'deepspeed/runtime/state_dict_factory.py' 2023-11-04T04:55:41,673 adding 'deepspeed/runtime/utils.py' 2023-11-04T04:55:41,675 adding 'deepspeed/runtime/weight_quantizer.py' 2023-11-04T04:55:41,677 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-11-04T04:55:41,681 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-11-04T04:55:41,683 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-11-04T04:55:41,685 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-11-04T04:55:41,686 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-11-04T04:55:41,688 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-11-04T04:55:41,689 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-11-04T04:55:41,691 adding 'deepspeed/runtime/comm/__init__.py' 2023-11-04T04:55:41,692 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-11-04T04:55:41,694 adding 'deepspeed/runtime/comm/mpi.py' 2023-11-04T04:55:41,695 adding 'deepspeed/runtime/comm/nccl.py' 2023-11-04T04:55:41,697 adding 'deepspeed/runtime/compression/__init__.py' 2023-11-04T04:55:41,698 adding 'deepspeed/runtime/compression/cupy.py' 2023-11-04T04:55:41,700 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-11-04T04:55:41,701 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-11-04T04:55:41,702 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-11-04T04:55:41,704 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-11-04T04:55:41,706 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-11-04T04:55:41,707 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-11-04T04:55:41,708 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-11-04T04:55:41,709 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-11-04T04:55:41,710 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-11-04T04:55:41,712 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-11-04T04:55:41,715 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-11-04T04:55:41,717 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-11-04T04:55:41,720 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-11-04T04:55:41,721 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-11-04T04:55:41,723 adding 'deepspeed/runtime/fp16/__init__.py' 2023-11-04T04:55:41,725 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-11-04T04:55:41,727 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-11-04T04:55:41,730 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-11-04T04:55:41,732 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-11-04T04:55:41,734 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-11-04T04:55:41,736 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-11-04T04:55:41,739 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-11-04T04:55:41,740 adding 'deepspeed/runtime/pipe/__init__.py' 2023-11-04T04:55:41,747 adding 'deepspeed/runtime/pipe/engine.py' 2023-11-04T04:55:41,750 adding 'deepspeed/runtime/pipe/module.py' 2023-11-04T04:55:41,752 adding 'deepspeed/runtime/pipe/p2p.py' 2023-11-04T04:55:41,754 adding 'deepspeed/runtime/pipe/schedule.py' 2023-11-04T04:55:41,757 adding 'deepspeed/runtime/pipe/topology.py' 2023-11-04T04:55:41,759 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-11-04T04:55:41,760 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-11-04T04:55:41,762 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-11-04T04:55:41,763 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-11-04T04:55:41,765 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-11-04T04:55:41,767 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-11-04T04:55:41,769 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-11-04T04:55:41,771 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-11-04T04:55:41,773 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-11-04T04:55:41,775 adding 'deepspeed/runtime/zero/__init__.py' 2023-11-04T04:55:41,777 adding 'deepspeed/runtime/zero/config.py' 2023-11-04T04:55:41,779 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-11-04T04:55:41,781 adding 'deepspeed/runtime/zero/linear.py' 2023-11-04T04:55:41,783 adding 'deepspeed/runtime/zero/mics.py' 2023-11-04T04:55:41,785 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-11-04T04:55:41,787 adding 'deepspeed/runtime/zero/offload_config.py' 2023-11-04T04:55:41,789 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-11-04T04:55:41,800 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-11-04T04:55:41,804 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-11-04T04:55:41,806 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2023-11-04T04:55:41,819 adding 'deepspeed/runtime/zero/stage3.py' 2023-11-04T04:55:41,833 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-11-04T04:55:41,835 adding 'deepspeed/runtime/zero/test.py' 2023-11-04T04:55:41,837 adding 'deepspeed/runtime/zero/tiling.py' 2023-11-04T04:55:41,838 adding 'deepspeed/runtime/zero/utils.py' 2023-11-04T04:55:41,840 adding 'deepspeed/sequence/__init__.py' 2023-11-04T04:55:41,841 adding 'deepspeed/sequence/layer.py' 2023-11-04T04:55:41,843 adding 'deepspeed/utils/__init__.py' 2023-11-04T04:55:41,845 adding 'deepspeed/utils/comms_logging.py' 2023-11-04T04:55:41,846 adding 'deepspeed/utils/debug.py' 2023-11-04T04:55:41,847 adding 'deepspeed/utils/exceptions.py' 2023-11-04T04:55:41,850 adding 'deepspeed/utils/groups.py' 2023-11-04T04:55:41,851 adding 'deepspeed/utils/init_on_device.py' 2023-11-04T04:55:41,853 adding 'deepspeed/utils/logging.py' 2023-11-04T04:55:41,854 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-11-04T04:55:41,855 adding 'deepspeed/utils/numa.py' 2023-11-04T04:55:41,856 adding 'deepspeed/utils/nvtx.py' 2023-11-04T04:55:41,858 adding 'deepspeed/utils/tensor_fragment.py' 2023-11-04T04:55:41,860 adding 'deepspeed/utils/timer.py' 2023-11-04T04:55:41,861 adding 'deepspeed/utils/types.py' 2023-11-04T04:55:41,864 adding 'deepspeed/utils/zero_to_fp32.py' 2023-11-04T04:55:41,866 adding 'deepspeed-0.12.2.data/scripts/deepspeed' 2023-11-04T04:55:41,867 adding 'deepspeed-0.12.2.data/scripts/deepspeed.pt' 2023-11-04T04:55:41,868 adding 'deepspeed-0.12.2.data/scripts/ds' 2023-11-04T04:55:41,869 adding 'deepspeed-0.12.2.data/scripts/ds_bench' 2023-11-04T04:55:41,870 adding 'deepspeed-0.12.2.data/scripts/ds_elastic' 2023-11-04T04:55:41,871 adding 'deepspeed-0.12.2.data/scripts/ds_report' 2023-11-04T04:55:41,873 adding 'deepspeed-0.12.2.data/scripts/ds_ssh' 2023-11-04T04:55:41,874 adding 'deepspeed-0.12.2.data/scripts/dsr' 2023-11-04T04:55:41,879 adding 'deepspeed-0.12.2.dist-info/METADATA' 2023-11-04T04:55:41,880 adding 'deepspeed-0.12.2.dist-info/WHEEL' 2023-11-04T04:55:41,881 adding 'deepspeed-0.12.2.dist-info/entry_points.txt' 2023-11-04T04:55:41,882 adding 'deepspeed-0.12.2.dist-info/top_level.txt' 2023-11-04T04:55:41,894 adding 'deepspeed-0.12.2.dist-info/RECORD' 2023-11-04T04:55:41,916 removing build/bdist.linux-armv7l/wheel 2023-11-04T04:55:42,095 deepspeed build time = 10.417845487594604 secs 2023-11-04T04:55:42,218 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-11-04T04:55:42,235 Created wheel for deepspeed: filename=deepspeed-0.12.2-py3-none-any.whl size=1265624 sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 2023-11-04T04:55:42,236 Stored in directory: /tmp/pip-ephem-wheel-cache-9usx_nbt/wheels/89/49/1d/5c889e99d9a184bb36a279671b2efc111470ad619932bc2fb7 2023-11-04T04:55:42,272 Successfully built deepspeed 2023-11-04T04:55:42,315 Removed build tracker: '/tmp/pip-build-tracker-rd2imcf5'