2021-07-13T00:08:52,782 Created temporary directory: /tmp/pip-ephem-wheel-cache-74czkx3g 2021-07-13T00:08:52,785 Created temporary directory: /tmp/pip-req-tracker-e3kurquf 2021-07-13T00:08:52,786 Initialized build tracking at /tmp/pip-req-tracker-e3kurquf 2021-07-13T00:08:52,786 Created build tracker: /tmp/pip-req-tracker-e3kurquf 2021-07-13T00:08:52,786 Entered build tracker: /tmp/pip-req-tracker-e3kurquf 2021-07-13T00:08:52,787 Created temporary directory: /tmp/pip-wheel-cbqogfdu 2021-07-13T00:08:52,817 1 location(s) to search for versions of deepspeed: 2021-07-13T00:08:52,817 * https://pypi.org/simple/deepspeed/ 2021-07-13T00:08:52,818 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2021-07-13T00:08:52,818 Getting page https://pypi.org/simple/deepspeed/ 2021-07-13T00:08:52,820 Found index url https://pypi.org/simple 2021-07-13T00:08:52,935 Found link https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2021-07-13T00:08:52,936 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2021-07-13T00:08:52,937 Found link https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2021-07-13T00:08:52,937 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2021-07-13T00:08:52,937 Found link https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2021-07-13T00:08:52,938 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2021-07-13T00:08:52,938 Found link https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2021-07-13T00:08:52,938 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2021-07-13T00:08:52,939 Found link https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2021-07-13T00:08:52,939 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2021-07-13T00:08:52,940 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2021-07-13T00:08:52,940 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2021-07-13T00:08:52,940 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2021-07-13T00:08:52,940 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2021-07-13T00:08:52,941 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2021-07-13T00:08:52,941 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2021-07-13T00:08:52,941 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2021-07-13T00:08:52,942 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2021-07-13T00:08:52,942 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2021-07-13T00:08:52,942 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2021-07-13T00:08:52,942 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2021-07-13T00:08:52,943 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2021-07-13T00:08:52,943 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2021-07-13T00:08:52,943 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2021-07-13T00:08:52,944 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2021-07-13T00:08:52,944 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2021-07-13T00:08:52,944 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2021-07-13T00:08:52,944 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2021-07-13T00:08:52,945 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2021-07-13T00:08:52,945 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2021-07-13T00:08:52,945 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2021-07-13T00:08:52,946 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2021-07-13T00:08:52,946 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2021-07-13T00:08:52,946 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2021-07-13T00:08:52,951 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2021-07-13T00:08:52,966 Collecting deepspeed==0.4.3 2021-07-13T00:08:52,968 Created temporary directory: /tmp/pip-unpack-uz21ltwt 2021-07-13T00:08:53,008 Downloading deepspeed-0.4.3.tar.gz (451 kB) 2021-07-13T00:08:53,925 Added deepspeed==0.4.3 from https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 to build tracker '/tmp/pip-req-tracker-e3kurquf' 2021-07-13T00:08:53,926 Running setup.py (path:/tmp/pip-wheel-cbqogfdu/deepspeed_0dbebc9339fe4d7fa29f1210a23d523e/setup.py) egg_info for package deepspeed 2021-07-13T00:08:53,927 Created temporary directory: /tmp/pip-pip-egg-info-x6d3668r 2021-07-13T00:08:53,927 Running command python setup.py egg_info 2021-07-13T00:08:55,041 fatal: not a git repository (or any of the parent directories): .git 2021-07-13T00:08:55,331 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-07-13T00:08:55,331 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-07-13T00:08:55,331 DS_BUILD_OPS=0 2021-07-13T00:08:55,331 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-07-13T00:08:55,331 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-07-13T00:08:55,331 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-07-13T00:08:55,332 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-07-13T00:08:55,332 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-07-13T00:08:55,332 version=0.4.3, git_hash=unknown, git_branch=unknown 2021-07-13T00:08:55,332 install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-07-13T00:08:55,332 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-07-13T00:08:55,332 ext_modules=[] 2021-07-13T00:08:55,332 running egg_info 2021-07-13T00:08:55,333 creating /tmp/pip-pip-egg-info-x6d3668r/deepspeed.egg-info 2021-07-13T00:08:55,334 writing /tmp/pip-pip-egg-info-x6d3668r/deepspeed.egg-info/PKG-INFO 2021-07-13T00:08:55,337 writing dependency_links to /tmp/pip-pip-egg-info-x6d3668r/deepspeed.egg-info/dependency_links.txt 2021-07-13T00:08:55,339 writing entry points to /tmp/pip-pip-egg-info-x6d3668r/deepspeed.egg-info/entry_points.txt 2021-07-13T00:08:55,340 writing requirements to /tmp/pip-pip-egg-info-x6d3668r/deepspeed.egg-info/requires.txt 2021-07-13T00:08:55,341 writing top-level names to /tmp/pip-pip-egg-info-x6d3668r/deepspeed.egg-info/top_level.txt 2021-07-13T00:08:55,343 writing manifest file '/tmp/pip-pip-egg-info-x6d3668r/deepspeed.egg-info/SOURCES.txt' 2021-07-13T00:08:55,504 reading manifest file '/tmp/pip-pip-egg-info-x6d3668r/deepspeed.egg-info/SOURCES.txt' 2021-07-13T00:08:55,506 reading manifest template 'MANIFEST.in' 2021-07-13T00:08:56,161 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-07-13T00:08:56,298 warning: no files found matching '*.tr' under directory 'csrc' 2021-07-13T00:08:56,363 warning: no files found matching '*.cc' under directory 'csrc' 2021-07-13T00:08:56,364 adding license file 'LICENSE' 2021-07-13T00:08:56,379 writing manifest file '/tmp/pip-pip-egg-info-x6d3668r/deepspeed.egg-info/SOURCES.txt' 2021-07-13T00:08:56,381 deepspeed build time = 1.3321664333343506 secs 2021-07-13T00:08:56,447 Source in /tmp/pip-wheel-cbqogfdu/deepspeed_0dbebc9339fe4d7fa29f1210a23d523e has version 0.4.3, which satisfies requirement deepspeed==0.4.3 from https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 2021-07-13T00:08:56,448 Removed deepspeed==0.4.3 from https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 from build tracker '/tmp/pip-req-tracker-e3kurquf' 2021-07-13T00:08:56,453 Created temporary directory: /tmp/pip-unpack-7621k4to 2021-07-13T00:08:56,454 Building wheels for collected packages: deepspeed 2021-07-13T00:08:56,458 Created temporary directory: /tmp/pip-wheel-3nki376z 2021-07-13T00:08:56,458 Building wheel for deepspeed (setup.py): started 2021-07-13T00:08:56,458 Destination directory: /tmp/pip-wheel-3nki376z 2021-07-13T00:08:56,459 Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-cbqogfdu/deepspeed_0dbebc9339fe4d7fa29f1210a23d523e/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-cbqogfdu/deepspeed_0dbebc9339fe4d7fa29f1210a23d523e/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-3nki376z 2021-07-13T00:08:57,271 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-07-13T00:08:57,277 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-07-13T00:08:57,287 DS_BUILD_OPS=0 2021-07-13T00:08:57,288 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-07-13T00:08:57,366 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-07-13T00:08:57,367 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-07-13T00:08:57,445 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-07-13T00:08:57,445 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-07-13T00:08:57,465 fatal: not a git repository (or any of the parent directories): .git 2021-07-13T00:08:57,469 version=0.4.3, git_hash=unknown, git_branch=unknown 2021-07-13T00:08:57,470 install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-07-13T00:08:57,471 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-07-13T00:08:57,471 ext_modules=[] 2021-07-13T00:08:57,753 running bdist_wheel 2021-07-13T00:08:57,759 running build 2021-07-13T00:08:57,759 running build_py 2021-07-13T00:08:57,885 creating build 2021-07-13T00:08:57,886 creating build/lib 2021-07-13T00:08:57,886 creating build/lib/op_builder 2021-07-13T00:08:57,888 copying op_builder/transformer_inference.py -> build/lib/op_builder 2021-07-13T00:08:57,890 copying op_builder/fused_lamb.py -> build/lib/op_builder 2021-07-13T00:08:57,892 copying op_builder/sparse_attn.py -> build/lib/op_builder 2021-07-13T00:08:57,893 copying op_builder/__init__.py -> build/lib/op_builder 2021-07-13T00:08:57,895 copying op_builder/builder.py -> build/lib/op_builder 2021-07-13T00:08:57,898 copying op_builder/utils.py -> build/lib/op_builder 2021-07-13T00:08:57,900 copying op_builder/stochastic_transformer.py -> build/lib/op_builder 2021-07-13T00:08:57,902 copying op_builder/async_io.py -> build/lib/op_builder 2021-07-13T00:08:57,904 copying op_builder/fused_adam.py -> build/lib/op_builder 2021-07-13T00:08:57,906 copying op_builder/cpu_adam.py -> build/lib/op_builder 2021-07-13T00:08:57,908 copying op_builder/transformer.py -> build/lib/op_builder 2021-07-13T00:08:57,910 copying op_builder/quantizer.py -> build/lib/op_builder 2021-07-13T00:08:57,913 creating build/lib/deepspeed 2021-07-13T00:08:57,913 copying deepspeed/constants.py -> build/lib/deepspeed 2021-07-13T00:08:57,916 copying deepspeed/__init__.py -> build/lib/deepspeed 2021-07-13T00:08:57,918 copying deepspeed/env_report.py -> build/lib/deepspeed 2021-07-13T00:08:57,920 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2021-07-13T00:08:57,922 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2021-07-13T00:08:57,926 creating build/lib/deepspeed/runtime 2021-07-13T00:08:57,927 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,930 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,932 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,934 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,937 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,941 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,943 copying deepspeed/runtime/csr_tensor.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,945 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,948 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,951 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,954 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,956 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,960 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,962 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2021-07-13T00:08:57,965 creating build/lib/deepspeed/inference 2021-07-13T00:08:57,966 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2021-07-13T00:08:57,968 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2021-07-13T00:08:57,972 creating build/lib/deepspeed/utils 2021-07-13T00:08:57,973 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2021-07-13T00:08:57,975 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2021-07-13T00:08:57,977 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2021-07-13T00:08:57,979 copying deepspeed/utils/distributed.py -> build/lib/deepspeed/utils 2021-07-13T00:08:57,982 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2021-07-13T00:08:57,984 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2021-07-13T00:08:57,987 creating build/lib/deepspeed/module_inject 2021-07-13T00:08:57,988 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2021-07-13T00:08:57,990 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2021-07-13T00:08:57,992 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2021-07-13T00:08:57,995 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2021-07-13T00:08:57,998 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2021-07-13T00:08:58,001 creating build/lib/deepspeed/profiling 2021-07-13T00:08:58,002 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2021-07-13T00:08:58,004 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2021-07-13T00:08:58,006 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2021-07-13T00:08:58,009 creating build/lib/deepspeed/pipe 2021-07-13T00:08:58,010 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2021-07-13T00:08:58,013 creating build/lib/deepspeed/launcher 2021-07-13T00:08:58,013 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2021-07-13T00:08:58,016 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2021-07-13T00:08:58,017 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2021-07-13T00:08:58,020 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2021-07-13T00:08:58,022 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2021-07-13T00:08:58,026 creating build/lib/deepspeed/elasticity 2021-07-13T00:08:58,027 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2021-07-13T00:08:58,029 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2021-07-13T00:08:58,031 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2021-07-13T00:08:58,034 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2021-07-13T00:08:58,036 creating build/lib/deepspeed/ops 2021-07-13T00:08:58,037 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2021-07-13T00:08:58,041 creating build/lib/deepspeed/runtime/swap_tensor 2021-07-13T00:08:58,042 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-13T00:08:58,044 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-13T00:08:58,047 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-13T00:08:58,049 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-13T00:08:58,051 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-13T00:08:58,054 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-13T00:08:58,056 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-13T00:08:58,059 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-13T00:08:58,061 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-13T00:08:58,065 creating build/lib/deepspeed/runtime/activation_checkpointing 2021-07-13T00:08:58,066 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-07-13T00:08:58,068 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-07-13T00:08:58,070 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-07-13T00:08:58,074 creating build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,075 copying deepspeed/runtime/zero/constants.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,078 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,080 copying deepspeed/runtime/zero/offload_constants.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,082 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,084 copying deepspeed/runtime/zero/stage1.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,088 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,091 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,093 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,095 copying deepspeed/runtime/zero/stage2.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,100 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,102 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,104 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,107 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,111 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2021-07-13T00:08:58,118 creating build/lib/deepspeed/runtime/comm 2021-07-13T00:08:58,119 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2021-07-13T00:08:58,121 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2021-07-13T00:08:58,124 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2021-07-13T00:08:58,127 creating build/lib/deepspeed/runtime/fp16 2021-07-13T00:08:58,128 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-07-13T00:08:58,130 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2021-07-13T00:08:58,132 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-07-13T00:08:58,135 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2021-07-13T00:08:58,138 creating build/lib/deepspeed/runtime/pipe 2021-07-13T00:08:58,139 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2021-07-13T00:08:58,141 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2021-07-13T00:08:58,143 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2021-07-13T00:08:58,146 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2021-07-13T00:08:58,150 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2021-07-13T00:08:58,152 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2021-07-13T00:08:58,156 creating build/lib/deepspeed/runtime/compression 2021-07-13T00:08:58,157 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2021-07-13T00:08:58,158 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2021-07-13T00:08:58,161 creating build/lib/deepspeed/runtime/fp16/onebit 2021-07-13T00:08:58,162 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-07-13T00:08:58,163 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-07-13T00:08:58,166 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-07-13T00:08:58,170 creating build/lib/deepspeed/profiling/flops_profiler 2021-07-13T00:08:58,171 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2021-07-13T00:08:58,173 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2021-07-13T00:08:58,178 creating build/lib/deepspeed/ops/sparse_attention 2021-07-13T00:08:58,178 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-13T00:08:58,181 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-13T00:08:58,183 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-13T00:08:58,186 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-13T00:08:58,189 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-13T00:08:58,192 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-13T00:08:58,194 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-13T00:08:58,197 creating build/lib/deepspeed/ops/quantizer 2021-07-13T00:08:58,198 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2021-07-13T00:08:58,200 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2021-07-13T00:08:58,203 creating build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,204 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,206 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,208 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,210 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,212 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,214 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,216 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,218 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,220 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,222 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,224 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,226 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2021-07-13T00:08:58,228 creating build/lib/deepspeed/ops/aio 2021-07-13T00:08:58,229 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2021-07-13T00:08:58,232 creating build/lib/deepspeed/ops/adam 2021-07-13T00:08:58,233 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2021-07-13T00:08:58,235 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2021-07-13T00:08:58,237 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2021-07-13T00:08:58,239 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2021-07-13T00:08:58,242 creating build/lib/deepspeed/ops/lamb 2021-07-13T00:08:58,243 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2021-07-13T00:08:58,246 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2021-07-13T00:08:58,248 creating build/lib/deepspeed/ops/transformer 2021-07-13T00:08:58,249 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2021-07-13T00:08:58,251 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2021-07-13T00:08:58,255 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2021-07-13T00:08:58,256 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-07-13T00:08:58,259 creating build/lib/deepspeed/ops/transformer/inference 2021-07-13T00:08:58,260 copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference 2021-07-13T00:08:58,263 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2021-07-13T00:08:58,265 running egg_info 2021-07-13T00:08:58,279 writing deepspeed.egg-info/PKG-INFO 2021-07-13T00:08:58,282 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2021-07-13T00:08:58,283 writing entry points to deepspeed.egg-info/entry_points.txt 2021-07-13T00:08:58,285 writing requirements to deepspeed.egg-info/requires.txt 2021-07-13T00:08:58,286 writing top-level names to deepspeed.egg-info/top_level.txt 2021-07-13T00:08:58,309 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-07-13T00:08:58,318 reading manifest template 'MANIFEST.in' 2021-07-13T00:08:58,947 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-07-13T00:08:59,077 warning: no files found matching '*.tr' under directory 'csrc' 2021-07-13T00:08:59,145 warning: no files found matching '*.cc' under directory 'csrc' 2021-07-13T00:08:59,146 adding license file 'LICENSE' 2021-07-13T00:08:59,166 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-07-13T00:08:59,180 creating build/lib/deepspeed/ops/csrc 2021-07-13T00:08:59,181 creating build/lib/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,182 copying deepspeed/ops/csrc/adam/compat.h -> build/lib/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,184 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,187 copying deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,190 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,192 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,194 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,197 creating build/lib/deepspeed/ops/csrc/aio 2021-07-13T00:08:59,197 creating build/lib/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,199 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,201 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,204 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,206 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,208 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,211 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,214 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,215 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,217 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,220 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,222 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,225 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,228 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,231 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,234 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,236 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,239 creating build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,239 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,242 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,244 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,247 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,250 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,253 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,257 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,260 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,263 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,265 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,268 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,271 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,273 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,276 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,279 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,282 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,285 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,288 creating build/lib/deepspeed/ops/csrc/lamb 2021-07-13T00:08:59,289 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2021-07-13T00:08:59,291 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2021-07-13T00:08:59,294 creating build/lib/deepspeed/ops/csrc/quantization 2021-07-13T00:08:59,295 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2021-07-13T00:08:59,298 copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2021-07-13T00:08:59,302 creating build/lib/deepspeed/ops/csrc/sparse_attention 2021-07-13T00:08:59,303 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2021-07-13T00:08:59,306 creating build/lib/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,307 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,310 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,314 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,318 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,321 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,325 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,330 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,334 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,337 creating build/lib/deepspeed/ops/csrc/transformer/inference 2021-07-13T00:08:59,338 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,340 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,343 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,347 copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,350 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,354 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,358 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-07-13T00:08:59,359 copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-07-13T00:08:59,362 copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-07-13T00:08:59,365 copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-07-13T00:08:59,368 creating build/lib/deepspeed/ops/csrc/utils 2021-07-13T00:08:59,369 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2021-07-13T00:08:59,372 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-07-13T00:08:59,374 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-07-13T00:08:59,377 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-07-13T00:08:59,398 running build_scripts 2021-07-13T00:08:59,398 creating build/scripts-3.7 2021-07-13T00:08:59,400 copying and adjusting bin/deepspeed -> build/scripts-3.7 2021-07-13T00:08:59,401 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2021-07-13T00:08:59,403 copying and adjusting bin/ds -> build/scripts-3.7 2021-07-13T00:08:59,404 copying bin/ds_ssh -> build/scripts-3.7 2021-07-13T00:08:59,406 copying and adjusting bin/ds_report -> build/scripts-3.7 2021-07-13T00:08:59,408 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2021-07-13T00:08:59,409 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2021-07-13T00:08:59,409 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2021-07-13T00:08:59,410 changing mode of build/scripts-3.7/ds from 644 to 755 2021-07-13T00:08:59,410 changing mode of build/scripts-3.7/ds_report from 644 to 755 2021-07-13T00:08:59,410 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2021-07-13T00:08:59,416 installing to build/bdist.linux-armv7l/wheel 2021-07-13T00:08:59,416 running install 2021-07-13T00:08:59,417 running install_lib 2021-07-13T00:08:59,421 creating build/bdist.linux-armv7l 2021-07-13T00:08:59,421 creating build/bdist.linux-armv7l/wheel 2021-07-13T00:08:59,423 creating build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,424 copying build/lib/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,426 copying build/lib/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,428 copying build/lib/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,430 copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,432 copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,434 copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,436 copying build/lib/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,438 copying build/lib/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,440 copying build/lib/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,442 copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,444 copying build/lib/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,446 copying build/lib/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-13T00:08:59,449 creating build/bdist.linux-armv7l/wheel/deepspeed 2021-07-13T00:08:59,450 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-07-13T00:08:59,454 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,455 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,459 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,462 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-13T00:08:59,463 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-13T00:08:59,465 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-13T00:08:59,468 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-13T00:08:59,470 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-13T00:08:59,473 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-13T00:08:59,475 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-13T00:08:59,477 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-13T00:08:59,480 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-13T00:08:59,482 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-13T00:08:59,485 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,486 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,489 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,494 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,496 copying build/lib/deepspeed/runtime/csr_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,498 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,501 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-07-13T00:08:59,502 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-07-13T00:08:59,504 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-07-13T00:08:59,506 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-07-13T00:08:59,509 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,513 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,514 copying build/lib/deepspeed/runtime/zero/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,516 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,519 copying build/lib/deepspeed/runtime/zero/offload_constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,521 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,523 copying build/lib/deepspeed/runtime/zero/stage1.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,526 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,529 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,531 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,533 copying build/lib/deepspeed/runtime/zero/stage2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,537 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,540 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,542 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,545 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,549 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-13T00:08:59,556 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,560 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-07-13T00:08:59,561 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-07-13T00:08:59,562 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-07-13T00:08:59,565 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-07-13T00:08:59,568 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,571 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,575 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-07-13T00:08:59,576 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-07-13T00:08:59,579 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-07-13T00:08:59,581 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-07-13T00:08:59,584 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-07-13T00:08:59,585 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-07-13T00:08:59,587 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-07-13T00:08:59,589 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-07-13T00:08:59,592 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-07-13T00:08:59,595 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-13T00:08:59,596 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-13T00:08:59,599 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-13T00:08:59,601 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-13T00:08:59,603 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-13T00:08:59,607 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-13T00:08:59,610 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-13T00:08:59,613 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,615 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-13T00:08:59,618 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-07-13T00:08:59,619 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-07-13T00:08:59,621 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-07-13T00:08:59,623 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-07-13T00:08:59,626 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-07-13T00:08:59,627 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-07-13T00:08:59,629 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-07-13T00:08:59,632 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-13T00:08:59,633 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-13T00:08:59,635 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-13T00:08:59,638 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-13T00:08:59,641 copying build/lib/deepspeed/utils/distributed.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-13T00:08:59,643 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-13T00:08:59,645 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-13T00:08:59,648 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-07-13T00:08:59,650 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-13T00:08:59,651 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-13T00:08:59,653 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-13T00:08:59,656 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-13T00:08:59,658 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-13T00:08:59,661 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-13T00:08:59,664 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-07-13T00:08:59,665 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-07-13T00:08:59,668 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-07-13T00:08:59,669 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-07-13T00:08:59,672 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-07-13T00:08:59,673 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-07-13T00:08:59,675 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-07-13T00:08:59,679 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-07-13T00:08:59,681 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-07-13T00:08:59,683 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-07-13T00:08:59,684 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-07-13T00:08:59,687 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-13T00:08:59,688 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-13T00:08:59,690 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-13T00:08:59,692 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-13T00:08:59,694 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-13T00:08:59,697 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-13T00:08:59,700 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-07-13T00:08:59,701 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-07-13T00:08:59,703 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-07-13T00:08:59,705 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-07-13T00:08:59,708 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-07-13T00:08:59,711 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-07-13T00:08:59,713 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-13T00:08:59,714 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-13T00:08:59,716 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-13T00:08:59,720 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-07-13T00:08:59,720 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-07-13T00:08:59,723 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-07-13T00:08:59,725 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-07-13T00:08:59,727 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-07-13T00:08:59,730 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-13T00:08:59,733 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-13T00:08:59,736 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-13T00:08:59,739 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-13T00:08:59,741 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-13T00:08:59,744 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-07-13T00:08:59,745 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-07-13T00:08:59,747 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-07-13T00:08:59,749 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-07-13T00:08:59,752 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,753 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,755 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,757 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,759 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,761 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,764 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,766 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,769 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,771 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,773 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,775 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,777 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-13T00:08:59,780 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2021-07-13T00:08:59,781 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-07-13T00:08:59,782 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-07-13T00:08:59,785 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-07-13T00:08:59,786 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-07-13T00:08:59,789 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-07-13T00:08:59,790 copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-07-13T00:08:59,794 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-07-13T00:08:59,797 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2021-07-13T00:08:59,799 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,800 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,802 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,805 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,807 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,809 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,811 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,813 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,815 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,818 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-13T00:08:59,821 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,822 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,825 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,827 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,829 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,831 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,833 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-13T00:08:59,836 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,837 copying build/lib/deepspeed/ops/csrc/adam/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,839 copying build/lib/deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,841 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,844 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,846 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,850 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-13T00:08:59,855 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-07-13T00:08:59,856 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-07-13T00:08:59,858 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-07-13T00:08:59,862 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,864 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2021-07-13T00:08:59,866 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,867 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,870 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,872 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,876 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,879 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-13T00:08:59,881 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-07-13T00:08:59,882 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-07-13T00:08:59,885 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-07-13T00:08:59,887 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-07-13T00:08:59,889 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,893 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,896 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,899 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,901 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,904 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,906 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,911 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-13T00:08:59,915 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,916 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,918 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,921 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,923 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,925 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,927 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,929 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,932 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,934 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,936 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,938 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,941 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,943 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,945 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,948 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,951 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,953 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-13T00:08:59,956 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-07-13T00:08:59,957 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-07-13T00:08:59,960 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-07-13T00:08:59,961 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-07-13T00:08:59,963 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-07-13T00:08:59,965 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-07-13T00:08:59,968 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-07-13T00:08:59,971 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-07-13T00:08:59,972 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-07-13T00:08:59,975 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-07-13T00:08:59,978 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-07-13T00:08:59,979 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-07-13T00:08:59,982 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-07-13T00:08:59,983 copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-07-13T00:08:59,986 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-07-13T00:08:59,989 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-07-13T00:08:59,992 running install_egg_info 2021-07-13T00:09:00,001 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.4.3-py3.7.egg-info 2021-07-13T00:09:00,016 running install_scripts 2021-07-13T00:09:00,076 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data 2021-07-13T00:09:00,077 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts 2021-07-13T00:09:00,078 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts 2021-07-13T00:09:00,080 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts 2021-07-13T00:09:00,082 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts 2021-07-13T00:09:00,084 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts 2021-07-13T00:09:00,085 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts 2021-07-13T00:09:00,087 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts 2021-07-13T00:09:00,089 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts/ds_elastic to 755 2021-07-13T00:09:00,089 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts/ds_ssh to 755 2021-07-13T00:09:00,089 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts/deepspeed.pt to 755 2021-07-13T00:09:00,090 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts/deepspeed to 755 2021-07-13T00:09:00,090 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts/ds_report to 755 2021-07-13T00:09:00,090 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.data/scripts/ds to 755 2021-07-13T00:09:00,152 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2021-07-13T00:09:00,157 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.3.dist-info/WHEEL 2021-07-13T00:09:00,160 creating '/tmp/pip-wheel-3nki376z/deepspeed-0.4.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2021-07-13T00:09:00,163 adding 'deepspeed/__init__.py' 2021-07-13T00:09:00,165 adding 'deepspeed/constants.py' 2021-07-13T00:09:00,166 adding 'deepspeed/env_report.py' 2021-07-13T00:09:00,168 adding 'deepspeed/git_version_info.py' 2021-07-13T00:09:00,169 adding 'deepspeed/git_version_info_installed.py' 2021-07-13T00:09:00,171 adding 'deepspeed/elasticity/__init__.py' 2021-07-13T00:09:00,173 adding 'deepspeed/elasticity/config.py' 2021-07-13T00:09:00,174 adding 'deepspeed/elasticity/constants.py' 2021-07-13T00:09:00,176 adding 'deepspeed/elasticity/elasticity.py' 2021-07-13T00:09:00,178 adding 'deepspeed/inference/__init__.py' 2021-07-13T00:09:00,180 adding 'deepspeed/inference/engine.py' 2021-07-13T00:09:00,182 adding 'deepspeed/launcher/__init__.py' 2021-07-13T00:09:00,183 adding 'deepspeed/launcher/constants.py' 2021-07-13T00:09:00,185 adding 'deepspeed/launcher/launch.py' 2021-07-13T00:09:00,187 adding 'deepspeed/launcher/multinode_runner.py' 2021-07-13T00:09:00,189 adding 'deepspeed/launcher/runner.py' 2021-07-13T00:09:00,191 adding 'deepspeed/module_inject/__init__.py' 2021-07-13T00:09:00,193 adding 'deepspeed/module_inject/inject.py' 2021-07-13T00:09:00,195 adding 'deepspeed/module_inject/module_quantize.py' 2021-07-13T00:09:00,197 adding 'deepspeed/module_inject/replace_module.py' 2021-07-13T00:09:00,199 adding 'deepspeed/module_inject/replace_policy.py' 2021-07-13T00:09:00,201 adding 'deepspeed/ops/__init__.py' 2021-07-13T00:09:00,203 adding 'deepspeed/ops/adam/__init__.py' 2021-07-13T00:09:00,205 adding 'deepspeed/ops/adam/cpu_adam.py' 2021-07-13T00:09:00,206 adding 'deepspeed/ops/adam/fused_adam.py' 2021-07-13T00:09:00,208 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2021-07-13T00:09:00,210 adding 'deepspeed/ops/aio/__init__.py' 2021-07-13T00:09:00,212 adding 'deepspeed/ops/csrc/adam/compat.h' 2021-07-13T00:09:00,215 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2021-07-13T00:09:00,217 adding 'deepspeed/ops/csrc/adam/custom_cuda_kernel.cu' 2021-07-13T00:09:00,218 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2021-07-13T00:09:00,219 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2021-07-13T00:09:00,221 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2021-07-13T00:09:00,225 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2021-07-13T00:09:00,226 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2021-07-13T00:09:00,227 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2021-07-13T00:09:00,229 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2021-07-13T00:09:00,230 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2021-07-13T00:09:00,231 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2021-07-13T00:09:00,234 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2021-07-13T00:09:00,235 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2021-07-13T00:09:00,236 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2021-07-13T00:09:00,238 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2021-07-13T00:09:00,239 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2021-07-13T00:09:00,241 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2021-07-13T00:09:00,242 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2021-07-13T00:09:00,244 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2021-07-13T00:09:00,245 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2021-07-13T00:09:00,248 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2021-07-13T00:09:00,249 adding 'deepspeed/ops/csrc/includes/Timer.h' 2021-07-13T00:09:00,251 adding 'deepspeed/ops/csrc/includes/context.h' 2021-07-13T00:09:00,252 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2021-07-13T00:09:00,253 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2021-07-13T00:09:00,255 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2021-07-13T00:09:00,257 adding 'deepspeed/ops/csrc/includes/dropout.h' 2021-07-13T00:09:00,258 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2021-07-13T00:09:00,260 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2021-07-13T00:09:00,261 adding 'deepspeed/ops/csrc/includes/gelu.h' 2021-07-13T00:09:00,263 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2021-07-13T00:09:00,264 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2021-07-13T00:09:00,265 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2021-07-13T00:09:00,267 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2021-07-13T00:09:00,268 adding 'deepspeed/ops/csrc/includes/softmax.h' 2021-07-13T00:09:00,269 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2021-07-13T00:09:00,271 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2021-07-13T00:09:00,273 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2021-07-13T00:09:00,275 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2021-07-13T00:09:00,277 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2021-07-13T00:09:00,280 adding 'deepspeed/ops/csrc/quantization/quantizer.cu' 2021-07-13T00:09:00,283 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2021-07-13T00:09:00,285 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2021-07-13T00:09:00,288 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2021-07-13T00:09:00,293 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2021-07-13T00:09:00,295 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2021-07-13T00:09:00,297 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2021-07-13T00:09:00,302 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2021-07-13T00:09:00,305 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2021-07-13T00:09:00,307 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2021-07-13T00:09:00,310 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2021-07-13T00:09:00,312 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2021-07-13T00:09:00,314 adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu' 2021-07-13T00:09:00,316 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2021-07-13T00:09:00,318 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2021-07-13T00:09:00,320 adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h' 2021-07-13T00:09:00,322 adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h' 2021-07-13T00:09:00,323 adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h' 2021-07-13T00:09:00,325 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2021-07-13T00:09:00,327 adding 'deepspeed/ops/lamb/__init__.py' 2021-07-13T00:09:00,329 adding 'deepspeed/ops/lamb/fused_lamb.py' 2021-07-13T00:09:00,331 adding 'deepspeed/ops/op_builder/__init__.py' 2021-07-13T00:09:00,332 adding 'deepspeed/ops/op_builder/async_io.py' 2021-07-13T00:09:00,334 adding 'deepspeed/ops/op_builder/builder.py' 2021-07-13T00:09:00,335 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2021-07-13T00:09:00,337 adding 'deepspeed/ops/op_builder/fused_adam.py' 2021-07-13T00:09:00,338 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2021-07-13T00:09:00,339 adding 'deepspeed/ops/op_builder/quantizer.py' 2021-07-13T00:09:00,340 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2021-07-13T00:09:00,341 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2021-07-13T00:09:00,343 adding 'deepspeed/ops/op_builder/transformer.py' 2021-07-13T00:09:00,344 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2021-07-13T00:09:00,345 adding 'deepspeed/ops/op_builder/utils.py' 2021-07-13T00:09:00,347 adding 'deepspeed/ops/quantizer/__init__.py' 2021-07-13T00:09:00,348 adding 'deepspeed/ops/quantizer/quantizer.py' 2021-07-13T00:09:00,350 adding 'deepspeed/ops/sparse_attention/__init__.py' 2021-07-13T00:09:00,351 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2021-07-13T00:09:00,355 adding 'deepspeed/ops/sparse_attention/matmul.py' 2021-07-13T00:09:00,357 adding 'deepspeed/ops/sparse_attention/softmax.py' 2021-07-13T00:09:00,361 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2021-07-13T00:09:00,363 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2021-07-13T00:09:00,366 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2021-07-13T00:09:00,369 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2021-07-13T00:09:00,370 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2021-07-13T00:09:00,372 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2021-07-13T00:09:00,373 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2021-07-13T00:09:00,375 adding 'deepspeed/ops/transformer/__init__.py' 2021-07-13T00:09:00,378 adding 'deepspeed/ops/transformer/transformer.py' 2021-07-13T00:09:00,380 adding 'deepspeed/ops/transformer/inference/__init__.py' 2021-07-13T00:09:00,383 adding 'deepspeed/ops/transformer/inference/transformer_inference.py' 2021-07-13T00:09:00,384 adding 'deepspeed/pipe/__init__.py' 2021-07-13T00:09:00,386 adding 'deepspeed/profiling/__init__.py' 2021-07-13T00:09:00,387 adding 'deepspeed/profiling/config.py' 2021-07-13T00:09:00,389 adding 'deepspeed/profiling/constants.py' 2021-07-13T00:09:00,390 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2021-07-13T00:09:00,395 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2021-07-13T00:09:00,397 adding 'deepspeed/runtime/__init__.py' 2021-07-13T00:09:00,401 adding 'deepspeed/runtime/config.py' 2021-07-13T00:09:00,402 adding 'deepspeed/runtime/config_utils.py' 2021-07-13T00:09:00,404 adding 'deepspeed/runtime/constants.py' 2021-07-13T00:09:00,406 adding 'deepspeed/runtime/csr_tensor.py' 2021-07-13T00:09:00,407 adding 'deepspeed/runtime/dataloader.py' 2021-07-13T00:09:00,409 adding 'deepspeed/runtime/eigenvalue.py' 2021-07-13T00:09:00,420 adding 'deepspeed/runtime/engine.py' 2021-07-13T00:09:00,424 adding 'deepspeed/runtime/lr_schedules.py' 2021-07-13T00:09:00,425 adding 'deepspeed/runtime/progressive_layer_drop.py' 2021-07-13T00:09:00,427 adding 'deepspeed/runtime/quantize.py' 2021-07-13T00:09:00,429 adding 'deepspeed/runtime/state_dict_factory.py' 2021-07-13T00:09:00,432 adding 'deepspeed/runtime/utils.py' 2021-07-13T00:09:00,434 adding 'deepspeed/runtime/weight_quantizer.py' 2021-07-13T00:09:00,436 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2021-07-13T00:09:00,440 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2021-07-13T00:09:00,442 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2021-07-13T00:09:00,443 adding 'deepspeed/runtime/comm/__init__.py' 2021-07-13T00:09:00,445 adding 'deepspeed/runtime/comm/mpi.py' 2021-07-13T00:09:00,447 adding 'deepspeed/runtime/comm/nccl.py' 2021-07-13T00:09:00,449 adding 'deepspeed/runtime/compression/__init__.py' 2021-07-13T00:09:00,450 adding 'deepspeed/runtime/compression/cupy.py' 2021-07-13T00:09:00,451 adding 'deepspeed/runtime/fp16/__init__.py' 2021-07-13T00:09:00,454 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2021-07-13T00:09:00,456 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2021-07-13T00:09:00,458 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2021-07-13T00:09:00,460 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2021-07-13T00:09:00,462 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2021-07-13T00:09:00,465 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2021-07-13T00:09:00,467 adding 'deepspeed/runtime/pipe/__init__.py' 2021-07-13T00:09:00,473 adding 'deepspeed/runtime/pipe/engine.py' 2021-07-13T00:09:00,476 adding 'deepspeed/runtime/pipe/module.py' 2021-07-13T00:09:00,478 adding 'deepspeed/runtime/pipe/p2p.py' 2021-07-13T00:09:00,480 adding 'deepspeed/runtime/pipe/schedule.py' 2021-07-13T00:09:00,482 adding 'deepspeed/runtime/pipe/topology.py' 2021-07-13T00:09:00,484 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2021-07-13T00:09:00,486 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2021-07-13T00:09:00,487 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2021-07-13T00:09:00,488 adding 'deepspeed/runtime/swap_tensor/constants.py' 2021-07-13T00:09:00,491 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2021-07-13T00:09:00,493 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2021-07-13T00:09:00,495 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2021-07-13T00:09:00,497 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2021-07-13T00:09:00,499 adding 'deepspeed/runtime/swap_tensor/utils.py' 2021-07-13T00:09:00,501 adding 'deepspeed/runtime/zero/__init__.py' 2021-07-13T00:09:00,502 adding 'deepspeed/runtime/zero/config.py' 2021-07-13T00:09:00,504 adding 'deepspeed/runtime/zero/constants.py' 2021-07-13T00:09:00,506 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2021-07-13T00:09:00,508 adding 'deepspeed/runtime/zero/linear.py' 2021-07-13T00:09:00,509 adding 'deepspeed/runtime/zero/offload_config.py' 2021-07-13T00:09:00,510 adding 'deepspeed/runtime/zero/offload_constants.py' 2021-07-13T00:09:00,516 adding 'deepspeed/runtime/zero/partition_parameters.py' 2021-07-13T00:09:00,523 adding 'deepspeed/runtime/zero/stage1.py' 2021-07-13T00:09:00,534 adding 'deepspeed/runtime/zero/stage2.py' 2021-07-13T00:09:00,552 adding 'deepspeed/runtime/zero/stage3.py' 2021-07-13T00:09:00,554 adding 'deepspeed/runtime/zero/test.py' 2021-07-13T00:09:00,556 adding 'deepspeed/runtime/zero/tiling.py' 2021-07-13T00:09:00,557 adding 'deepspeed/runtime/zero/utils.py' 2021-07-13T00:09:00,559 adding 'deepspeed/utils/__init__.py' 2021-07-13T00:09:00,560 adding 'deepspeed/utils/debug.py' 2021-07-13T00:09:00,562 adding 'deepspeed/utils/distributed.py' 2021-07-13T00:09:00,563 adding 'deepspeed/utils/logging.py' 2021-07-13T00:09:00,565 adding 'deepspeed/utils/timer.py' 2021-07-13T00:09:00,567 adding 'deepspeed/utils/zero_to_fp32.py' 2021-07-13T00:09:00,569 adding 'deepspeed-0.4.3.data/scripts/deepspeed' 2021-07-13T00:09:00,570 adding 'deepspeed-0.4.3.data/scripts/deepspeed.pt' 2021-07-13T00:09:00,571 adding 'deepspeed-0.4.3.data/scripts/ds' 2021-07-13T00:09:00,572 adding 'deepspeed-0.4.3.data/scripts/ds_elastic' 2021-07-13T00:09:00,574 adding 'deepspeed-0.4.3.data/scripts/ds_report' 2021-07-13T00:09:00,575 adding 'deepspeed-0.4.3.data/scripts/ds_ssh' 2021-07-13T00:09:00,578 adding 'op_builder/__init__.py' 2021-07-13T00:09:00,579 adding 'op_builder/async_io.py' 2021-07-13T00:09:00,581 adding 'op_builder/builder.py' 2021-07-13T00:09:00,583 adding 'op_builder/cpu_adam.py' 2021-07-13T00:09:00,584 adding 'op_builder/fused_adam.py' 2021-07-13T00:09:00,585 adding 'op_builder/fused_lamb.py' 2021-07-13T00:09:00,586 adding 'op_builder/quantizer.py' 2021-07-13T00:09:00,588 adding 'op_builder/sparse_attn.py' 2021-07-13T00:09:00,589 adding 'op_builder/stochastic_transformer.py' 2021-07-13T00:09:00,590 adding 'op_builder/transformer.py' 2021-07-13T00:09:00,591 adding 'op_builder/transformer_inference.py' 2021-07-13T00:09:00,592 adding 'op_builder/utils.py' 2021-07-13T00:09:00,593 adding 'deepspeed-0.4.3.dist-info/LICENSE' 2021-07-13T00:09:00,596 adding 'deepspeed-0.4.3.dist-info/METADATA' 2021-07-13T00:09:00,597 adding 'deepspeed-0.4.3.dist-info/WHEEL' 2021-07-13T00:09:00,598 adding 'deepspeed-0.4.3.dist-info/entry_points.txt' 2021-07-13T00:09:00,599 adding 'deepspeed-0.4.3.dist-info/top_level.txt' 2021-07-13T00:09:00,602 adding 'deepspeed-0.4.3.dist-info/RECORD' 2021-07-13T00:09:00,614 removing build/bdist.linux-armv7l/wheel 2021-07-13T00:09:00,701 deepspeed build time = 3.2289674282073975 secs 2021-07-13T00:09:00,779 Building wheel for deepspeed (setup.py): finished with status 'done' 2021-07-13T00:09:00,786 Created wheel for deepspeed: filename=deepspeed-0.4.3-py3-none-any.whl size=454638 sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 2021-07-13T00:09:00,787 Stored in directory: /tmp/pip-ephem-wheel-cache-74czkx3g/wheels/4a/8d/93/598b6a20d6b1bd479345d9c7ae0d14d2ce897f966adadfec89 2021-07-13T00:09:00,808 Successfully built deepspeed 2021-07-13T00:09:00,831 Removed build tracker: '/tmp/pip-req-tracker-e3kurquf'