2021-06-23T17:32:29,295 Created temporary directory: /tmp/pip-ephem-wheel-cache-j0vxbs93 2021-06-23T17:32:29,298 Created temporary directory: /tmp/pip-req-tracker-j9j0a9sr 2021-06-23T17:32:29,298 Initialized build tracking at /tmp/pip-req-tracker-j9j0a9sr 2021-06-23T17:32:29,298 Created build tracker: /tmp/pip-req-tracker-j9j0a9sr 2021-06-23T17:32:29,298 Entered build tracker: /tmp/pip-req-tracker-j9j0a9sr 2021-06-23T17:32:29,299 Created temporary directory: /tmp/pip-wheel-h_488wcl 2021-06-23T17:32:29,329 1 location(s) to search for versions of deepspeed: 2021-06-23T17:32:29,329 * https://pypi.org/simple/deepspeed/ 2021-06-23T17:32:29,330 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2021-06-23T17:32:29,330 Getting page https://pypi.org/simple/deepspeed/ 2021-06-23T17:32:29,332 Found index url https://pypi.org/simple 2021-06-23T17:32:29,445 Found link https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2021-06-23T17:32:29,445 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2021-06-23T17:32:29,446 Found link https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2021-06-23T17:32:29,446 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2021-06-23T17:32:29,447 Found link https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2021-06-23T17:32:29,447 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2021-06-23T17:32:29,447 Found link https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2021-06-23T17:32:29,448 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2021-06-23T17:32:29,448 Found link https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2021-06-23T17:32:29,449 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2021-06-23T17:32:29,449 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2021-06-23T17:32:29,449 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2021-06-23T17:32:29,450 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2021-06-23T17:32:29,450 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2021-06-23T17:32:29,450 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2021-06-23T17:32:29,450 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2021-06-23T17:32:29,451 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2021-06-23T17:32:29,451 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2021-06-23T17:32:29,451 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2021-06-23T17:32:29,452 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2021-06-23T17:32:29,452 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2021-06-23T17:32:29,452 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2021-06-23T17:32:29,453 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2021-06-23T17:32:29,453 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2021-06-23T17:32:29,453 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2021-06-23T17:32:29,453 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2021-06-23T17:32:29,454 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2021-06-23T17:32:29,454 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2021-06-23T17:32:29,454 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2021-06-23T17:32:29,455 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2021-06-23T17:32:29,455 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2021-06-23T17:32:29,455 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2021-06-23T17:32:29,460 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2021-06-23T17:32:29,475 Collecting deepspeed==0.4.1 2021-06-23T17:32:29,477 Created temporary directory: /tmp/pip-unpack-7uerwkhg 2021-06-23T17:32:29,518 Downloading deepspeed-0.4.1.tar.gz (445 kB) 2021-06-23T17:32:30,414 Added deepspeed==0.4.1 from https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 to build tracker '/tmp/pip-req-tracker-j9j0a9sr' 2021-06-23T17:32:30,415 Running setup.py (path:/tmp/pip-wheel-h_488wcl/deepspeed_857beaac217748f0bbaea4f3050148b7/setup.py) egg_info for package deepspeed 2021-06-23T17:32:30,416 Created temporary directory: /tmp/pip-pip-egg-info-prxv9u6n 2021-06-23T17:32:30,416 Running command python setup.py egg_info 2021-06-23T17:32:31,505 fatal: not a git repository (or any of the parent directories): .git 2021-06-23T17:32:31,791 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-06-23T17:32:31,791 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-06-23T17:32:31,791 DS_BUILD_OPS=0 2021-06-23T17:32:31,792 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-06-23T17:32:31,792 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-06-23T17:32:31,792 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-06-23T17:32:31,792 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-06-23T17:32:31,792 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-06-23T17:32:31,792 version=0.4.1, git_hash=unknown, git_branch=unknown 2021-06-23T17:32:31,792 install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-06-23T17:32:31,793 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-06-23T17:32:31,793 ext_modules=[] 2021-06-23T17:32:31,793 running egg_info 2021-06-23T17:32:31,793 creating /tmp/pip-pip-egg-info-prxv9u6n/deepspeed.egg-info 2021-06-23T17:32:31,794 writing /tmp/pip-pip-egg-info-prxv9u6n/deepspeed.egg-info/PKG-INFO 2021-06-23T17:32:31,798 writing dependency_links to /tmp/pip-pip-egg-info-prxv9u6n/deepspeed.egg-info/dependency_links.txt 2021-06-23T17:32:31,799 writing entry points to /tmp/pip-pip-egg-info-prxv9u6n/deepspeed.egg-info/entry_points.txt 2021-06-23T17:32:31,801 writing requirements to /tmp/pip-pip-egg-info-prxv9u6n/deepspeed.egg-info/requires.txt 2021-06-23T17:32:31,802 writing top-level names to /tmp/pip-pip-egg-info-prxv9u6n/deepspeed.egg-info/top_level.txt 2021-06-23T17:32:31,804 writing manifest file '/tmp/pip-pip-egg-info-prxv9u6n/deepspeed.egg-info/SOURCES.txt' 2021-06-23T17:32:31,969 reading manifest file '/tmp/pip-pip-egg-info-prxv9u6n/deepspeed.egg-info/SOURCES.txt' 2021-06-23T17:32:31,971 reading manifest template 'MANIFEST.in' 2021-06-23T17:32:32,622 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-06-23T17:32:32,761 warning: no files found matching '*.tr' under directory 'csrc' 2021-06-23T17:32:32,830 warning: no files found matching '*.cc' under directory 'csrc' 2021-06-23T17:32:32,846 writing manifest file '/tmp/pip-pip-egg-info-prxv9u6n/deepspeed.egg-info/SOURCES.txt' 2021-06-23T17:32:32,848 deepspeed build time = 1.3364224433898926 secs 2021-06-23T17:32:32,914 Source in /tmp/pip-wheel-h_488wcl/deepspeed_857beaac217748f0bbaea4f3050148b7 has version 0.4.1, which satisfies requirement deepspeed==0.4.1 from https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 2021-06-23T17:32:32,916 Removed deepspeed==0.4.1 from https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 from build tracker '/tmp/pip-req-tracker-j9j0a9sr' 2021-06-23T17:32:32,922 Created temporary directory: /tmp/pip-unpack-d2878al7 2021-06-23T17:32:32,922 Building wheels for collected packages: deepspeed 2021-06-23T17:32:32,927 Created temporary directory: /tmp/pip-wheel-now7s3m_ 2021-06-23T17:32:32,927 Building wheel for deepspeed (setup.py): started 2021-06-23T17:32:32,928 Destination directory: /tmp/pip-wheel-now7s3m_ 2021-06-23T17:32:32,928 Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-h_488wcl/deepspeed_857beaac217748f0bbaea4f3050148b7/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-h_488wcl/deepspeed_857beaac217748f0bbaea4f3050148b7/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-now7s3m_ 2021-06-23T17:32:33,745 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-06-23T17:32:33,752 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-06-23T17:32:33,763 DS_BUILD_OPS=0 2021-06-23T17:32:33,764 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-06-23T17:32:33,849 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-06-23T17:32:33,851 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-06-23T17:32:33,930 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-06-23T17:32:33,930 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-06-23T17:32:33,950 fatal: not a git repository (or any of the parent directories): .git 2021-06-23T17:32:33,953 version=0.4.1, git_hash=unknown, git_branch=unknown 2021-06-23T17:32:33,954 install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-06-23T17:32:33,954 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-06-23T17:32:33,955 ext_modules=[] 2021-06-23T17:32:34,228 running bdist_wheel 2021-06-23T17:32:34,233 running build 2021-06-23T17:32:34,233 running build_py 2021-06-23T17:32:34,364 creating build 2021-06-23T17:32:34,364 creating build/lib 2021-06-23T17:32:34,365 creating build/lib/op_builder 2021-06-23T17:32:34,366 copying op_builder/utils.py -> build/lib/op_builder 2021-06-23T17:32:34,368 copying op_builder/stochastic_transformer.py -> build/lib/op_builder 2021-06-23T17:32:34,369 copying op_builder/__init__.py -> build/lib/op_builder 2021-06-23T17:32:34,371 copying op_builder/fused_adam.py -> build/lib/op_builder 2021-06-23T17:32:34,373 copying op_builder/quantizer.py -> build/lib/op_builder 2021-06-23T17:32:34,375 copying op_builder/fused_lamb.py -> build/lib/op_builder 2021-06-23T17:32:34,376 copying op_builder/builder.py -> build/lib/op_builder 2021-06-23T17:32:34,379 copying op_builder/sparse_attn.py -> build/lib/op_builder 2021-06-23T17:32:34,381 copying op_builder/async_io.py -> build/lib/op_builder 2021-06-23T17:32:34,383 copying op_builder/cpu_adam.py -> build/lib/op_builder 2021-06-23T17:32:34,385 copying op_builder/transformer.py -> build/lib/op_builder 2021-06-23T17:32:34,387 copying op_builder/transformer_inference.py -> build/lib/op_builder 2021-06-23T17:32:34,389 creating build/lib/deepspeed 2021-06-23T17:32:34,390 copying deepspeed/__init__.py -> build/lib/deepspeed 2021-06-23T17:32:34,393 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2021-06-23T17:32:34,394 copying deepspeed/env_report.py -> build/lib/deepspeed 2021-06-23T17:32:34,396 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2021-06-23T17:32:34,398 copying deepspeed/constants.py -> build/lib/deepspeed 2021-06-23T17:32:34,401 creating build/lib/deepspeed/elasticity 2021-06-23T17:32:34,402 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2021-06-23T17:32:34,404 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2021-06-23T17:32:34,406 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2021-06-23T17:32:34,415 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2021-06-23T17:32:34,419 creating build/lib/deepspeed/runtime 2021-06-23T17:32:34,420 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,423 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,426 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,430 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,432 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,434 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,436 copying deepspeed/runtime/csr_tensor.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,438 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,441 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,443 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,448 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,451 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,455 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,458 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2021-06-23T17:32:34,462 creating build/lib/deepspeed/ops 2021-06-23T17:32:34,463 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2021-06-23T17:32:34,466 creating build/lib/deepspeed/benchmarking 2021-06-23T17:32:34,467 copying deepspeed/benchmarking/__init__.py -> build/lib/deepspeed/benchmarking 2021-06-23T17:32:34,469 copying deepspeed/benchmarking/all_reduce.py -> build/lib/deepspeed/benchmarking 2021-06-23T17:32:34,472 creating build/lib/deepspeed/pipe 2021-06-23T17:32:34,473 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2021-06-23T17:32:34,477 creating build/lib/deepspeed/utils 2021-06-23T17:32:34,478 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2021-06-23T17:32:34,480 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2021-06-23T17:32:34,482 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2021-06-23T17:32:34,485 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2021-06-23T17:32:34,488 copying deepspeed/utils/distributed.py -> build/lib/deepspeed/utils 2021-06-23T17:32:34,491 creating build/lib/deepspeed/launcher 2021-06-23T17:32:34,492 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2021-06-23T17:32:34,500 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2021-06-23T17:32:34,501 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2021-06-23T17:32:34,505 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2021-06-23T17:32:34,507 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2021-06-23T17:32:34,511 creating build/lib/deepspeed/profiling 2021-06-23T17:32:34,513 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2021-06-23T17:32:34,515 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2021-06-23T17:32:34,518 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2021-06-23T17:32:34,521 creating build/lib/deepspeed/inference 2021-06-23T17:32:34,522 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2021-06-23T17:32:34,525 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2021-06-23T17:32:34,529 creating build/lib/deepspeed/module_inject 2021-06-23T17:32:34,530 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2021-06-23T17:32:34,533 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2021-06-23T17:32:34,537 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2021-06-23T17:32:34,541 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2021-06-23T17:32:34,543 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2021-06-23T17:32:34,546 creating build/lib/deepspeed/runtime/comm 2021-06-23T17:32:34,548 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2021-06-23T17:32:34,550 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2021-06-23T17:32:34,553 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2021-06-23T17:32:34,556 creating build/lib/deepspeed/runtime/compression 2021-06-23T17:32:34,558 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2021-06-23T17:32:34,560 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2021-06-23T17:32:34,563 creating build/lib/deepspeed/runtime/fp16 2021-06-23T17:32:34,564 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2021-06-23T17:32:34,566 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2021-06-23T17:32:34,569 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-06-23T17:32:34,572 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-06-23T17:32:34,576 creating build/lib/deepspeed/runtime/pipe 2021-06-23T17:32:34,577 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2021-06-23T17:32:34,580 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2021-06-23T17:32:34,583 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2021-06-23T17:32:34,586 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2021-06-23T17:32:34,589 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2021-06-23T17:32:34,592 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2021-06-23T17:32:34,596 creating build/lib/deepspeed/runtime/swap_tensor 2021-06-23T17:32:34,597 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-06-23T17:32:34,600 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2021-06-23T17:32:34,602 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-06-23T17:32:34,605 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2021-06-23T17:32:34,607 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-06-23T17:32:34,609 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-06-23T17:32:34,612 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-06-23T17:32:34,615 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-06-23T17:32:34,617 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2021-06-23T17:32:34,621 creating build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,622 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,624 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,627 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,629 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,631 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,633 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,639 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,642 copying deepspeed/runtime/zero/stage1.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,645 copying deepspeed/runtime/zero/stage2.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,650 copying deepspeed/runtime/zero/constants.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,653 copying deepspeed/runtime/zero/offload_constants.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,655 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,658 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,661 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2021-06-23T17:32:34,664 creating build/lib/deepspeed/runtime/activation_checkpointing 2021-06-23T17:32:34,666 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-06-23T17:32:34,668 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-06-23T17:32:34,670 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-06-23T17:32:34,673 creating build/lib/deepspeed/runtime/fp16/onebit 2021-06-23T17:32:34,675 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-06-23T17:32:34,676 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-06-23T17:32:34,680 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-06-23T17:32:34,684 creating build/lib/deepspeed/ops/adam 2021-06-23T17:32:34,685 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2021-06-23T17:32:34,687 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2021-06-23T17:32:34,690 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2021-06-23T17:32:34,692 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2021-06-23T17:32:34,695 creating build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,697 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,699 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,701 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,703 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,705 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,707 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,709 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,712 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,714 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,717 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,719 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,721 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2021-06-23T17:32:34,724 creating build/lib/deepspeed/ops/sparse_attention 2021-06-23T17:32:34,725 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-06-23T17:32:34,728 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-06-23T17:32:34,730 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2021-06-23T17:32:34,732 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2021-06-23T17:32:34,736 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2021-06-23T17:32:34,739 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2021-06-23T17:32:34,742 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2021-06-23T17:32:34,745 creating build/lib/deepspeed/ops/quantizer 2021-06-23T17:32:34,746 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2021-06-23T17:32:34,749 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2021-06-23T17:32:34,751 creating build/lib/deepspeed/ops/aio 2021-06-23T17:32:34,753 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2021-06-23T17:32:34,755 creating build/lib/deepspeed/ops/transformer 2021-06-23T17:32:34,757 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2021-06-23T17:32:34,759 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2021-06-23T17:32:34,765 creating build/lib/deepspeed/ops/lamb 2021-06-23T17:32:34,766 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2021-06-23T17:32:34,769 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2021-06-23T17:32:34,772 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2021-06-23T17:32:34,773 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-06-23T17:32:34,779 creating build/lib/deepspeed/ops/transformer/inference 2021-06-23T17:32:34,783 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2021-06-23T17:32:34,793 copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference 2021-06-23T17:32:34,810 creating build/lib/deepspeed/profiling/flops_profiler 2021-06-23T17:32:34,814 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2021-06-23T17:32:34,822 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2021-06-23T17:32:34,826 running egg_info 2021-06-23T17:32:34,842 writing deepspeed.egg-info/PKG-INFO 2021-06-23T17:32:34,847 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2021-06-23T17:32:34,849 writing entry points to deepspeed.egg-info/entry_points.txt 2021-06-23T17:32:34,851 writing requirements to deepspeed.egg-info/requires.txt 2021-06-23T17:32:34,852 writing top-level names to deepspeed.egg-info/top_level.txt 2021-06-23T17:32:34,882 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-06-23T17:32:34,891 reading manifest template 'MANIFEST.in' 2021-06-23T17:32:35,508 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-06-23T17:32:35,636 warning: no files found matching '*.tr' under directory 'csrc' 2021-06-23T17:32:35,700 warning: no files found matching '*.cc' under directory 'csrc' 2021-06-23T17:32:35,720 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-06-23T17:32:35,735 creating build/lib/deepspeed/ops/csrc 2021-06-23T17:32:35,736 creating build/lib/deepspeed/ops/csrc/adam 2021-06-23T17:32:35,737 copying deepspeed/ops/csrc/adam/compat.h -> build/lib/deepspeed/ops/csrc/adam 2021-06-23T17:32:35,740 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-06-23T17:32:35,743 copying deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/adam 2021-06-23T17:32:35,746 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-06-23T17:32:35,748 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2021-06-23T17:32:35,751 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2021-06-23T17:32:35,754 creating build/lib/deepspeed/ops/csrc/aio 2021-06-23T17:32:35,755 creating build/lib/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:35,756 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:35,760 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:35,762 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:35,765 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:35,768 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:35,771 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:35,774 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:35,775 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:35,778 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:35,781 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:35,784 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:35,787 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:35,790 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:35,793 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:35,796 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:35,798 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:35,801 creating build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,802 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,805 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,807 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,811 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,817 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,820 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,823 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,826 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,830 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,833 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,835 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,839 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,842 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,845 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,848 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,850 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,853 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2021-06-23T17:32:35,856 creating build/lib/deepspeed/ops/csrc/lamb 2021-06-23T17:32:35,857 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2021-06-23T17:32:35,860 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2021-06-23T17:32:35,863 creating build/lib/deepspeed/ops/csrc/quantization 2021-06-23T17:32:35,865 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2021-06-23T17:32:35,868 copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2021-06-23T17:32:35,872 creating build/lib/deepspeed/ops/csrc/sparse_attention 2021-06-23T17:32:35,873 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2021-06-23T17:32:35,876 creating build/lib/deepspeed/ops/csrc/transformer 2021-06-23T17:32:35,877 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-06-23T17:32:35,881 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-06-23T17:32:35,885 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2021-06-23T17:32:35,889 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-06-23T17:32:35,893 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-06-23T17:32:35,896 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-06-23T17:32:35,901 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-06-23T17:32:35,905 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-06-23T17:32:35,909 creating build/lib/deepspeed/ops/csrc/transformer/inference 2021-06-23T17:32:35,910 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:35,911 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:35,915 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:35,918 copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:35,922 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:35,925 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:35,929 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-06-23T17:32:35,930 copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-06-23T17:32:35,933 copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-06-23T17:32:35,937 copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-06-23T17:32:35,940 creating build/lib/deepspeed/ops/csrc/utils 2021-06-23T17:32:35,941 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2021-06-23T17:32:35,944 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-06-23T17:32:35,948 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-06-23T17:32:35,950 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-06-23T17:32:35,972 running build_scripts 2021-06-23T17:32:35,973 creating build/scripts-3.7 2021-06-23T17:32:35,975 copying and adjusting bin/deepspeed -> build/scripts-3.7 2021-06-23T17:32:35,977 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2021-06-23T17:32:35,979 copying and adjusting bin/ds -> build/scripts-3.7 2021-06-23T17:32:35,981 copying bin/ds_ssh -> build/scripts-3.7 2021-06-23T17:32:35,983 copying and adjusting bin/ds_report -> build/scripts-3.7 2021-06-23T17:32:35,986 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2021-06-23T17:32:35,987 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2021-06-23T17:32:35,987 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2021-06-23T17:32:35,988 changing mode of build/scripts-3.7/ds from 644 to 755 2021-06-23T17:32:35,989 changing mode of build/scripts-3.7/ds_report from 644 to 755 2021-06-23T17:32:35,989 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2021-06-23T17:32:35,993 installing to build/bdist.linux-armv7l/wheel 2021-06-23T17:32:35,993 running install 2021-06-23T17:32:35,995 running install_lib 2021-06-23T17:32:35,999 creating build/bdist.linux-armv7l 2021-06-23T17:32:35,999 creating build/bdist.linux-armv7l/wheel 2021-06-23T17:32:36,002 creating build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,003 copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,006 copying build/lib/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,008 copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,010 copying build/lib/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,013 copying build/lib/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,015 copying build/lib/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,018 copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,021 copying build/lib/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,023 copying build/lib/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,026 copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,028 copying build/lib/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,031 copying build/lib/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-06-23T17:32:36,034 creating build/bdist.linux-armv7l/wheel/deepspeed 2021-06-23T17:32:36,036 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-06-23T17:32:36,037 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-06-23T17:32:36,040 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-06-23T17:32:36,042 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-06-23T17:32:36,045 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-06-23T17:32:36,049 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,050 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,054 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,058 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-06-23T17:32:36,059 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-06-23T17:32:36,061 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-06-23T17:32:36,064 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-06-23T17:32:36,067 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,071 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,073 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,075 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,078 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-06-23T17:32:36,080 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-06-23T17:32:36,082 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-06-23T17:32:36,085 copying build/lib/deepspeed/runtime/csr_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,088 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,092 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-06-23T17:32:36,093 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-06-23T17:32:36,095 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-06-23T17:32:36,099 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-06-23T17:32:36,100 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-06-23T17:32:36,103 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-06-23T17:32:36,106 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-06-23T17:32:36,109 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-06-23T17:32:36,112 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-06-23T17:32:36,116 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-06-23T17:32:36,118 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-06-23T17:32:36,120 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-06-23T17:32:36,123 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-06-23T17:32:36,127 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-06-23T17:32:36,130 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-06-23T17:32:36,134 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-06-23T17:32:36,138 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-06-23T17:32:36,139 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-06-23T17:32:36,142 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-06-23T17:32:36,145 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-06-23T17:32:36,148 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-06-23T17:32:36,150 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-06-23T17:32:36,153 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-06-23T17:32:36,157 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-06-23T17:32:36,160 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-06-23T17:32:36,163 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-06-23T17:32:36,165 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,168 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,173 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,176 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,180 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,185 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,187 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,189 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,192 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,194 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,197 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,199 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,208 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,210 copying build/lib/deepspeed/runtime/zero/stage1.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,215 copying build/lib/deepspeed/runtime/zero/stage2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,220 copying build/lib/deepspeed/runtime/zero/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,223 copying build/lib/deepspeed/runtime/zero/offload_constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,226 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,230 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,233 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-06-23T17:32:36,237 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-06-23T17:32:36,239 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-06-23T17:32:36,242 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-06-23T17:32:36,244 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-06-23T17:32:36,248 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-06-23T17:32:36,252 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-06-23T17:32:36,253 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-06-23T17:32:36,257 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-06-23T17:32:36,258 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-06-23T17:32:36,261 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-06-23T17:32:36,264 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-06-23T17:32:36,266 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-06-23T17:32:36,269 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,270 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,273 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,275 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,277 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,280 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,282 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,284 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,287 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,290 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,293 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,295 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,297 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-06-23T17:32:36,300 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-06-23T17:32:36,301 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-06-23T17:32:36,303 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-06-23T17:32:36,306 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-06-23T17:32:36,308 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-06-23T17:32:36,312 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-06-23T17:32:36,312 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-06-23T17:32:36,315 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-06-23T17:32:36,317 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-06-23T17:32:36,319 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-06-23T17:32:36,322 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-06-23T17:32:36,325 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-06-23T17:32:36,328 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-06-23T17:32:36,331 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-06-23T17:32:36,332 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-06-23T17:32:36,334 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-06-23T17:32:36,337 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-06-23T17:32:36,337 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-06-23T17:32:36,340 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-06-23T17:32:36,341 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-06-23T17:32:36,344 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-06-23T17:32:36,345 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-06-23T17:32:36,347 copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-06-23T17:32:36,350 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-06-23T17:32:36,354 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-06-23T17:32:36,355 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-06-23T17:32:36,357 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-06-23T17:32:36,360 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2021-06-23T17:32:36,362 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-06-23T17:32:36,363 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-06-23T17:32:36,366 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-06-23T17:32:36,369 copying build/lib/deepspeed/ops/csrc/adam/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-06-23T17:32:36,371 copying build/lib/deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-06-23T17:32:36,373 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-06-23T17:32:36,375 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-06-23T17:32:36,378 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-06-23T17:32:36,379 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-06-23T17:32:36,382 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-06-23T17:32:36,382 copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-06-23T17:32:36,386 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-06-23T17:32:36,389 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,389 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,392 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,395 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,397 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,399 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,401 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,403 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,405 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,407 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,409 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,411 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,414 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,416 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,418 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,420 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,422 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,425 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-06-23T17:32:36,428 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-06-23T17:32:36,429 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-06-23T17:32:36,431 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2021-06-23T17:32:36,433 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:36,434 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:36,436 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:36,438 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:36,440 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:36,443 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:36,445 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-06-23T17:32:36,449 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:36,450 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:36,452 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:36,455 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:36,457 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:36,460 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:36,461 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:36,464 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:36,466 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:36,469 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-06-23T17:32:36,471 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-06-23T17:32:36,472 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-06-23T17:32:36,475 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-06-23T17:32:36,479 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-06-23T17:32:36,481 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-06-23T17:32:36,487 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-06-23T17:32:36,490 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-06-23T17:32:36,493 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-06-23T17:32:36,496 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-06-23T17:32:36,499 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2021-06-23T17:32:36,501 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-06-23T17:32:36,502 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-06-23T17:32:36,504 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-06-23T17:32:36,506 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-06-23T17:32:36,509 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:36,510 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:36,513 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:36,516 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:36,518 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:36,521 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-06-23T17:32:36,524 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-06-23T17:32:36,525 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-06-23T17:32:36,528 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-06-23T17:32:36,530 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-06-23T17:32:36,533 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-06-23T17:32:36,536 creating build/bdist.linux-armv7l/wheel/deepspeed/benchmarking 2021-06-23T17:32:36,537 copying build/lib/deepspeed/benchmarking/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/benchmarking 2021-06-23T17:32:36,538 copying build/lib/deepspeed/benchmarking/all_reduce.py -> build/bdist.linux-armv7l/wheel/deepspeed/benchmarking 2021-06-23T17:32:36,541 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-06-23T17:32:36,542 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-06-23T17:32:36,544 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-06-23T17:32:36,547 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-06-23T17:32:36,549 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-06-23T17:32:36,550 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-06-23T17:32:36,552 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-06-23T17:32:36,554 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-06-23T17:32:36,557 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-06-23T17:32:36,559 copying build/lib/deepspeed/utils/distributed.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-06-23T17:32:36,561 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-06-23T17:32:36,564 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-06-23T17:32:36,565 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-06-23T17:32:36,568 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-06-23T17:32:36,569 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-06-23T17:32:36,572 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-06-23T17:32:36,573 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-06-23T17:32:36,577 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-06-23T17:32:36,578 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-06-23T17:32:36,580 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-06-23T17:32:36,582 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-06-23T17:32:36,583 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-06-23T17:32:36,586 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-06-23T17:32:36,588 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-06-23T17:32:36,590 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-06-23T17:32:36,591 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-06-23T17:32:36,593 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-06-23T17:32:36,597 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-06-23T17:32:36,598 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-06-23T17:32:36,600 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-06-23T17:32:36,602 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-06-23T17:32:36,605 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-06-23T17:32:36,608 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-06-23T17:32:36,609 running install_egg_info 2021-06-23T17:32:36,618 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.4.1-py3.7.egg-info 2021-06-23T17:32:36,633 running install_scripts 2021-06-23T17:32:36,690 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data 2021-06-23T17:32:36,690 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts 2021-06-23T17:32:36,691 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts 2021-06-23T17:32:36,693 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts 2021-06-23T17:32:36,695 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts 2021-06-23T17:32:36,697 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts 2021-06-23T17:32:36,699 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts 2021-06-23T17:32:36,700 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts 2021-06-23T17:32:36,702 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts/ds_elastic to 755 2021-06-23T17:32:36,702 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts/ds_report to 755 2021-06-23T17:32:36,702 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts/ds to 755 2021-06-23T17:32:36,703 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts/deepspeed to 755 2021-06-23T17:32:36,703 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts/ds_ssh to 755 2021-06-23T17:32:36,703 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.data/scripts/deepspeed.pt to 755 2021-06-23T17:32:36,774 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.1.dist-info/WHEEL 2021-06-23T17:32:36,777 creating '/tmp/pip-wheel-now7s3m_/deepspeed-0.4.1-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2021-06-23T17:32:36,780 adding 'deepspeed/__init__.py' 2021-06-23T17:32:36,781 adding 'deepspeed/constants.py' 2021-06-23T17:32:36,783 adding 'deepspeed/env_report.py' 2021-06-23T17:32:36,784 adding 'deepspeed/git_version_info.py' 2021-06-23T17:32:36,785 adding 'deepspeed/git_version_info_installed.py' 2021-06-23T17:32:36,787 adding 'deepspeed/benchmarking/__init__.py' 2021-06-23T17:32:36,788 adding 'deepspeed/benchmarking/all_reduce.py' 2021-06-23T17:32:36,790 adding 'deepspeed/elasticity/__init__.py' 2021-06-23T17:32:36,792 adding 'deepspeed/elasticity/config.py' 2021-06-23T17:32:36,793 adding 'deepspeed/elasticity/constants.py' 2021-06-23T17:32:36,795 adding 'deepspeed/elasticity/elasticity.py' 2021-06-23T17:32:36,797 adding 'deepspeed/inference/__init__.py' 2021-06-23T17:32:36,799 adding 'deepspeed/inference/engine.py' 2021-06-23T17:32:36,800 adding 'deepspeed/launcher/__init__.py' 2021-06-23T17:32:36,802 adding 'deepspeed/launcher/constants.py' 2021-06-23T17:32:36,803 adding 'deepspeed/launcher/launch.py' 2021-06-23T17:32:36,805 adding 'deepspeed/launcher/multinode_runner.py' 2021-06-23T17:32:36,807 adding 'deepspeed/launcher/runner.py' 2021-06-23T17:32:36,809 adding 'deepspeed/module_inject/__init__.py' 2021-06-23T17:32:36,811 adding 'deepspeed/module_inject/inject.py' 2021-06-23T17:32:36,812 adding 'deepspeed/module_inject/module_quantize.py' 2021-06-23T17:32:36,814 adding 'deepspeed/module_inject/replace_module.py' 2021-06-23T17:32:36,816 adding 'deepspeed/module_inject/replace_policy.py' 2021-06-23T17:32:36,818 adding 'deepspeed/ops/__init__.py' 2021-06-23T17:32:36,820 adding 'deepspeed/ops/adam/__init__.py' 2021-06-23T17:32:36,821 adding 'deepspeed/ops/adam/cpu_adam.py' 2021-06-23T17:32:36,823 adding 'deepspeed/ops/adam/fused_adam.py' 2021-06-23T17:32:36,824 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2021-06-23T17:32:36,826 adding 'deepspeed/ops/aio/__init__.py' 2021-06-23T17:32:36,828 adding 'deepspeed/ops/csrc/adam/compat.h' 2021-06-23T17:32:36,831 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2021-06-23T17:32:36,832 adding 'deepspeed/ops/csrc/adam/custom_cuda_kernel.cu' 2021-06-23T17:32:36,834 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2021-06-23T17:32:36,835 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2021-06-23T17:32:36,837 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2021-06-23T17:32:36,840 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2021-06-23T17:32:36,841 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2021-06-23T17:32:36,842 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2021-06-23T17:32:36,843 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2021-06-23T17:32:36,845 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2021-06-23T17:32:36,846 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2021-06-23T17:32:36,848 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2021-06-23T17:32:36,850 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2021-06-23T17:32:36,851 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2021-06-23T17:32:36,853 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2021-06-23T17:32:36,854 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2021-06-23T17:32:36,856 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2021-06-23T17:32:36,857 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2021-06-23T17:32:36,858 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2021-06-23T17:32:36,859 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2021-06-23T17:32:36,861 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2021-06-23T17:32:36,863 adding 'deepspeed/ops/csrc/includes/Timer.h' 2021-06-23T17:32:36,864 adding 'deepspeed/ops/csrc/includes/context.h' 2021-06-23T17:32:36,866 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2021-06-23T17:32:36,867 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2021-06-23T17:32:36,869 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2021-06-23T17:32:36,870 adding 'deepspeed/ops/csrc/includes/dropout.h' 2021-06-23T17:32:36,872 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2021-06-23T17:32:36,873 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2021-06-23T17:32:36,874 adding 'deepspeed/ops/csrc/includes/gelu.h' 2021-06-23T17:32:36,876 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2021-06-23T17:32:36,877 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2021-06-23T17:32:36,878 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2021-06-23T17:32:36,880 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2021-06-23T17:32:36,881 adding 'deepspeed/ops/csrc/includes/softmax.h' 2021-06-23T17:32:36,882 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2021-06-23T17:32:36,884 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2021-06-23T17:32:36,886 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2021-06-23T17:32:36,888 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2021-06-23T17:32:36,890 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2021-06-23T17:32:36,893 adding 'deepspeed/ops/csrc/quantization/quantizer.cu' 2021-06-23T17:32:36,895 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2021-06-23T17:32:36,897 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2021-06-23T17:32:36,900 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2021-06-23T17:32:36,904 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2021-06-23T17:32:36,906 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2021-06-23T17:32:36,908 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2021-06-23T17:32:36,913 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2021-06-23T17:32:36,916 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2021-06-23T17:32:36,918 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2021-06-23T17:32:36,921 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2021-06-23T17:32:36,923 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2021-06-23T17:32:36,924 adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu' 2021-06-23T17:32:36,927 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2021-06-23T17:32:36,929 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2021-06-23T17:32:36,931 adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h' 2021-06-23T17:32:36,933 adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h' 2021-06-23T17:32:36,934 adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h' 2021-06-23T17:32:36,936 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2021-06-23T17:32:36,938 adding 'deepspeed/ops/lamb/__init__.py' 2021-06-23T17:32:36,939 adding 'deepspeed/ops/lamb/fused_lamb.py' 2021-06-23T17:32:36,941 adding 'deepspeed/ops/op_builder/__init__.py' 2021-06-23T17:32:36,943 adding 'deepspeed/ops/op_builder/async_io.py' 2021-06-23T17:32:36,945 adding 'deepspeed/ops/op_builder/builder.py' 2021-06-23T17:32:36,946 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2021-06-23T17:32:36,948 adding 'deepspeed/ops/op_builder/fused_adam.py' 2021-06-23T17:32:36,949 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2021-06-23T17:32:36,950 adding 'deepspeed/ops/op_builder/quantizer.py' 2021-06-23T17:32:36,951 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2021-06-23T17:32:36,952 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2021-06-23T17:32:36,954 adding 'deepspeed/ops/op_builder/transformer.py' 2021-06-23T17:32:36,955 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2021-06-23T17:32:36,956 adding 'deepspeed/ops/op_builder/utils.py' 2021-06-23T17:32:36,958 adding 'deepspeed/ops/quantizer/__init__.py' 2021-06-23T17:32:36,959 adding 'deepspeed/ops/quantizer/quantizer.py' 2021-06-23T17:32:36,961 adding 'deepspeed/ops/sparse_attention/__init__.py' 2021-06-23T17:32:36,962 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2021-06-23T17:32:36,965 adding 'deepspeed/ops/sparse_attention/matmul.py' 2021-06-23T17:32:36,967 adding 'deepspeed/ops/sparse_attention/softmax.py' 2021-06-23T17:32:36,969 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2021-06-23T17:32:36,971 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2021-06-23T17:32:36,974 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2021-06-23T17:32:36,976 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2021-06-23T17:32:36,978 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2021-06-23T17:32:36,979 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2021-06-23T17:32:36,980 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2021-06-23T17:32:36,982 adding 'deepspeed/ops/transformer/__init__.py' 2021-06-23T17:32:36,985 adding 'deepspeed/ops/transformer/transformer.py' 2021-06-23T17:32:36,987 adding 'deepspeed/ops/transformer/inference/__init__.py' 2021-06-23T17:32:36,990 adding 'deepspeed/ops/transformer/inference/transformer_inference.py' 2021-06-23T17:32:36,992 adding 'deepspeed/pipe/__init__.py' 2021-06-23T17:32:36,994 adding 'deepspeed/profiling/__init__.py' 2021-06-23T17:32:36,995 adding 'deepspeed/profiling/config.py' 2021-06-23T17:32:36,996 adding 'deepspeed/profiling/constants.py' 2021-06-23T17:32:36,998 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2021-06-23T17:32:37,002 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2021-06-23T17:32:37,004 adding 'deepspeed/runtime/__init__.py' 2021-06-23T17:32:37,008 adding 'deepspeed/runtime/config.py' 2021-06-23T17:32:37,010 adding 'deepspeed/runtime/config_utils.py' 2021-06-23T17:32:37,011 adding 'deepspeed/runtime/constants.py' 2021-06-23T17:32:37,013 adding 'deepspeed/runtime/csr_tensor.py' 2021-06-23T17:32:37,014 adding 'deepspeed/runtime/dataloader.py' 2021-06-23T17:32:37,016 adding 'deepspeed/runtime/eigenvalue.py' 2021-06-23T17:32:37,027 adding 'deepspeed/runtime/engine.py' 2021-06-23T17:32:37,031 adding 'deepspeed/runtime/lr_schedules.py' 2021-06-23T17:32:37,033 adding 'deepspeed/runtime/progressive_layer_drop.py' 2021-06-23T17:32:37,035 adding 'deepspeed/runtime/quantize.py' 2021-06-23T17:32:37,037 adding 'deepspeed/runtime/state_dict_factory.py' 2021-06-23T17:32:37,040 adding 'deepspeed/runtime/utils.py' 2021-06-23T17:32:37,041 adding 'deepspeed/runtime/weight_quantizer.py' 2021-06-23T17:32:37,043 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2021-06-23T17:32:37,047 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2021-06-23T17:32:37,049 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2021-06-23T17:32:37,050 adding 'deepspeed/runtime/comm/__init__.py' 2021-06-23T17:32:37,052 adding 'deepspeed/runtime/comm/mpi.py' 2021-06-23T17:32:37,053 adding 'deepspeed/runtime/comm/nccl.py' 2021-06-23T17:32:37,055 adding 'deepspeed/runtime/compression/__init__.py' 2021-06-23T17:32:37,056 adding 'deepspeed/runtime/compression/cupy.py' 2021-06-23T17:32:37,058 adding 'deepspeed/runtime/fp16/__init__.py' 2021-06-23T17:32:37,060 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2021-06-23T17:32:37,062 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2021-06-23T17:32:37,065 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2021-06-23T17:32:37,067 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2021-06-23T17:32:37,069 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2021-06-23T17:32:37,072 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2021-06-23T17:32:37,074 adding 'deepspeed/runtime/pipe/__init__.py' 2021-06-23T17:32:37,080 adding 'deepspeed/runtime/pipe/engine.py' 2021-06-23T17:32:37,083 adding 'deepspeed/runtime/pipe/module.py' 2021-06-23T17:32:37,085 adding 'deepspeed/runtime/pipe/p2p.py' 2021-06-23T17:32:37,087 adding 'deepspeed/runtime/pipe/schedule.py' 2021-06-23T17:32:37,090 adding 'deepspeed/runtime/pipe/topology.py' 2021-06-23T17:32:37,092 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2021-06-23T17:32:37,093 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2021-06-23T17:32:37,094 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2021-06-23T17:32:37,096 adding 'deepspeed/runtime/swap_tensor/constants.py' 2021-06-23T17:32:37,099 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2021-06-23T17:32:37,101 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2021-06-23T17:32:37,104 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2021-06-23T17:32:37,106 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2021-06-23T17:32:37,107 adding 'deepspeed/runtime/swap_tensor/utils.py' 2021-06-23T17:32:37,109 adding 'deepspeed/runtime/zero/__init__.py' 2021-06-23T17:32:37,111 adding 'deepspeed/runtime/zero/config.py' 2021-06-23T17:32:37,112 adding 'deepspeed/runtime/zero/constants.py' 2021-06-23T17:32:37,114 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2021-06-23T17:32:37,116 adding 'deepspeed/runtime/zero/linear.py' 2021-06-23T17:32:37,117 adding 'deepspeed/runtime/zero/offload_config.py' 2021-06-23T17:32:37,118 adding 'deepspeed/runtime/zero/offload_constants.py' 2021-06-23T17:32:37,124 adding 'deepspeed/runtime/zero/partition_parameters.py' 2021-06-23T17:32:37,130 adding 'deepspeed/runtime/zero/stage1.py' 2021-06-23T17:32:37,141 adding 'deepspeed/runtime/zero/stage2.py' 2021-06-23T17:32:37,157 adding 'deepspeed/runtime/zero/stage3.py' 2021-06-23T17:32:37,159 adding 'deepspeed/runtime/zero/test.py' 2021-06-23T17:32:37,161 adding 'deepspeed/runtime/zero/tiling.py' 2021-06-23T17:32:37,163 adding 'deepspeed/runtime/zero/utils.py' 2021-06-23T17:32:37,164 adding 'deepspeed/utils/__init__.py' 2021-06-23T17:32:37,166 adding 'deepspeed/utils/distributed.py' 2021-06-23T17:32:37,167 adding 'deepspeed/utils/logging.py' 2021-06-23T17:32:37,168 adding 'deepspeed/utils/timer.py' 2021-06-23T17:32:37,170 adding 'deepspeed/utils/zero_to_fp32.py' 2021-06-23T17:32:37,172 adding 'deepspeed-0.4.1.data/scripts/deepspeed' 2021-06-23T17:32:37,173 adding 'deepspeed-0.4.1.data/scripts/deepspeed.pt' 2021-06-23T17:32:37,174 adding 'deepspeed-0.4.1.data/scripts/ds' 2021-06-23T17:32:37,175 adding 'deepspeed-0.4.1.data/scripts/ds_elastic' 2021-06-23T17:32:37,176 adding 'deepspeed-0.4.1.data/scripts/ds_report' 2021-06-23T17:32:37,177 adding 'deepspeed-0.4.1.data/scripts/ds_ssh' 2021-06-23T17:32:37,180 adding 'op_builder/__init__.py' 2021-06-23T17:32:37,181 adding 'op_builder/async_io.py' 2021-06-23T17:32:37,184 adding 'op_builder/builder.py' 2021-06-23T17:32:37,185 adding 'op_builder/cpu_adam.py' 2021-06-23T17:32:37,186 adding 'op_builder/fused_adam.py' 2021-06-23T17:32:37,187 adding 'op_builder/fused_lamb.py' 2021-06-23T17:32:37,189 adding 'op_builder/quantizer.py' 2021-06-23T17:32:37,190 adding 'op_builder/sparse_attn.py' 2021-06-23T17:32:37,191 adding 'op_builder/stochastic_transformer.py' 2021-06-23T17:32:37,192 adding 'op_builder/transformer.py' 2021-06-23T17:32:37,193 adding 'op_builder/transformer_inference.py' 2021-06-23T17:32:37,194 adding 'op_builder/utils.py' 2021-06-23T17:32:37,197 adding 'deepspeed-0.4.1.dist-info/METADATA' 2021-06-23T17:32:37,198 adding 'deepspeed-0.4.1.dist-info/WHEEL' 2021-06-23T17:32:37,199 adding 'deepspeed-0.4.1.dist-info/entry_points.txt' 2021-06-23T17:32:37,200 adding 'deepspeed-0.4.1.dist-info/top_level.txt' 2021-06-23T17:32:37,202 adding 'deepspeed-0.4.1.dist-info/RECORD' 2021-06-23T17:32:37,215 removing build/bdist.linux-armv7l/wheel 2021-06-23T17:32:37,292 deepspeed build time = 3.33646297454834 secs 2021-06-23T17:32:37,363 Building wheel for deepspeed (setup.py): finished with status 'done' 2021-06-23T17:32:37,371 Created wheel for deepspeed: filename=deepspeed-0.4.1-py3-none-any.whl size=447001 sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 2021-06-23T17:32:37,371 Stored in directory: /tmp/pip-ephem-wheel-cache-j0vxbs93/wheels/91/52/c6/cf7ecba6ecef354b90708076acf236e7a1aa0c1047cb85dc5d 2021-06-23T17:32:37,388 Successfully built deepspeed 2021-06-23T17:32:37,407 Removed build tracker: '/tmp/pip-req-tracker-j9j0a9sr'