2021-07-31T22:15:13,285 Created temporary directory: /tmp/pip-ephem-wheel-cache-os7n25ta
2021-07-31T22:15:13,289 Created temporary directory: /tmp/pip-req-tracker-srotvc_v
2021-07-31T22:15:13,290 Initialized build tracking at /tmp/pip-req-tracker-srotvc_v
2021-07-31T22:15:13,290 Created build tracker: /tmp/pip-req-tracker-srotvc_v
2021-07-31T22:15:13,290 Entered build tracker: /tmp/pip-req-tracker-srotvc_v
2021-07-31T22:15:13,291 Created temporary directory: /tmp/pip-wheel-v5vnxaa0
2021-07-31T22:15:13,323 WARNING: The index url "/" seems invalid, please provide a scheme.
2021-07-31T22:15:13,323 WARNING: The index url "t" seems invalid, please provide a scheme.
2021-07-31T22:15:13,324 WARNING: The index url "m" seems invalid, please provide a scheme.
2021-07-31T22:15:13,324 WARNING: The index url "p" seems invalid, please provide a scheme.
2021-07-31T22:15:13,324 Looking in indexes: https://pypi.org/simple, /, t, m, p
2021-07-31T22:15:13,327 WARNING: Location '/deepspeed/' is ignored: it is either a non-existing path or lacks a specific scheme.
2021-07-31T22:15:13,328 WARNING: Location 't/deepspeed/' is ignored: it is either a non-existing path or lacks a specific scheme.
2021-07-31T22:15:13,328 WARNING: Location 'm/deepspeed/' is ignored: it is either a non-existing path or lacks a specific scheme.
2021-07-31T22:15:13,328 WARNING: Location 'p/deepspeed/' is ignored: it is either a non-existing path or lacks a specific scheme.
2021-07-31T22:15:13,328 1 location(s) to search for versions of deepspeed:
2021-07-31T22:15:13,328 * https://pypi.org/simple/deepspeed/
2021-07-31T22:15:13,329 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2021-07-31T22:15:13,329 Getting page https://pypi.org/simple/deepspeed/
2021-07-31T22:15:13,334 Found index url https://pypi.org/simple
2021-07-31T22:15:13,441   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/)
2021-07-31T22:15:13,441   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2021-07-31T22:15:13,441   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/)
2021-07-31T22:15:13,442   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2021-07-31T22:15:13,442   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/)
2021-07-31T22:15:13,442   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2021-07-31T22:15:13,443   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/)
2021-07-31T22:15:13,443   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2021-07-31T22:15:13,443   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/)
2021-07-31T22:15:13,443   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2021-07-31T22:15:13,444   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2021-07-31T22:15:13,444   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2021-07-31T22:15:13,444   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2021-07-31T22:15:13,445   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2021-07-31T22:15:13,445   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2021-07-31T22:15:13,445   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2021-07-31T22:15:13,445   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2021-07-31T22:15:13,446   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2021-07-31T22:15:13,446   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2021-07-31T22:15:13,446   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2021-07-31T22:15:13,447   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2021-07-31T22:15:13,447   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2021-07-31T22:15:13,447   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2021-07-31T22:15:13,448   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2021-07-31T22:15:13,448   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2021-07-31T22:15:13,448   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2021-07-31T22:15:13,449   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2021-07-31T22:15:13,449   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2021-07-31T22:15:13,449   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2021-07-31T22:15:13,449   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2021-07-31T22:15:13,450   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2021-07-31T22:15:13,450   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2021-07-31T22:15:13,450   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz#sha256=c1e4292d431a510d20694a40d8507d3386de79e842195410b92d2890a81131c4 (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2021-07-31T22:15:13,450   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2021-07-31T22:15:13,451 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2021-07-31T22:15:13,468 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2021-07-31T22:15:13,483 Collecting deepspeed==0.4.4
2021-07-31T22:15:13,485   Created temporary directory: /tmp/pip-unpack-rmrh8nej
2021-07-31T22:15:13,526   Downloading deepspeed-0.4.4.tar.gz (457 kB)
2021-07-31T22:15:14,453   Added deepspeed==0.4.4 from https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee to build tracker '/tmp/pip-req-tracker-srotvc_v'
2021-07-31T22:15:14,454     Running setup.py (path:/tmp/pip-wheel-v5vnxaa0/deepspeed_55be3cb5911b49e8ab433e02ec61e342/setup.py) egg_info for package deepspeed
2021-07-31T22:15:14,455     Created temporary directory: /tmp/pip-pip-egg-info-afq4n1g3
2021-07-31T22:15:14,455     Running command python setup.py egg_info
2021-07-31T22:15:15,579     fatal: not a git repository (or any of the parent directories): .git
2021-07-31T22:15:15,871     [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2021-07-31T22:15:15,871     �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2021-07-31T22:15:15,871     DS_BUILD_OPS=0
2021-07-31T22:15:15,872     �[93m [WARNING] �[0m unable to import torch, please install it first
2021-07-31T22:15:15,872     �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found.
2021-07-31T22:15:15,872     �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt
2021-07-31T22:15:15,872     �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2021-07-31T22:15:15,872     Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False}
2021-07-31T22:15:15,872     version=0.4.4, git_hash=unknown, git_branch=unknown
2021-07-31T22:15:15,872     install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging']
2021-07-31T22:15:15,873     compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True}
2021-07-31T22:15:15,873     ext_modules=[]
2021-07-31T22:15:15,873     running egg_info
2021-07-31T22:15:15,873     creating /tmp/pip-pip-egg-info-afq4n1g3/deepspeed.egg-info
2021-07-31T22:15:15,874     writing /tmp/pip-pip-egg-info-afq4n1g3/deepspeed.egg-info/PKG-INFO
2021-07-31T22:15:15,878     writing dependency_links to /tmp/pip-pip-egg-info-afq4n1g3/deepspeed.egg-info/dependency_links.txt
2021-07-31T22:15:15,880     writing entry points to /tmp/pip-pip-egg-info-afq4n1g3/deepspeed.egg-info/entry_points.txt
2021-07-31T22:15:15,881     writing requirements to /tmp/pip-pip-egg-info-afq4n1g3/deepspeed.egg-info/requires.txt
2021-07-31T22:15:15,882     writing top-level names to /tmp/pip-pip-egg-info-afq4n1g3/deepspeed.egg-info/top_level.txt
2021-07-31T22:15:15,884     writing manifest file '/tmp/pip-pip-egg-info-afq4n1g3/deepspeed.egg-info/SOURCES.txt'
2021-07-31T22:15:16,047     reading manifest file '/tmp/pip-pip-egg-info-afq4n1g3/deepspeed.egg-info/SOURCES.txt'
2021-07-31T22:15:16,049     reading manifest template 'MANIFEST.in'
2021-07-31T22:15:16,719     warning: no files found matching '*.cc' under directory 'deepspeed'
2021-07-31T22:15:16,874     warning: no files found matching '*.tr' under directory 'csrc'
2021-07-31T22:15:16,944     warning: no files found matching '*.cc' under directory 'csrc'
2021-07-31T22:15:16,944     adding license file 'LICENSE'
2021-07-31T22:15:16,962     writing manifest file '/tmp/pip-pip-egg-info-afq4n1g3/deepspeed.egg-info/SOURCES.txt'
2021-07-31T22:15:16,963     deepspeed build time = 1.377612829208374 secs
2021-07-31T22:15:17,030   Source in /tmp/pip-wheel-v5vnxaa0/deepspeed_55be3cb5911b49e8ab433e02ec61e342 has version 0.4.4, which satisfies requirement deepspeed==0.4.4 from https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee
2021-07-31T22:15:17,031   Removed deepspeed==0.4.4 from https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz#sha256=1890bcd076e72321470556fbff30a46eaed0bf8ef69c7c6a39b0febf6fc598ee from build tracker '/tmp/pip-req-tracker-srotvc_v'
2021-07-31T22:15:17,037 Created temporary directory: /tmp/pip-unpack-y9lqt21q
2021-07-31T22:15:17,037 Building wheels for collected packages: deepspeed
2021-07-31T22:15:17,042   Created temporary directory: /tmp/pip-wheel-j1breimm
2021-07-31T22:15:17,042   Building wheel for deepspeed (setup.py): started
2021-07-31T22:15:17,043   Destination directory: /tmp/pip-wheel-j1breimm
2021-07-31T22:15:17,043   Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-v5vnxaa0/deepspeed_55be3cb5911b49e8ab433e02ec61e342/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-v5vnxaa0/deepspeed_55be3cb5911b49e8ab433e02ec61e342/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-j1breimm
2021-07-31T22:15:17,735   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2021-07-31T22:15:17,751   �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2021-07-31T22:15:17,760   DS_BUILD_OPS=0
2021-07-31T22:15:17,761   �[93m [WARNING] �[0m unable to import torch, please install it first
2021-07-31T22:15:17,913   �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found.
2021-07-31T22:15:17,995   �[93m [WARNING] �[0m async_io: please install the libaio-dev package with apt
2021-07-31T22:15:17,996   �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2021-07-31T22:15:17,996   Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False}
2021-07-31T22:15:18,015   fatal: not a git repository (or any of the parent directories): .git
2021-07-31T22:15:18,018   version=0.4.4, git_hash=unknown, git_branch=unknown
2021-07-31T22:15:18,019   install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging']
2021-07-31T22:15:18,020   compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True}
2021-07-31T22:15:18,020   ext_modules=[]
2021-07-31T22:15:18,290   running bdist_wheel
2021-07-31T22:15:18,295   running build
2021-07-31T22:15:18,295   running build_py
2021-07-31T22:15:18,422   creating build
2021-07-31T22:15:18,423   creating build/lib
2021-07-31T22:15:18,423   creating build/lib/op_builder
2021-07-31T22:15:18,425   copying op_builder/transformer.py -> build/lib/op_builder
2021-07-31T22:15:18,427   copying op_builder/stochastic_transformer.py -> build/lib/op_builder
2021-07-31T22:15:18,428   copying op_builder/cpu_adam.py -> build/lib/op_builder
2021-07-31T22:15:18,430   copying op_builder/fused_lamb.py -> build/lib/op_builder
2021-07-31T22:15:18,432   copying op_builder/builder.py -> build/lib/op_builder
2021-07-31T22:15:18,435   copying op_builder/utils.py -> build/lib/op_builder
2021-07-31T22:15:18,437   copying op_builder/async_io.py -> build/lib/op_builder
2021-07-31T22:15:18,439   copying op_builder/fused_adam.py -> build/lib/op_builder
2021-07-31T22:15:18,441   copying op_builder/transformer_inference.py -> build/lib/op_builder
2021-07-31T22:15:18,442   copying op_builder/quantizer.py -> build/lib/op_builder
2021-07-31T22:15:18,444   copying op_builder/__init__.py -> build/lib/op_builder
2021-07-31T22:15:18,446   copying op_builder/sparse_attn.py -> build/lib/op_builder
2021-07-31T22:15:18,449   creating build/lib/deepspeed
2021-07-31T22:15:18,450   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2021-07-31T22:15:18,452   copying deepspeed/env_report.py -> build/lib/deepspeed
2021-07-31T22:15:18,454   copying deepspeed/__init__.py -> build/lib/deepspeed
2021-07-31T22:15:18,457   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2021-07-31T22:15:18,459   copying deepspeed/constants.py -> build/lib/deepspeed
2021-07-31T22:15:18,461   creating build/lib/deepspeed/elasticity
2021-07-31T22:15:18,462   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2021-07-31T22:15:18,465   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2021-07-31T22:15:18,467   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2021-07-31T22:15:18,469   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2021-07-31T22:15:18,472   creating build/lib/deepspeed/module_inject
2021-07-31T22:15:18,473   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2021-07-31T22:15:18,476   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2021-07-31T22:15:18,478   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2021-07-31T22:15:18,481   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2021-07-31T22:15:18,482   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2021-07-31T22:15:18,485   creating build/lib/deepspeed/inference
2021-07-31T22:15:18,486   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2021-07-31T22:15:18,489   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2021-07-31T22:15:18,491   creating build/lib/deepspeed/pipe
2021-07-31T22:15:18,492   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2021-07-31T22:15:18,495   creating build/lib/deepspeed/ops
2021-07-31T22:15:18,496   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2021-07-31T22:15:18,499   creating build/lib/deepspeed/utils
2021-07-31T22:15:18,500   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2021-07-31T22:15:18,502   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2021-07-31T22:15:18,504   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2021-07-31T22:15:18,507   copying deepspeed/utils/distributed.py -> build/lib/deepspeed/utils
2021-07-31T22:15:18,509   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2021-07-31T22:15:18,511   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2021-07-31T22:15:18,514   creating build/lib/deepspeed/launcher
2021-07-31T22:15:18,515   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2021-07-31T22:15:18,518   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2021-07-31T22:15:18,520   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2021-07-31T22:15:18,522   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2021-07-31T22:15:18,524   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2021-07-31T22:15:18,527   creating build/lib/deepspeed/profiling
2021-07-31T22:15:18,528   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2021-07-31T22:15:18,530   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2021-07-31T22:15:18,531   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2021-07-31T22:15:18,535   creating build/lib/deepspeed/runtime
2021-07-31T22:15:18,535   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,538   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,539   copying deepspeed/runtime/csr_tensor.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,541   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,544   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,547   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,549   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,552   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,556   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,559   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,562   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,565   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,567   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,570   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2021-07-31T22:15:18,573   creating build/lib/deepspeed/ops/transformer
2021-07-31T22:15:18,574   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2021-07-31T22:15:18,577   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2021-07-31T22:15:18,580   creating build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,581   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,583   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,585   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,587   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,589   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,592   copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,594   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,596   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,598   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,600   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,601   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,603   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2021-07-31T22:15:18,606   creating build/lib/deepspeed/ops/aio
2021-07-31T22:15:18,607   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2021-07-31T22:15:18,610   creating build/lib/deepspeed/ops/adam
2021-07-31T22:15:18,611   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2021-07-31T22:15:18,613   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2021-07-31T22:15:18,616   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2021-07-31T22:15:18,618   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2021-07-31T22:15:18,621   creating build/lib/deepspeed/ops/sparse_attention
2021-07-31T22:15:18,622   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2021-07-31T22:15:18,624   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2021-07-31T22:15:18,628   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2021-07-31T22:15:18,631   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2021-07-31T22:15:18,633   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2021-07-31T22:15:18,635   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2021-07-31T22:15:18,637   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2021-07-31T22:15:18,640   creating build/lib/deepspeed/ops/quantizer
2021-07-31T22:15:18,641   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2021-07-31T22:15:18,643   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2021-07-31T22:15:18,646   creating build/lib/deepspeed/ops/lamb
2021-07-31T22:15:18,647   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2021-07-31T22:15:18,650   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2021-07-31T22:15:18,652   creating build/lib/deepspeed/ops/transformer/inference
2021-07-31T22:15:18,653   copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference
2021-07-31T22:15:18,656   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2021-07-31T22:15:18,659   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2021-07-31T22:15:18,660   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2021-07-31T22:15:18,662   creating build/lib/deepspeed/profiling/flops_profiler
2021-07-31T22:15:18,663   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2021-07-31T22:15:18,665   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2021-07-31T22:15:18,670   creating build/lib/deepspeed/runtime/swap_tensor
2021-07-31T22:15:18,671   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2021-07-31T22:15:18,673   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2021-07-31T22:15:18,675   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2021-07-31T22:15:18,677   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2021-07-31T22:15:18,680   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2021-07-31T22:15:18,682   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2021-07-31T22:15:18,684   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2021-07-31T22:15:18,686   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2021-07-31T22:15:18,689   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2021-07-31T22:15:18,692   creating build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,693   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,696   copying deepspeed/runtime/zero/stage1.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,701   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,705   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,708   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,714   copying deepspeed/runtime/zero/offload_constants.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,716   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,718   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,721   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,723   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,725   copying deepspeed/runtime/zero/constants.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,727   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,729   copying deepspeed/runtime/zero/stage2.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,734   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2021-07-31T22:15:18,737   creating build/lib/deepspeed/runtime/pipe
2021-07-31T22:15:18,738   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2021-07-31T22:15:18,741   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2021-07-31T22:15:18,745   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2021-07-31T22:15:18,747   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2021-07-31T22:15:18,750   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2021-07-31T22:15:18,752   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2021-07-31T22:15:18,755   creating build/lib/deepspeed/runtime/comm
2021-07-31T22:15:18,756   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2021-07-31T22:15:18,758   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2021-07-31T22:15:18,760   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2021-07-31T22:15:18,763   creating build/lib/deepspeed/runtime/activation_checkpointing
2021-07-31T22:15:18,764   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2021-07-31T22:15:18,767   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2021-07-31T22:15:18,769   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2021-07-31T22:15:18,771   creating build/lib/deepspeed/runtime/compression
2021-07-31T22:15:18,772   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2021-07-31T22:15:18,774   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2021-07-31T22:15:18,776   creating build/lib/deepspeed/runtime/fp16
2021-07-31T22:15:18,777   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2021-07-31T22:15:18,780   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2021-07-31T22:15:18,782   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2021-07-31T22:15:18,784   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2021-07-31T22:15:18,787   creating build/lib/deepspeed/runtime/fp16/onebit
2021-07-31T22:15:18,788   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2021-07-31T22:15:18,791   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2021-07-31T22:15:18,794   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2021-07-31T22:15:18,795   running egg_info
2021-07-31T22:15:18,810   writing deepspeed.egg-info/PKG-INFO
2021-07-31T22:15:18,813   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2021-07-31T22:15:18,815   writing entry points to deepspeed.egg-info/entry_points.txt
2021-07-31T22:15:18,816   writing requirements to deepspeed.egg-info/requires.txt
2021-07-31T22:15:18,817   writing top-level names to deepspeed.egg-info/top_level.txt
2021-07-31T22:15:18,840   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2021-07-31T22:15:18,848   reading manifest template 'MANIFEST.in'
2021-07-31T22:15:19,482   warning: no files found matching '*.cc' under directory 'deepspeed'
2021-07-31T22:15:19,621   warning: no files found matching '*.tr' under directory 'csrc'
2021-07-31T22:15:19,685   warning: no files found matching '*.cc' under directory 'csrc'
2021-07-31T22:15:19,686   adding license file 'LICENSE'
2021-07-31T22:15:19,706   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2021-07-31T22:15:19,722   creating build/lib/deepspeed/ops/csrc
2021-07-31T22:15:19,722   creating build/lib/deepspeed/ops/csrc/adam
2021-07-31T22:15:19,723   copying deepspeed/ops/csrc/adam/compat.h -> build/lib/deepspeed/ops/csrc/adam
2021-07-31T22:15:19,726   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2021-07-31T22:15:19,729   copying deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/adam
2021-07-31T22:15:19,731   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2021-07-31T22:15:19,733   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2021-07-31T22:15:19,735   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2021-07-31T22:15:19,738   creating build/lib/deepspeed/ops/csrc/aio
2021-07-31T22:15:19,738   creating build/lib/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:19,739   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:19,743   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:19,745   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:19,747   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:19,749   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:19,752   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:19,754   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:19,755   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:19,758   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:19,760   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:19,763   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:19,765   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:19,768   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:19,771   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:19,774   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:19,776   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:19,778   creating build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,779   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,782   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,784   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,788   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,790   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,793   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,796   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,798   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,801   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,804   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,806   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,809   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,812   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,814   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,817   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,819   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,822   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2021-07-31T22:15:19,825   creating build/lib/deepspeed/ops/csrc/lamb
2021-07-31T22:15:19,826   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2021-07-31T22:15:19,828   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2021-07-31T22:15:19,832   creating build/lib/deepspeed/ops/csrc/quantization
2021-07-31T22:15:19,833   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2021-07-31T22:15:19,835   copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2021-07-31T22:15:19,839   creating build/lib/deepspeed/ops/csrc/sparse_attention
2021-07-31T22:15:19,840   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2021-07-31T22:15:19,843   creating build/lib/deepspeed/ops/csrc/transformer
2021-07-31T22:15:19,844   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-07-31T22:15:19,847   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-07-31T22:15:19,850   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2021-07-31T22:15:19,854   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-07-31T22:15:19,857   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-07-31T22:15:19,860   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-07-31T22:15:19,866   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-07-31T22:15:19,869   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2021-07-31T22:15:19,872   creating build/lib/deepspeed/ops/csrc/transformer/inference
2021-07-31T22:15:19,873   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:19,874   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:19,877   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:19,880   copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:19,883   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:19,887   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:19,890   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2021-07-31T22:15:19,891   copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2021-07-31T22:15:19,894   copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2021-07-31T22:15:19,897   copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2021-07-31T22:15:19,899   creating build/lib/deepspeed/ops/csrc/utils
2021-07-31T22:15:19,900   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2021-07-31T22:15:19,903   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2021-07-31T22:15:19,905   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2021-07-31T22:15:19,908   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2021-07-31T22:15:19,931   running build_scripts
2021-07-31T22:15:19,931   creating build/scripts-3.7
2021-07-31T22:15:19,933   copying and adjusting bin/deepspeed -> build/scripts-3.7
2021-07-31T22:15:19,934   copying and adjusting bin/deepspeed.pt -> build/scripts-3.7
2021-07-31T22:15:19,936   copying and adjusting bin/ds -> build/scripts-3.7
2021-07-31T22:15:19,937   copying bin/ds_ssh -> build/scripts-3.7
2021-07-31T22:15:19,940   copying and adjusting bin/ds_report -> build/scripts-3.7
2021-07-31T22:15:19,941   copying and adjusting bin/ds_elastic -> build/scripts-3.7
2021-07-31T22:15:19,942   changing mode of build/scripts-3.7/deepspeed from 644 to 755
2021-07-31T22:15:19,942   changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755
2021-07-31T22:15:19,942   changing mode of build/scripts-3.7/ds from 644 to 755
2021-07-31T22:15:19,943   changing mode of build/scripts-3.7/ds_report from 644 to 755
2021-07-31T22:15:19,943   changing mode of build/scripts-3.7/ds_elastic from 644 to 755
2021-07-31T22:15:19,949   installing to build/bdist.linux-armv7l/wheel
2021-07-31T22:15:19,949   running install
2021-07-31T22:15:19,950   running install_lib
2021-07-31T22:15:19,954   creating build/bdist.linux-armv7l
2021-07-31T22:15:19,955   creating build/bdist.linux-armv7l/wheel
2021-07-31T22:15:19,957   creating build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,958   copying build/lib/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,960   copying build/lib/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,962   copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,964   copying build/lib/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,966   copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,969   copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,971   copying build/lib/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,973   copying build/lib/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,975   copying build/lib/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,977   copying build/lib/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,979   copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,981   copying build/lib/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/op_builder
2021-07-31T22:15:19,984   creating build/bdist.linux-armv7l/wheel/deepspeed
2021-07-31T22:15:19,985   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed
2021-07-31T22:15:19,988   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2021-07-31T22:15:19,989   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2021-07-31T22:15:19,992   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2021-07-31T22:15:19,994   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2021-07-31T22:15:19,996   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2021-07-31T22:15:19,998   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed
2021-07-31T22:15:20,001   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-07-31T22:15:20,002   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-07-31T22:15:20,005   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-07-31T22:15:20,009   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-07-31T22:15:20,011   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-07-31T22:15:20,013   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2021-07-31T22:15:20,016   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2021-07-31T22:15:20,017   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2021-07-31T22:15:20,020   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference
2021-07-31T22:15:20,023   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2021-07-31T22:15:20,024   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe
2021-07-31T22:15:20,027   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2021-07-31T22:15:20,029   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2021-07-31T22:15:20,030   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2021-07-31T22:15:20,035   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2021-07-31T22:15:20,036   copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2021-07-31T22:15:20,039   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2021-07-31T22:15:20,041   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2021-07-31T22:15:20,044   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2021-07-31T22:15:20,046   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-07-31T22:15:20,047   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-07-31T22:15:20,052   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2021-07-31T22:15:20,053   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:20,054   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:20,057   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:20,060   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:20,062   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:20,065   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2021-07-31T22:15:20,069   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2021-07-31T22:15:20,070   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2021-07-31T22:15:20,072   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2021-07-31T22:15:20,075   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2021-07-31T22:15:20,077   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-07-31T22:15:20,080   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-07-31T22:15:20,083   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-07-31T22:15:20,087   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-07-31T22:15:20,090   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-07-31T22:15:20,094   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-07-31T22:15:20,097   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2021-07-31T22:15:20,101   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,102   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,104   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,107   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,109   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,112   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,114   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,116   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,118   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,120   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,123   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,125   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,128   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,131   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,133   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,135   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,137   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,139   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2021-07-31T22:15:20,141   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2021-07-31T22:15:20,143   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:20,144   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:20,146   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:20,149   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:20,151   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:20,153   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:20,155   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2021-07-31T22:15:20,158   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:20,159   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:20,161   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:20,163   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:20,166   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:20,168   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:20,170   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:20,173   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:20,175   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:20,177   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2021-07-31T22:15:20,181   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-07-31T22:15:20,182   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-07-31T22:15:20,185   copying build/lib/deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-07-31T22:15:20,188   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-07-31T22:15:20,190   copying build/lib/deepspeed/ops/csrc/adam/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-07-31T22:15:20,192   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-07-31T22:15:20,195   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2021-07-31T22:15:20,197   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2021-07-31T22:15:20,198   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2021-07-31T22:15:20,202   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2021-07-31T22:15:20,203   copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2021-07-31T22:15:20,206   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2021-07-31T22:15:20,209   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2021-07-31T22:15:20,210   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2021-07-31T22:15:20,213   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2021-07-31T22:15:20,214   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2021-07-31T22:15:20,216   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2021-07-31T22:15:20,220   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,221   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,223   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,225   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,228   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,230   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,232   copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,234   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,236   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,239   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,241   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,243   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,245   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2021-07-31T22:15:20,248   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2021-07-31T22:15:20,249   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2021-07-31T22:15:20,252   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2021-07-31T22:15:20,253   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2021-07-31T22:15:20,255   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2021-07-31T22:15:20,258   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2021-07-31T22:15:20,260   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2021-07-31T22:15:20,263   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-07-31T22:15:20,263   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-07-31T22:15:20,266   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-07-31T22:15:20,270   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-07-31T22:15:20,273   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2021-07-31T22:15:20,274   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2021-07-31T22:15:20,277   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2021-07-31T22:15:20,279   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2021-07-31T22:15:20,281   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2021-07-31T22:15:20,283   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-07-31T22:15:20,285   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-07-31T22:15:20,287   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-07-31T22:15:20,289   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2021-07-31T22:15:20,293   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2021-07-31T22:15:20,294   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2021-07-31T22:15:20,296   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2021-07-31T22:15:20,299   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2021-07-31T22:15:20,300   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2021-07-31T22:15:20,302   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2021-07-31T22:15:20,304   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops
2021-07-31T22:15:20,307   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-07-31T22:15:20,308   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-07-31T22:15:20,311   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-07-31T22:15:20,313   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-07-31T22:15:20,315   copying build/lib/deepspeed/utils/distributed.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-07-31T22:15:20,318   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-07-31T22:15:20,320   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils
2021-07-31T22:15:20,322   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed
2021-07-31T22:15:20,325   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed
2021-07-31T22:15:20,327   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed
2021-07-31T22:15:20,329   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-07-31T22:15:20,330   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-07-31T22:15:20,333   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-07-31T22:15:20,336   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-07-31T22:15:20,338   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-07-31T22:15:20,340   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher
2021-07-31T22:15:20,343   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2021-07-31T22:15:20,344   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2021-07-31T22:15:20,347   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2021-07-31T22:15:20,347   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2021-07-31T22:15:20,350   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2021-07-31T22:15:20,353   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2021-07-31T22:15:20,355   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling
2021-07-31T22:15:20,358   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,359   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,362   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-07-31T22:15:20,362   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-07-31T22:15:20,365   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-07-31T22:15:20,368   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-07-31T22:15:20,370   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-07-31T22:15:20,373   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-07-31T22:15:20,376   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-07-31T22:15:20,378   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-07-31T22:15:20,380   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-07-31T22:15:20,383   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2021-07-31T22:15:20,386   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,388   copying build/lib/deepspeed/runtime/csr_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,390   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,394   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,395   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,398   copying build/lib/deepspeed/runtime/zero/stage1.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,403   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,407   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,410   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,416   copying build/lib/deepspeed/runtime/zero/offload_constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,419   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,421   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,424   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,426   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,428   copying build/lib/deepspeed/runtime/zero/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,431   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,433   copying build/lib/deepspeed/runtime/zero/stage2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,438   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2021-07-31T22:15:20,441   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-07-31T22:15:20,442   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-07-31T22:15:20,446   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-07-31T22:15:20,450   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-07-31T22:15:20,452   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-07-31T22:15:20,455   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-07-31T22:15:20,458   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2021-07-31T22:15:20,462   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2021-07-31T22:15:20,463   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2021-07-31T22:15:20,465   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2021-07-31T22:15:20,468   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2021-07-31T22:15:20,472   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2021-07-31T22:15:20,473   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2021-07-31T22:15:20,477   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2021-07-31T22:15:20,480   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2021-07-31T22:15:20,482   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,485   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,489   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2021-07-31T22:15:20,490   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2021-07-31T22:15:20,493   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2021-07-31T22:15:20,495   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,498   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,503   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,508   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2021-07-31T22:15:20,509   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2021-07-31T22:15:20,511   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2021-07-31T22:15:20,514   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2021-07-31T22:15:20,517   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2021-07-31T22:15:20,519   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2021-07-31T22:15:20,522   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2021-07-31T22:15:20,525   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2021-07-31T22:15:20,527   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2021-07-31T22:15:20,530   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,533   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,537   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,539   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,542   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime
2021-07-31T22:15:20,544   running install_egg_info
2021-07-31T22:15:20,554   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.4.4-py3.7.egg-info
2021-07-31T22:15:20,570   running install_scripts
2021-07-31T22:15:20,625   creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data
2021-07-31T22:15:20,626   creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts
2021-07-31T22:15:20,627   copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts
2021-07-31T22:15:20,629   copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts
2021-07-31T22:15:20,630   copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts
2021-07-31T22:15:20,632   copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts
2021-07-31T22:15:20,634   copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts
2021-07-31T22:15:20,635   copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts
2021-07-31T22:15:20,637   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts/ds to 755
2021-07-31T22:15:20,637   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts/ds_report to 755
2021-07-31T22:15:20,637   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts/deepspeed.pt to 755
2021-07-31T22:15:20,637   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts/deepspeed to 755
2021-07-31T22:15:20,638   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts/ds_elastic to 755
2021-07-31T22:15:20,638   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.data/scripts/ds_ssh to 755
2021-07-31T22:15:20,700   adding license file "LICENSE" (matched pattern "LICEN[CS]E*")
2021-07-31T22:15:20,704   creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.4.dist-info/WHEEL
2021-07-31T22:15:20,706   creating '/tmp/pip-wheel-j1breimm/deepspeed-0.4.4-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2021-07-31T22:15:20,710   adding 'deepspeed/__init__.py'
2021-07-31T22:15:20,712   adding 'deepspeed/constants.py'
2021-07-31T22:15:20,713   adding 'deepspeed/env_report.py'
2021-07-31T22:15:20,714   adding 'deepspeed/git_version_info.py'
2021-07-31T22:15:20,716   adding 'deepspeed/git_version_info_installed.py'
2021-07-31T22:15:20,717   adding 'deepspeed/elasticity/__init__.py'
2021-07-31T22:15:20,719   adding 'deepspeed/elasticity/config.py'
2021-07-31T22:15:20,720   adding 'deepspeed/elasticity/constants.py'
2021-07-31T22:15:20,723   adding 'deepspeed/elasticity/elasticity.py'
2021-07-31T22:15:20,724   adding 'deepspeed/inference/__init__.py'
2021-07-31T22:15:20,726   adding 'deepspeed/inference/engine.py'
2021-07-31T22:15:20,728   adding 'deepspeed/launcher/__init__.py'
2021-07-31T22:15:20,729   adding 'deepspeed/launcher/constants.py'
2021-07-31T22:15:20,731   adding 'deepspeed/launcher/launch.py'
2021-07-31T22:15:20,732   adding 'deepspeed/launcher/multinode_runner.py'
2021-07-31T22:15:20,735   adding 'deepspeed/launcher/runner.py'
2021-07-31T22:15:20,736   adding 'deepspeed/module_inject/__init__.py'
2021-07-31T22:15:20,738   adding 'deepspeed/module_inject/inject.py'
2021-07-31T22:15:20,739   adding 'deepspeed/module_inject/module_quantize.py'
2021-07-31T22:15:20,742   adding 'deepspeed/module_inject/replace_module.py'
2021-07-31T22:15:20,744   adding 'deepspeed/module_inject/replace_policy.py'
2021-07-31T22:15:20,745   adding 'deepspeed/ops/__init__.py'
2021-07-31T22:15:20,747   adding 'deepspeed/ops/adam/__init__.py'
2021-07-31T22:15:20,749   adding 'deepspeed/ops/adam/cpu_adam.py'
2021-07-31T22:15:20,750   adding 'deepspeed/ops/adam/fused_adam.py'
2021-07-31T22:15:20,751   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2021-07-31T22:15:20,753   adding 'deepspeed/ops/aio/__init__.py'
2021-07-31T22:15:20,755   adding 'deepspeed/ops/csrc/adam/compat.h'
2021-07-31T22:15:20,758   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2021-07-31T22:15:20,760   adding 'deepspeed/ops/csrc/adam/custom_cuda_kernel.cu'
2021-07-31T22:15:20,761   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2021-07-31T22:15:20,762   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2021-07-31T22:15:20,764   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2021-07-31T22:15:20,767   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2021-07-31T22:15:20,769   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2021-07-31T22:15:20,770   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2021-07-31T22:15:20,771   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2021-07-31T22:15:20,773   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2021-07-31T22:15:20,774   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2021-07-31T22:15:20,776   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2021-07-31T22:15:20,777   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2021-07-31T22:15:20,779   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2021-07-31T22:15:20,780   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2021-07-31T22:15:20,782   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2021-07-31T22:15:20,783   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2021-07-31T22:15:20,785   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2021-07-31T22:15:20,786   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2021-07-31T22:15:20,787   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2021-07-31T22:15:20,789   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2021-07-31T22:15:20,791   adding 'deepspeed/ops/csrc/includes/Timer.h'
2021-07-31T22:15:20,792   adding 'deepspeed/ops/csrc/includes/context.h'
2021-07-31T22:15:20,794   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2021-07-31T22:15:20,795   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2021-07-31T22:15:20,797   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2021-07-31T22:15:20,798   adding 'deepspeed/ops/csrc/includes/dropout.h'
2021-07-31T22:15:20,800   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2021-07-31T22:15:20,801   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2021-07-31T22:15:20,802   adding 'deepspeed/ops/csrc/includes/gelu.h'
2021-07-31T22:15:20,804   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2021-07-31T22:15:20,805   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2021-07-31T22:15:20,807   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2021-07-31T22:15:20,808   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2021-07-31T22:15:20,809   adding 'deepspeed/ops/csrc/includes/softmax.h'
2021-07-31T22:15:20,811   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2021-07-31T22:15:20,812   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2021-07-31T22:15:20,815   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2021-07-31T22:15:20,817   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2021-07-31T22:15:20,819   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2021-07-31T22:15:20,822   adding 'deepspeed/ops/csrc/quantization/quantizer.cu'
2021-07-31T22:15:20,824   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2021-07-31T22:15:20,827   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2021-07-31T22:15:20,830   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2021-07-31T22:15:20,834   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2021-07-31T22:15:20,836   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2021-07-31T22:15:20,838   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2021-07-31T22:15:20,844   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2021-07-31T22:15:20,847   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2021-07-31T22:15:20,850   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2021-07-31T22:15:20,852   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2021-07-31T22:15:20,854   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2021-07-31T22:15:20,856   adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu'
2021-07-31T22:15:20,858   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2021-07-31T22:15:20,860   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2021-07-31T22:15:20,863   adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h'
2021-07-31T22:15:20,864   adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h'
2021-07-31T22:15:20,865   adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h'
2021-07-31T22:15:20,867   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2021-07-31T22:15:20,869   adding 'deepspeed/ops/lamb/__init__.py'
2021-07-31T22:15:20,870   adding 'deepspeed/ops/lamb/fused_lamb.py'
2021-07-31T22:15:20,872   adding 'deepspeed/ops/op_builder/__init__.py'
2021-07-31T22:15:20,874   adding 'deepspeed/ops/op_builder/async_io.py'
2021-07-31T22:15:20,876   adding 'deepspeed/ops/op_builder/builder.py'
2021-07-31T22:15:20,878   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2021-07-31T22:15:20,879   adding 'deepspeed/ops/op_builder/fused_adam.py'
2021-07-31T22:15:20,880   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2021-07-31T22:15:20,881   adding 'deepspeed/ops/op_builder/quantizer.py'
2021-07-31T22:15:20,882   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2021-07-31T22:15:20,883   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2021-07-31T22:15:20,885   adding 'deepspeed/ops/op_builder/transformer.py'
2021-07-31T22:15:20,886   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2021-07-31T22:15:20,887   adding 'deepspeed/ops/op_builder/utils.py'
2021-07-31T22:15:20,888   adding 'deepspeed/ops/quantizer/__init__.py'
2021-07-31T22:15:20,890   adding 'deepspeed/ops/quantizer/quantizer.py'
2021-07-31T22:15:20,891   adding 'deepspeed/ops/sparse_attention/__init__.py'
2021-07-31T22:15:20,893   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2021-07-31T22:15:20,896   adding 'deepspeed/ops/sparse_attention/matmul.py'
2021-07-31T22:15:20,899   adding 'deepspeed/ops/sparse_attention/softmax.py'
2021-07-31T22:15:20,901   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2021-07-31T22:15:20,903   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2021-07-31T22:15:20,906   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2021-07-31T22:15:20,909   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2021-07-31T22:15:20,910   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2021-07-31T22:15:20,912   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2021-07-31T22:15:20,913   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2021-07-31T22:15:20,915   adding 'deepspeed/ops/transformer/__init__.py'
2021-07-31T22:15:20,918   adding 'deepspeed/ops/transformer/transformer.py'
2021-07-31T22:15:20,920   adding 'deepspeed/ops/transformer/inference/__init__.py'
2021-07-31T22:15:20,923   adding 'deepspeed/ops/transformer/inference/transformer_inference.py'
2021-07-31T22:15:20,924   adding 'deepspeed/pipe/__init__.py'
2021-07-31T22:15:20,926   adding 'deepspeed/profiling/__init__.py'
2021-07-31T22:15:20,927   adding 'deepspeed/profiling/config.py'
2021-07-31T22:15:20,929   adding 'deepspeed/profiling/constants.py'
2021-07-31T22:15:20,930   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2021-07-31T22:15:20,935   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2021-07-31T22:15:20,938   adding 'deepspeed/runtime/__init__.py'
2021-07-31T22:15:20,942   adding 'deepspeed/runtime/config.py'
2021-07-31T22:15:20,943   adding 'deepspeed/runtime/config_utils.py'
2021-07-31T22:15:20,945   adding 'deepspeed/runtime/constants.py'
2021-07-31T22:15:20,947   adding 'deepspeed/runtime/csr_tensor.py'
2021-07-31T22:15:20,948   adding 'deepspeed/runtime/dataloader.py'
2021-07-31T22:15:20,950   adding 'deepspeed/runtime/eigenvalue.py'
2021-07-31T22:15:20,960   adding 'deepspeed/runtime/engine.py'
2021-07-31T22:15:20,964   adding 'deepspeed/runtime/lr_schedules.py'
2021-07-31T22:15:20,966   adding 'deepspeed/runtime/progressive_layer_drop.py'
2021-07-31T22:15:20,967   adding 'deepspeed/runtime/quantize.py'
2021-07-31T22:15:20,970   adding 'deepspeed/runtime/state_dict_factory.py'
2021-07-31T22:15:20,973   adding 'deepspeed/runtime/utils.py'
2021-07-31T22:15:20,974   adding 'deepspeed/runtime/weight_quantizer.py'
2021-07-31T22:15:20,976   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2021-07-31T22:15:20,980   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2021-07-31T22:15:20,982   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2021-07-31T22:15:20,983   adding 'deepspeed/runtime/comm/__init__.py'
2021-07-31T22:15:20,986   adding 'deepspeed/runtime/comm/mpi.py'
2021-07-31T22:15:20,987   adding 'deepspeed/runtime/comm/nccl.py'
2021-07-31T22:15:20,989   adding 'deepspeed/runtime/compression/__init__.py'
2021-07-31T22:15:20,990   adding 'deepspeed/runtime/compression/cupy.py'
2021-07-31T22:15:20,992   adding 'deepspeed/runtime/fp16/__init__.py'
2021-07-31T22:15:20,994   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2021-07-31T22:15:20,996   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2021-07-31T22:15:20,999   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2021-07-31T22:15:21,001   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2021-07-31T22:15:21,003   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2021-07-31T22:15:21,006   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2021-07-31T22:15:21,008   adding 'deepspeed/runtime/pipe/__init__.py'
2021-07-31T22:15:21,014   adding 'deepspeed/runtime/pipe/engine.py'
2021-07-31T22:15:21,018   adding 'deepspeed/runtime/pipe/module.py'
2021-07-31T22:15:21,020   adding 'deepspeed/runtime/pipe/p2p.py'
2021-07-31T22:15:21,022   adding 'deepspeed/runtime/pipe/schedule.py'
2021-07-31T22:15:21,024   adding 'deepspeed/runtime/pipe/topology.py'
2021-07-31T22:15:21,026   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2021-07-31T22:15:21,028   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2021-07-31T22:15:21,029   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2021-07-31T22:15:21,030   adding 'deepspeed/runtime/swap_tensor/constants.py'
2021-07-31T22:15:21,033   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2021-07-31T22:15:21,035   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2021-07-31T22:15:21,037   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2021-07-31T22:15:21,039   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2021-07-31T22:15:21,041   adding 'deepspeed/runtime/swap_tensor/utils.py'
2021-07-31T22:15:21,043   adding 'deepspeed/runtime/zero/__init__.py'
2021-07-31T22:15:21,045   adding 'deepspeed/runtime/zero/config.py'
2021-07-31T22:15:21,046   adding 'deepspeed/runtime/zero/constants.py'
2021-07-31T22:15:21,048   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2021-07-31T22:15:21,050   adding 'deepspeed/runtime/zero/linear.py'
2021-07-31T22:15:21,051   adding 'deepspeed/runtime/zero/offload_config.py'
2021-07-31T22:15:21,052   adding 'deepspeed/runtime/zero/offload_constants.py'
2021-07-31T22:15:21,058   adding 'deepspeed/runtime/zero/partition_parameters.py'
2021-07-31T22:15:21,065   adding 'deepspeed/runtime/zero/stage1.py'
2021-07-31T22:15:21,075   adding 'deepspeed/runtime/zero/stage2.py'
2021-07-31T22:15:21,093   adding 'deepspeed/runtime/zero/stage3.py'
2021-07-31T22:15:21,095   adding 'deepspeed/runtime/zero/test.py'
2021-07-31T22:15:21,097   adding 'deepspeed/runtime/zero/tiling.py'
2021-07-31T22:15:21,098   adding 'deepspeed/runtime/zero/utils.py'
2021-07-31T22:15:21,100   adding 'deepspeed/utils/__init__.py'
2021-07-31T22:15:21,101   adding 'deepspeed/utils/debug.py'
2021-07-31T22:15:21,103   adding 'deepspeed/utils/distributed.py'
2021-07-31T22:15:21,104   adding 'deepspeed/utils/logging.py'
2021-07-31T22:15:21,105   adding 'deepspeed/utils/timer.py'
2021-07-31T22:15:21,107   adding 'deepspeed/utils/zero_to_fp32.py'
2021-07-31T22:15:21,110   adding 'deepspeed-0.4.4.data/scripts/deepspeed'
2021-07-31T22:15:21,111   adding 'deepspeed-0.4.4.data/scripts/deepspeed.pt'
2021-07-31T22:15:21,112   adding 'deepspeed-0.4.4.data/scripts/ds'
2021-07-31T22:15:21,113   adding 'deepspeed-0.4.4.data/scripts/ds_elastic'
2021-07-31T22:15:21,114   adding 'deepspeed-0.4.4.data/scripts/ds_report'
2021-07-31T22:15:21,115   adding 'deepspeed-0.4.4.data/scripts/ds_ssh'
2021-07-31T22:15:21,118   adding 'op_builder/__init__.py'
2021-07-31T22:15:21,120   adding 'op_builder/async_io.py'
2021-07-31T22:15:21,122   adding 'op_builder/builder.py'
2021-07-31T22:15:21,124   adding 'op_builder/cpu_adam.py'
2021-07-31T22:15:21,125   adding 'op_builder/fused_adam.py'
2021-07-31T22:15:21,126   adding 'op_builder/fused_lamb.py'
2021-07-31T22:15:21,127   adding 'op_builder/quantizer.py'
2021-07-31T22:15:21,129   adding 'op_builder/sparse_attn.py'
2021-07-31T22:15:21,130   adding 'op_builder/stochastic_transformer.py'
2021-07-31T22:15:21,131   adding 'op_builder/transformer.py'
2021-07-31T22:15:21,132   adding 'op_builder/transformer_inference.py'
2021-07-31T22:15:21,133   adding 'op_builder/utils.py'
2021-07-31T22:15:21,135   adding 'deepspeed-0.4.4.dist-info/LICENSE'
2021-07-31T22:15:21,137   adding 'deepspeed-0.4.4.dist-info/METADATA'
2021-07-31T22:15:21,138   adding 'deepspeed-0.4.4.dist-info/WHEEL'
2021-07-31T22:15:21,139   adding 'deepspeed-0.4.4.dist-info/entry_points.txt'
2021-07-31T22:15:21,140   adding 'deepspeed-0.4.4.dist-info/top_level.txt'
2021-07-31T22:15:21,143   adding 'deepspeed-0.4.4.dist-info/RECORD'
2021-07-31T22:15:21,155   removing build/bdist.linux-armv7l/wheel
2021-07-31T22:15:21,241   deepspeed build time = 3.2195708751678467 secs
2021-07-31T22:15:21,319   Building wheel for deepspeed (setup.py): finished with status 'done'
2021-07-31T22:15:21,326   Created wheel for deepspeed: filename=deepspeed-0.4.4-py3-none-any.whl size=458765 sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584
2021-07-31T22:15:21,326   Stored in directory: /tmp/pip-ephem-wheel-cache-os7n25ta/wheels/a6/ef/85/94dfed512267afefc3304d24be49793d2da805291338dcf1a5
2021-07-31T22:15:21,350 Successfully built deepspeed
2021-07-31T22:15:21,365 Removed build tracker: '/tmp/pip-req-tracker-srotvc_v'